Find Jobs
Hire Freelancers

Extract Name/Email addresses from completed orders to CSV

$50-100 USD

Closed
Posted over 8 years ago

$50-100 USD

Paid on delivery
You will need to write a Scrapy spider that successfully logs into Etsy and iterates over completed orders extracting First/Last name and email addresses. Scrapy v1.0 should be used, a server running Ubuntu will be provided for development if necessary. I have the login portion complete (see code below), however now the goal is to extract the email addresses and first/last name from each of the sold orders page. The information to extracted from the sold orders page is: <li><a href="someemail">someemail</a></li> and data-to_user_display_name="Some Name" The orders are sorted by: <div class="order" data-receipt-id="1024890424"> The name/email details are in a <div class="tt-inner"> for each order, the urls to be walked are: [login to view URL],2,3,4,etc (until we run out of pages) Data should be formatted in CSV follows: name,email somename,someemail What is done so far: from [login to view URL] import BaseSpider, CrawlSpider, Rule from [login to view URL] import FormRequest from loginform import fill_login_form from [login to view URL] import HtmlXPathSelector from [login to view URL] import SgmlLinkExtractor class LoginSpider(BaseSpider): name = "etsy" allowed_domains = ["[login to view URL]"] start_urls = ["[login to view URL]"] login_user = "someuser" login_pass = "somepass" rules = (Rule(SgmlLinkExtractor(allow=("/your/orders/sold",)) , callback="parse_items", follow=True), ) def parse(self, response): args, url, method = fill_login_form([login to view URL], [login to view URL], self.login_user, self.login_pass) return FormRequest(url, method=method, formdata=args, callback=self.parse_item) def after_login(self, response): if "avorites" in [login to view URL]: print ' logged in' else: print 'not logged in' return def parse_item(self, response): #TBD
Project ID: 8233242

About the project

19 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
19 freelancers are bidding on average $106 USD for this job
User Avatar
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$82 USD in 2 days
4.9 (101 reviews)
6.6
6.6
User Avatar
Hello. I am most experienced freelancer here in freelancer.com and expert in web scraping and data mining. I read your project description and i assure you that i can do this. Please send me website you want to scrape and details about data you want to scrape. Looking forward for your response. Thanks
$88 USD in 3 days
4.9 (130 reviews)
6.7
6.7
User Avatar
I am an expert in delivering custom scripts and willing to discuss further about the project needs .
$184 USD in 3 days
4.9 (69 reviews)
6.7
6.7
User Avatar
​I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete this task and will only waste your time. Hire me, a professional with a rock solid reputation and over 8 years of experience specifically in writing scraping code like this. I know what I can and cannot do, and I won't waste your time by saying I can do something that I can't. because I exclusively write scraping code I know what to expect and I will always live up to what I tell you, and will also deliver a higher quality final product than my competitors. Regards
$55 USD in 3 days
4.8 (134 reviews)
6.5
6.5
User Avatar
Hello Dear, I can do this for you. Please send a massage in the PMB for details.......Best Regards flashsaiful
$83 USD in 3 days
4.9 (73 reviews)
5.9
5.9
User Avatar
A proposal has not yet been provided
$100 USD in 2 days
4.8 (54 reviews)
5.8
5.8
User Avatar
Hello Dear, HERE Ready to start!!! I can perfectly do it and interested for this project. I have lot of experience related and different types of projects. I am waiting to your quick positive reply. Feel free ask me question if any. Have a nice day and stay fine:-) Thanks
$100 USD in 2 days
4.8 (61 reviews)
5.5
5.5
User Avatar
Hello! I'm web scraping expert. I use python scrapy framework. My scripts can run on windows or linux, but linux is preferably. I can schedule scripts on server if it is required. I can scrape secured and protected sites, my crawlers can enter into login form, emulate ajax requests etc. If site block IP i can use proxy or TOR. I can try avoid captha on site in avtomatic or manual mode. I can export data into json, csv (excel), mysql, mongodb. I have a lot of finish projects (google scraping, facebook scraping, yellow pages, webshops and other sites with lists of any items).
$80 USD in 3 days
4.9 (34 reviews)
5.3
5.3
User Avatar
Hi, Sir: I'm Alex from China. Nice to meet you. I've read the description thoughtfully. I know what you need. If I would be choose to do this work, I'll write a php script which can: 1. log in the website with your name and password 2. go to specific web apges 3. extract data we need 4. save it in CSV format. At last I'll deliver the script to you, 1st results as well. In fact I have many works like yours. please check my feedback. Hope work with you. Regards, Alex
$111 USD in 3 days
4.8 (14 reviews)
4.5
4.5
User Avatar
Dear Sir/Ma'am, I am a Web research and Data Entry expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can find and extract the information from different websites into an Excel sheet. I am ready to hear the details of the project more in detail now. I have always created a long-term collaboration with my clients through hard work and quality output for a reasonable price. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir
$100 USD in 3 days
4.9 (16 reviews)
4.1
4.1
User Avatar
Hello Sir I have gone through your job posting. I can do the task perfectly as your project requirement. I am professional in web research, web scraping, data collection, data extraction and all type of database development. I will do the project 100% accurately. I have a great experience for the same. I have conducted various similar and successful projects in past and are confident of delivering the best value and quality for you. Please consider me. Thank you.
$100 USD in 3 days
5.0 (16 reviews)
4.1
4.1
User Avatar
Expert web scraper here,I can fulfill all requirements and always submit work before deadline.I assure you high Quality Services. Consider me the best option for your project.
$50 USD in 3 days
5.0 (17 reviews)
3.1
3.1
User Avatar
I have performed similar work in the past. I have lots of python experience. The site seems easy to crawl. I can provide csv (or .xls, or .xlsx, ...)
$222 USD in 3 days
5.0 (1 review)
3.1
3.1
User Avatar
A proposal has not yet been provided
$83 USD in 3 days
5.0 (2 reviews)
1.1
1.1
User Avatar
I can make this scrapper and extract the information you wanted exactly. Please share further details if any and contact me for more details
$83 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
accept project and send server login details
$111 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$77 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Chicago, United States
5.0
1
Member since Mar 6, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.