Extract Name/Email addresses from completed orders to CSV
$50-100 USD
Closed
Posted over 8 years ago
$50-100 USD
Paid on delivery
You will need to write a Scrapy spider that successfully logs into Etsy and iterates over completed orders extracting First/Last name and email addresses.
Scrapy v1.0 should be used, a server running Ubuntu will be provided for development if necessary. I have the login portion complete (see code below), however now the goal is to extract the email addresses and first/last name from each of the sold orders page.
The information to extracted from the sold orders page is:
<li><a href="someemail">someemail</a></li>
and
data-to_user_display_name="Some Name"
The orders are sorted by: <div class="order" data-receipt-id="1024890424">
The name/email details are in a <div class="tt-inner"> for each order, the urls to be walked are:
[login to view URL],2,3,4,etc (until we run out of pages)
Data should be formatted in CSV follows:
name,email
somename,someemail
What is done so far:
from [login to view URL] import BaseSpider, CrawlSpider, Rule
from [login to view URL] import FormRequest
from loginform import fill_login_form
from [login to view URL] import HtmlXPathSelector
from [login to view URL] import SgmlLinkExtractor
class LoginSpider(BaseSpider):
name = "etsy"
allowed_domains = ["[login to view URL]"]
start_urls = ["[login to view URL]"]
login_user = "someuser"
login_pass = "somepass"
rules = (Rule(SgmlLinkExtractor(allow=("/your/orders/sold",))
, callback="parse_items", follow=True),
)
def parse(self, response):
args, url, method = fill_login_form([login to view URL], [login to view URL], self.login_user, self.login_pass)
return FormRequest(url, method=method, formdata=args, callback=self.parse_item)
def after_login(self, response):
if "avorites" in [login to view URL]:
print ' logged in'
else:
print 'not logged in'
return
def parse_item(self, response):
#TBD
Hi sir,
I am scraping expert, I have did too many similar projects, please check my feedback then you will know.
Can you tell me more details? then I will provide demo data for you.
Thanks,
Kimi
Hello. I am most experienced freelancer here in freelancer.com and expert in web scraping and data mining. I read your project description and i assure you that i can do this. Please send me website you want to scrape and details about data you want to scrape. Looking forward for your response. Thanks
I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs.
Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete this task and will only waste your time.
Hire me, a professional with a rock solid reputation and over 8 years of experience specifically in writing scraping code like this.
I know what I can and cannot do, and I won't waste your time by saying I can do something that I can't. because I exclusively write scraping code
I know what to expect and I will always live up to what I tell you, and will also deliver a higher quality final product than my competitors.
Regards
Hello Dear,
HERE Ready to start!!!
I can perfectly do it and interested for this project. I have lot of experience related and different types of projects. I am waiting to your quick positive reply.
Feel free ask me question if any.
Have a nice day and stay fine:-)
Thanks
Hello! I'm web scraping expert.
I use python scrapy framework. My scripts can run on windows or linux, but linux is preferably. I can schedule scripts on server if it is required.
I can scrape secured and protected sites, my crawlers can enter into login form, emulate ajax requests etc.
If site block IP i can use proxy or TOR. I can try avoid captha on site in avtomatic or manual mode.
I can export data into json, csv (excel), mysql, mongodb.
I have a lot of finish projects (google scraping, facebook scraping, yellow pages, webshops and other sites with lists of any items).
Hi, Sir:
I'm Alex from China. Nice to meet you. I've read the description thoughtfully. I know what you need.
If I would be choose to do this work, I'll write a php script which can:
1. log in the website with your name and password
2. go to specific web apges
3. extract data we need
4. save it in CSV format.
At last I'll deliver the script to you, 1st results as well.
In fact I have many works like yours. please check my feedback.
Hope work with you.
Regards,
Alex
Dear Sir/Ma'am,
I am a Web research and Data Entry expert. I checked and understood your requirements.
I can handle this job very well to your appreciation. I can find and extract the information from different websites into an Excel sheet.
I am ready to hear the details of the project more in detail now.
I have always created a long-term collaboration with my clients through hard work and quality output for a reasonable price.
If you have questions or doubts about anything, please feel free to ask me.
Sincerely,
Mir
Hello Sir
I have gone through your job posting. I can do the task perfectly as your project requirement. I am professional in web research, web scraping, data collection, data extraction and all type of database development. I will do the project 100% accurately.
I have a great experience for the same. I have conducted various similar and successful projects in past and are confident of delivering the best value and quality for you.
Please consider me. Thank you.
Expert web scraper here,I can fulfill all requirements and always submit work before deadline.I assure you high Quality Services. Consider me the best option for your project.