Another Scraping Project - repost
This project received 7 bids from talented freelancers with an average bid price of $210 USD.Get free quotes for a project like this
Browse Related Skills
Other things people do on Freelancer
Project Budget$30 - $250 USD
What I want to do is be able to monitor certain listing pages on Amazon.com. I have the lists of ASIN numbers. It would run once a day on some lists and once a week on some.
I have two ways I want to do this:
1. Whenever a listing is available that wasn’t there before notify me of that listing (some lists of ASINs are this type). With this I want to know about any new listings.
2. Whenever a listing is available that wasn’t there before that matches a few keywords in the notes (some lists are like this). I want to have to have two lists of keywords that I can use. With this one I want to know only about those that match certain keywords.
Basically I know how to do it but I am not very good with scraping and I don’t have time. Basically store all of the OfferingIDs (all are different - ) in a mysql database and then if there is any listings that were not there before put them on the results page and put them in the database so they will not be in the results again.
Run through all of the listings for each ASIN and use the condition all pages like: http://www.amazon.com/gp/offer-listing/030758836X/ref=zg_bs_books_price?ie=UTF8&condition=all so that all conditions are gone through (and go through all pages of listings).
Output the new listings that were never there before into an html page for that day that has the following information on it Title, Author, Binding, Publisher, Date, Edition, SellerName, Link to specific listing which is [url removed, login to view][ASIN HERE]/?ie=UTF8&m=[SellerID HERE], notes for that listing, condition (like Used - Acceptable or Collectable - Good).
Send an email when all are done.
Do this in a time delayed way so that it is fairly fast but like a regular viewer would do so Amazon doesn’t block me. Maybe random 10 to 20 second delay between pages.
I will probably have maybe a few hundred of ASIN’s total but will probably more in the future.
There is no way to do this now with API. Only scraping.
Should be fairly simple, probably easy for some people.
If you don't understand I could talk you on the chat here or I could send you a couple of screenshots to help show what i am talking about.
Looking to make some money?
- Set your budget and the timeframe
- Outline your proposal
- Get paid for your work
Hire Freelancers who also bid on this project
Looking for work?
Work on projects like this and make money from home!Sign Up Now
- The New York Times
- Wall Street Journal
- Times Online