Amazon Scraping Project - repost
- Status Closed
- Budget $30 - $250 USD
- Total Bids 14
What I want to do is be able to monitor certain listing pages on Amazon.com. I have the lists of ASIN numbers. It would run once a day on some lists and once a week on some.
Whenever a listing is available that wasn’t there before notify me of that listing (some lists of ASINs are this type). With this I want to know about any new listings.
Basically I know how to do it but I am not very good with scraping and I don’t have time. Basically store all of the OfferingIDs (all are different ) in a mysql database and then if there are any listings that were not there before put them on the results page and put them in the database so they will not be in the results again.
Run through all of the listings for each ASIN and use the condition all pages like: http://www.amazon.com/gp/offer-listing/030758836X/ref=zg_bs_books_price?ie=UTF8&condition=all so that all conditions are gone through (and go through all pages of listings).
Output the new listings that were never there before into an html page for that day that has the following information on it Title, Author, Binding, Publisher, Date, Edition, SellerName, Link to specific listing which is [url removed, login to view][ASIN HERE]/?ie=UTF8&m=[SellerID HERE], notes for that listing, condition (like Used - Acceptable or Collectable - Good).
Send an email when all are done.
Do this in a time delayed way so that it is fairly fast but like a regular viewer would do so Amazon doesn’t block me. Maybe random 10 to 20 second delay between pages. The option to add a proxy later (in case it gets to be to much and Amazon doesn't like it) would be excellent.
I will probably have maybe a few hundred of ASIN’s total but will probably more in the future.
There is no way to do this now with API. Only scraping.
Should be fairly simple, probably easy for some people.
If you don't have any questions or need clarification I could talk you on the chat here or I could send you a couple of screenshots to help show what i am talking about.Get free quotes for a project like this
Looking to make some money?
- Set your budget and the timeframe
- Outline your proposal
- Get paid for your work
Hire Freelancers who also bid on this project
Looking for work?
Work on projects like this and make money from home!Sign Up Now
- The New York Times
- Wall Street Journal
- Times Online