I need a program written that can extract some criteria from each listing on amazon.
Basically I need to leverage amazon's MWS api data faster than I currently can with the data scraping software I am using. I can extract all the data I need from each category on amazon in about three weeks. And then it will take three more weeks for each category. The only problem is that is way to long.
I want to use all the bandwidth and processing power I have to do this as fast as I can. I want you to make it so you can customize the program to my up/down load bandwidth and my computer's performance capabilities. I have 18mbs download and 4mbs upload. I am also using an 17 3820.
I want to collect all the data for the entire amazon catalog, about 100 million+ products. I want the code to send the data into a csv or xml file with about 7 columns. I will need The product Title, Asin, Amount of reviews, Average star rating, Category it is found in, Price, and Sales rank.