1. We are looking for all the main categories first 3 pages only.
2. We are looking to scrape only the products that do NOT have "amazon" direct ship.
3. Please provide a small sample of an excel spreadsheet with directions 1 and 2 above. Then simply, email a small sample of products you found, so we can see if you did correctly.
Link to scrape: http://www.amazon.com/gp/site-directory/ref=sa_menu_top_fullstore
All main categories. First three pages of each category only. We only want data of those products with NO AMAZON direct ship. We also, want to know how many competitors.
Columnn A Column B Column C
URL No Amazon Direct Ship 2 Competitors