I have an xls of around 7000 UPC numbers along with their associated product number. I need to search on a specific website for each product UPC and scrape a specific div section in the HTML source code for each product. The HTML text will be saved in separate .txt files corresponding to each different product. The txt files are labeled as each product number--not UPC. The copied HTML text will be added to these txt files.
The software I use has added a zero at the beginning of most UPC numbers. If the first number is a zero it needs to be removed before searching is done.
Before doing all items I would like 10 test items (or rather the .txt files for 10 items) to be sent to me so I can make sure everything is working as expected on my end.
The website I want to scrape from uses AJAX.
I do not want this done manually.