Project is to develop a PHP script that will scrape specified product data from 1 website and store that data in a MySQL database
1) Script must be written in PHP
2) Category URLs will be read from a MySQL table. You dont need to get all the category URLs, I will provide some samples
3) Scraped product data will include (category name, date, product name, product url, price, special price, description, large image url, brand)
4) Scraped data must be stored in a MySQL table
5) Script must have a rate-limiting capability (maximum requests per minute, and number of categories per execution)
6) Data should be obtained via PHP cURL, imported as a DOMDocument, and parsed via SimpleXML / XPath
7) Script should be designed to run once per day and exit after specified number of categories and their products have been processed.
8) Script should contain function to download image into specified directory on filesystem.
16 freelancers are bidding on average $196 for this job
hi, I did a lot these types of projects already. but my programs is windows based .net programs. if you interested in i can show a video of program and i can do this project in .net windows base for $50 in one day.