We have an e-commerce website with 200,000 sku's. We want to build a crawler which will crawl all competitor websites and dynamically update the price based on multiple conditions.
60 freelancers are bidding on average $21/hour for this job
Hello. I can build a crawler with PHP. The PHP script will scan all website in a list. There is a cronjob that call the PHP script every 5 minutes. Admin will have a cpanel to add and remove the website in scan list.