We need a web scraper which will toggle through the list of websites (daily deal/eCommerce) and scrap all published deals with the following values:
deal_url, website, country_name, city, category, subcategory, original_price, selling_price, coupons_sold, merchant_name, merchant_address, deal_start_date, last_deal_ crawl_date.
Data should be stored in MS SQL Server.
Data should be scraped every 2 hours. When deal went offline, service should notice that and transfer the deal with final number of coupon sold in the 'Main Deal table'.
There is 40 different websites tho some of them use the same web platform. Adding new sites and changing the scraping logic need to be documented.
26 freelancers are bidding on average $2605 for this job
Hi We are interested in your project and read your requirements.We have completed 150+ big projects in last 5 years. Please check private message board for details.