You have chosen to sponsor your bid up to a maximum amount of .
We need a web scraper which will toggle through the list of websites (daily deal/eCommerce) and scrap all published deals with the following values:
deal_url, website, country_name, city, category, subcategory, original_price, selling_price, coupons_sold, merchant_name, merchant_address, deal_start_date, last_deal_ crawl_date.
Data should be stored in MS SQL Server.
Data should be scraped every 2 hours. When deal went offline, service should notice that and transfer the deal with final number of coupon sold in the 'Main Deal table'.
There is 40 different websites tho some of them use the same web platform. Adding new sites and changing the scraping logic need to be documented.