Daily deal web scraper

  • Status Closed
  • Budget N/A
  • Total Bids 33

Project Description

We need a web scraper which will toggle through the list of websites (daily deal/eCommerce) and scrap all published deals with the following values:

deal_url, website, country_name, city, category, subcategory, original_price, selling_price, coupons_sold, merchant_name, merchant_address, deal_start_date, last_deal_ crawl_date.

Data should be stored in MS SQL Server.

Data should be scraped every 2 hours. When deal went offline, service should notice that and transfer the deal with final number of coupon sold in the 'Main Deal table'.

There is 40 different websites tho some of them use the same web platform. Adding new sites and changing the scraping logic need to be documented.

Get free quotes for a project like this

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online