Closed

Daily deal web scraper

This project received 33 bids from talented freelancers with an average bid price of $2489 USD.

Get free quotes for a project like this
Employer working
Project Budget
N/A
Total Bids
33
Project Description

We need a web scraper which will toggle through the list of websites (daily deal/eCommerce) and scrap all published deals with the following values:
deal_url, website, country_name, city, category, subcategory, original_price, selling_price, coupons_sold, merchant_name, merchant_address, deal_start_date, last_deal_ crawl_date.
Data should be stored in MS SQL Server.
Data should be scraped every 2 hours. When deal went offline, service should notice that and transfer the deal with final number of coupon sold in the 'Main Deal table'.
There is 40 different websites tho some of them use the same web platform. Adding new sites and changing the scraping logic need to be documented.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online