Daily deal web scraper
This project received 33 bids from talented freelancers with an average bid price of $2489 USD.Get free quotes for a project like this
We need a web scraper which will toggle through the list of websites (daily deal/eCommerce) and scrap all published deals with the following values:
deal_url, website, country_name, city, category, subcategory, original_price, selling_price, coupons_sold, merchant_name, merchant_address, deal_start_date, last_deal_ crawl_date.
Data should be stored in MS SQL Server.
Data should be scraped every 2 hours. When deal went offline, service should notice that and transfer the deal with final number of coupon sold in the 'Main Deal table'.
There is 40 different websites tho some of them use the same web platform. Adding new sites and changing the scraping logic need to be documented.
Looking to make some money?
- Set your budget and the timeframe
- Outline your proposal
- Get paid for your work
Hire Freelancers who also bid on this project
Looking for work?
Work on projects like this and make money from home!Sign Up Now
- The New York Times
- Wall Street Journal
- Times Online