Website with aggregate content, Webcrawler

This project was awarded to softomaniac2011 for $750 USD.

Get free quotes for a project like this
Project Budget
$250 - $750 USD
Total Bids
Project Description

We need help with design and development of Ski/Snowboarding website ([url removed, login to view]) with aggregate content from multiple websites. We're looking for an aggregation site with content like [url removed, login to view] where items/data under the Ski and Snowboard sections are scraped from multiple ecommerce websites like [url removed, login to view], amazon, [url removed, login to view], [url removed, login to view], craiglist, etc.

Site would conduct a daily automatically crawl hundreds eCommerce sites to extract product data (eg. Brand, Product Name, Picture, Description, and Pricing information). Users of our site can then use this data to filter for specific products. Please keep ease of navigation and usability in mind when designing site. Also, provide timeline and mock of what site could potentially look like if you would like to be considered for the job.

Language preference is python using the Scrapy framework, but open to if you've had experience building similar sites in other languages.

Awarded to:

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online