Need some work done? Post a Project Today
We need help with design and development of Ski/Snowboarding website (www.snowgears.com) with aggregate content from multiple websites. We're looking for an aggregation site with content like http://www.o2gearshop.com/catalog/ where items/data under the Ski and Snowboard sections are scraped from multiple ecommerce websites like rei.com, amazon, o2gearshop.com, anymountain.net/, craiglist, etc.
Site would conduct a daily automatically crawl hundreds eCommerce sites to extract product data (eg. Brand, Product Name, Picture, Description, and Pricing information). Users of our site can then use this data to filter for specific products. Please keep ease of navigation and usability in mind when designing site. Also, provide timeline and mock of what site could potentially look like if you would like to be considered for the job.
Language preference is python using the Scrapy framework, but open to if you've had experience building similar sites in other languages.