Ice Cat Scraper

This project received 20 bids from talented freelancers with an average bid price of €528 EUR.

Get free quotes for a project like this
Project Budget
€250 - €750 EUR
Total Bids
Project Description

I need an expert web scraper to scrape a website for information, put this info into a database and create an Intranet site to parse this information.

I need a feasibility study first before commencement, the right programmer will be needed again in the future for additional work.

This will be a difficult project so you must have proven samples of your work, your code will be examined and tested.

Scrape [url removed, login to view] using a scraper with the following capability:

Phase 1 -

Read an excel sheet of products

Go to the ice cat webpage

Search a product by name, EAN, Manufacturer Number or product code (we will need to be flexible)

Retrieve product page

Grab the following

Text boxes






Put the data into a database

Repeat for each product

Phase 2 - Export

Need ability to map data field

Example we might want Internal memory to map to a different word such as Memory

Allow data to map to additional fields

Example we might want Internal memory to map to Memory and also map to RAM (1+n number of fields)

Need ability to export all product data from database

Binarys to go in a folder based on product name

Text data to go to Excel File (master file)

Additional things

The scraper must be able to

Overcome all obstacles to retrieve its data, redirection scripts, cookies, leech protection etc

Cross navigate to get pictures from manufacturer websites, pictures must come back full size, uncompressed.

Rotate its queries through proxies specified in a proxy list to avoid any limits set by ip for HTTP requests, with an ability to set how many requests should be sent before changing proxy

The scraper must be bug free and well coded

Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online