Web Scraper

  • Status Completed
  • Budget $2 - $25 USD / hour
  • Total Bids 14

Project Description

I want a scrapper that will access and copy the entire contents of certain public data bases, of which there are a large number, each with 100K to 400K records and each record has 100 to 400 fields.

I will give the page, the entry point and the pattern of the ID code.

The scraper should enter the beginning ID code, access the record, copy all the data, goto any links in the db, copy all the data in the link or copy the link itself, then download to a file, then do it again until all records are copied.

The entire database should be converted to an Excel file for manipulation on a personal computer.

The database should also be able to be loaded into an SQL [url removed, login to view] manipulation online.

Coder must speak very good English over Skype. Will need close verbal communication.

Must have project by September 17, 2013

I will require ownership of the code and code to be written in English.

Visual Basic is preferred but not required.

Must be able to speak with coder prior to accepting job to assure good English and that job can be done to satisfaction.

Get free quotes for a project like this
Completed by:

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online