Web Scraper

This project was awarded to cliver for $150 USD.

Get free quotes for a project like this
Employer working
Awarded to:
Skills Required
Project Budget
$30 - $250 USD
Total Bids
Project Description

I need:

1. a PHP script that can scrape a website,
2. parse the sections I identify (see attached JPG image) and
3. insert them into MYSQL (red circled data goes into one table, blue circled data goes into the other)

- I have a skeleton php script written with general instructions and provided a sample URL to use as a test case.
- I have made the 2 mysql tables necessary and put test case data inside them.

The script must be fast; but be sensitive to the site you are scraping from (be friendly).

Some ideas:

a) Pausing for a random number of seconds between 1 and 5 before scraping
b) Changing the browser headers before scraping (mozilla to IE,to opera, etc.)
c) use a http proxy (proxify, etc.)

I need it in 24 hours. I will provide sample data to those who PM me.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online