Website scraper into database

This project was successfully completed by codedynamic for $300 USD in a day.

Get free quotes for a project like this
Project Budget
$250 - $750 USD
Completed In
1 day
Total Bids
Project Description

We are looking for an experienced coder to develop a web scraper coded in PHP (and preferably cURL) that places content into an MySQL database.

You will need to connect to a website (will disclose in private chat) that allows scraping in their terms but currently doesn't have an API, collect links matching a specific pattern (i.e. with reg ex), across multiple pages (paginated) after converting the javascript links into further pages (or by looping to say 100 pages, probably easier).

Then to connect to such individual pages and obtain content from certain header and paragraph HTML tags, and then insert into MySQL database.

The content should be made safe before being inserted into the database. Furthermore due to the requirements you will also need to write a basic script listing the database contents to prove it works but this is extremely easy to achieve and wont take up much time.

This project would suit a coder who has previously done web scrapping with PHP curl and MySQL and already has the scripting to modify.

We require a working prototype on your server before releasing funds.

Completed by:
Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online