Scrape Data and store into MySQL database

  • Status Closed
  • Budget $30 - $250 USD
  • Total Bids 27

Project Description

What I am looking for is someone to scrape data from the FAA's website.

Here is the link to the main page. [url removed, login to view]

This page shows each TFR that is active. The code will have to find each link to the main TFR page and then follow that link. Once the main page for that selected TFR is opened you will see an XML file that is associated with the TFR. In this XML file is the data that I need scraped and inserted or updated into a MySQL database.

My idea is to scrape each TFR link into an Array and then in a foreach loop loop through and open each TRF link. I believe that each TFR link must be opened and a cookie stored before you can access the XML file because for some reason you can not direct link to the XML file. What happens when you do is that it takes you to the TFR page where you can find the XML file link. After the TFR page is opened then you can open the XML file and parse the data into a MySQL database.

Get free quotes for a project like this
Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online