Scrape Data and store into MySQL database

Closed

What I am looking for is someone to scrape data from the FAA's website.

Here is the link to the main page. [url removed, login to view]

This page shows each TFR that is active. The code will have to find each link to the main TFR page and then follow that link. Once the main page for that selected TFR is opened you will see an XML file that is associated with the TFR. In this XML file is the data that I need scraped and inserted or updated into a MySQL database.

My idea is to scrape each TFR link into an Array and then in a foreach loop loop through and open each TRF link. I believe that each TFR link must be opened and a cookie stored before you can access the XML file because for some reason you can not direct link to the XML file. What happens when you do is that it takes you to the TFR page where you can find the XML file link. After the TFR page is opened then you can open the XML file and parse the data into a MySQL database.

Skills: HTML, MySQL, PHP

See more: scrape data mysql, scrape data website mysql, parse website, foreach in php and mysql, faa gov, xml scrape, xml php array, scrape selected data, scrape html, data scrape database, cookie store, mysql scrape website, scrape html data mysql, php mysql cookie, html data page, parse html link, php parse xml html, mysql inserted, parse array php, html parse link, php parse array, parse array, mysql store xml, parse data file, scrape code

About the Employer:
( 0 reviews ) Sebastian, United States

Project ID: #4727981

26 freelancers are bidding on average $181 for this job

e3d

Hello, I'm an expert in automated data scraping and have access to powerful servers with tons of proxies. There are alot of problems in parsing .gov sites as they require neat cookies to be passed as well as they wi More

$150 USD in 5 days
(66 Reviews)
7.8
rajeshsonisl

Quality work assured. Ready to get started. Thanks.

$618 USD in 3 days
(433 Reviews)
7.1
zeke

I have lots of experience with similar projects, please see PMB for links to my previous similar projects related to web scraping. Available to start immediately and finish within several hours. Best Regards, Zeke

$155 USD in 1 day
(155 Reviews)
6.8
linuxfreak1985

Hi there, We are experts in PHP Open Source (any kind of PHP/MySQL work),wordpress and Ajax/Web 2.0 technology. Some of the projects we completed for php are mentioned below https://www.freelancer.com/projects/ More

$257 USD in 3 days
(128 Reviews)
6.7
stdhtelkom

Hello, I am ready to help you. Please check pmb for more information. Thanks, Steve.

$250 USD in 3 days
(19 Reviews)
5.9
phpprogramming

i am interested in you project

$210 USD in 3 days
(69 Reviews)
5.9
gangabass

I'm expert in web scraping and MySQL. See my PM for details.

$175 USD in 3 days
(116 Reviews)
5.8
cheapexcell

Expert in PHP scraping. Ready to start.

$80 USD in 3 days
(84 Reviews)
5.8
ModularGuy

Hi, I'm the sole author of www.bidintel.com, a bookmarklet based hardcore scraping app. It also saves the data to a database all done in real-time. I'll be happy to do your work.

$290 USD in 5 days
(38 Reviews)
5.8
mauryacravings

Hello, I have 8 years of extensive experience in Web Application Development. Recently, I have added mobile development expertise in my portfolio which allows me to play dynamic role as per requirement. Following are More

$250 USD in 3 days
(15 Reviews)
5.5
eagle2k13

Hello! I'm a US based developer and I'm interested in working on this project with you. I've done quite a bit of scraping and parsing work in the past, and I've sent a proof of concept of scraping the FAA site in a PM.

$166 USD in 3 days
(26 Reviews)
5.2
Jeet81

Hi, i am experieced in making the web scrappers and store data in the databse Please check the pmb.

$166 USD in 3 days
(24 Reviews)
4.6
andreiandrei

Hi, please check PM.

$166 USD in 2 days
(3 Reviews)
4.5
cuteprince85

check pm !

$155 USD in 3 days
(7 Reviews)
4.4
scrapingsolution

Hi, I have done lots of similar type of projects before. I will create a desktop application to automate this task, so if you want later you can scrape the data without paying any money again. Please take a look More

$154 USD in 3 days
(19 Reviews)
4.4
nathan2022001

I am an expert in web automation and data scraping. I have sent you a PM. Regards, Nathan.

$155 USD in 7 days
(10 Reviews)
4.1
proauthor

Hi, Ready to start your work. Eagerly awaiting for your positive reply. Please check your inbox for further details. Thanks, Shaik.

$99 USD in 3 days
(9 Reviews)
4.1
GAnthonyMassie

I am interested. I can begin immediately and provide this quickly. Please check my PM for details.

$166 USD in 3 days
(15 Reviews)
3.8
vgrichards

Data scraping expert here. Have automated software to ensure high accuracy of results. Please do not hesitate to contact me if you have any questions. I look forward to working with you.

$100 USD in 5 days
(10 Reviews)
3.5
sonviet

Hello. I was watching the XML page of the TFR. This is a pretty easy thing to scraping data. Please let me know the structure data to insert into database. Note: We have all 65 TFR? or how to see more?

$133 USD in 2 days
(8 Reviews)
3.2