What I am looking for is someone to scrape data from the FAA's website.
Here is the link to the main page. [url removed, login to view]
This page shows each TFR that is active. The code will have to find each link to the main TFR page and then follow that link. Once the main page for that selected TFR is opened you will see an XML file that is associated with the TFR. In this XML file is the data that I need scraped and inserted or updated into a MySQL database.
My idea is to scrape each TFR link into an Array and then in a foreach loop loop through and open each TRF link. I believe that each TFR link must be opened and a cookie stored before you can access the XML file because for some reason you can not direct link to the XML file. What happens when you do is that it takes you to the TFR page where you can find the XML file link. After the TFR page is opened then you can open the XML file and parse the data into a MySQL database.
26 freelancers are bidding on average $181 for this job
I have lots of experience with similar projects, please see PMB for links to my previous similar projects related to web scraping. Available to start immediately and finish within several hours. Best Regards, Zeke
Hi, I'm the sole author of www.bidintel.com, a bookmarklet based hardcore scraping app. It also saves the data to a database all done in real-time. I'll be happy to do your work.
Hello! I'm a US based developer and I'm interested in working on this project with you. I've done quite a bit of scraping and parsing work in the past, and I've sent a proof of concept of scraping the FAA site in a PM.
Data scraping expert here. Have automated software to ensure high accuracy of results. Please do not hesitate to contact me if you have any questions. I look forward to working with you.
Hello. I was watching the XML page of the TFR. This is a pretty easy thing to scraping data. Please let me know the structure data to insert into database. Note: We have all 65 TFR? or how to see more?