I am looking for someone to build a prototype web scraping application in Java or PHP (preferably Java). The application needs to be able to scrape results from the Kayak flight search engine. As I only require a prototype, you do not need to implement the ability to perform multiple or complex searches. Simply scraping the results of a static search (such as [url removed, login to view]) into some kind of structured data is enough.
I need to be able to perform hundreds or thousands of searches a day. To my knowledge, Kayak only allows 40 searches per hour per IP address. The second requirement of this project is that the searches need to be able to be performed over a configurable proxy so that I can bypass this search limit.
The project deliverable is only the source code for your implementation. You do not need to implement any user interface elements or database. I want a prototype application that makes an anonymous search on Kayak and parses the search results into some kind of structured form (storing the relevant search result information into local variables and outputting them in the console is enough).
I am an an experienced software developer and the Kayak website has proven particularly difficult for me to scrape. Please provide some details about the approach you plan to take for this project in a private message when making your bid.
11 freelancers are bidding on average $197 for this job
Hi, i have done similar work and can provide you proxies to complete the task, i would like to do this as a vb.net desktop app, ready to start, can add me in skype fabiofelgueiras82