In Progress

Web Scraping Prototype: Kayak Flight Search Results (Java or PHP) over Proxy

I am looking for someone to build a prototype web scraping application in Java or PHP (preferably Java). The application needs to be able to scrape results from the Kayak flight search engine. As I only require a prototype, you do not need to implement the ability to perform multiple or complex searches. Simply scraping the results of a static search (such as [url removed, login to view]) into some kind of structured data is enough.

I need to be able to perform hundreds or thousands of searches a day. To my knowledge, Kayak only allows 40 searches per hour per IP address. The second requirement of this project is that the searches need to be able to be performed over a configurable proxy so that I can bypass this search limit.

The project deliverable is only the source code for your implementation. You do not need to implement any user interface elements or database. I want a prototype application that makes an anonymous search on Kayak and parses the search results into some kind of structured form (storing the relevant search result information into local variables and outputting them in the console is enough).

I am an an experienced software developer and the Kayak website has proven particularly difficult for me to scrape. Please provide some details about the approach you plan to take for this project in a private message when making your bid.

Skills: Data Mining, Java, PHP, Web Scraping

See more: flight search java, proxy flight search, flight search data php, web searches database, web search engine proxy, web developer search engine, web developer requirement, web developer local, software developer search, prototype making, private proxy search, nyc php developer, need java developer for a project, making a prototype, java web software, java developer application, developer console, build search engine, web developer nyc, prototype 3, software developer php, requirement of web developer, web software developer, search web information, search console

About the Employer:
( 2 reviews ) North Conway, Austria

Project ID: #4317066

Awarded to:

HyderBangash

I've checked the site source code. I've a solution for you. More details in private.

$100 USD in 3 days
(18 Reviews)
4.0

11 freelancers are bidding on average $197 for this job

zeke

I have lots of experience with writing web automation software, please see PMB for examples of my previous projects related to web automation. Available to start immediately and finish as soon as possible. Best Rega More

$250 USD in 3 days
(152 Reviews)
6.8
mantislin

Hi sir, please check PM, thx Kimi.

$248 USD in 5 days
(164 Reviews)
6.7
sergioes

HI, I have lot's of experience with web scrapping.

$75 USD in 2 days
(195 Reviews)
6.7
phpXpertbd

I worked on many similar projects, I have big experience in data mining projects. I can finish this task in short time, with the best quality.

$400 USD in 10 days
(27 Reviews)
6.0
FabioFelgueiras

Hi, i have done similar work and can provide you proxies to complete the task, i would like to do this as a vb.net desktop app, ready to start, can add me in skype fabiofelgueiras82

$70 USD in 5 days
(4 Reviews)
4.2
wbslivera

Hello, I can help you. Thanks

$100 USD in 5 days
(5 Reviews)
2.8
k0der

please check my pm

$150 USD in 5 days
(6 Reviews)
2.3
programer22

Hi I build spider engine for site which is now wish to be object of such activities (voucher site like retailmenot.com) so I know all about proxy problems :) I use curl and regular expression and need latest vertion p More

$500 USD in 21 days
(3 Reviews)
1.0
mxkarasek

Hi, I am very interested in cooperating with you.

$75 USD in 2 days
(0 Reviews)
0.0
Swaroborno

I have a great plan for this. Please go through PM.

$200 USD in 2 days
(0 Reviews)
0.0