Web Scraping Prototype: Kayak Flight Search Results (Java or PHP) over Proxy

Budget $30 - $250 USD
Bids 11
Average Bid $197

I am looking for someone to build a prototype web scraping application in Java or PHP (preferably Java). The application needs to be able to scrape results from the Kayak flight search engine. As I only require a prototype, you do not need to implement the ability to perform multiple or complex searches. Simply scraping the results of a static search (such as [url removed, login to view]) into some kind of structured data is enough.

I need to be able to perform hundreds or thousands of searches a day. To my knowledge, Kayak only allows 40 searches per hour per IP address. The second requirement of this project is that the searches need to be able to be performed over a configurable proxy so that I can bypass this search limit.

The project deliverable is only the source code for your implementation. You do not need to implement any user interface elements or database. I want a prototype application that makes an anonymous search on Kayak and parses the search results into some kind of structured form (storing the relevant search result information into local variables and outputting them in the console is enough).

I am an an experienced software developer and the Kayak website has proven particularly difficult for me to scrape. Please provide some details about the approach you plan to take for this project in a private message when making your bid.

Post a Project Like This

This project was awarded to

HyderBangash

From start to finish Hyder was professional and thorough in his work. He always understood what was being requested and helped me install the system with great guidance and clarity. His technical ability is exemplary and his communication was flawless. I was so impressed with the first project, I instantly awarded the second project without hesitation. His delivery was always ahead of schedule and he met budget will definitely keep to Hyder for all future projects!
About the Freelancer
HyderBangash Profile Picture

Hello! I'm Hyder from the beautiful island of Mauritius. I'm an independent web developer with 4+ years of experience. I'm proficient in PHP, MySQL, jQuery, CSS and HTML. I have extensive experience in working with PHP and the LAMP stack. I offer PHP development services and work with technologies such as CodeIgniter, Laravel and more! I write excellent PHP code with proper standards and good architecture as my number 1 priority. From time to time, I blog about programming at http://youhack.me. Thanks for reading =)

Looking to make some money?

  • Set your budget and the time frame
  • Outline your proposal
  • Get paid for your work

Bids on this Project

  • zeke Profile Picture

    zeke

    Hidden,  Russian Federation

    Expert PHP/MySQL developer with over 6 years of experience. My bid is for fast professional service exciting my customers.

    PHP, C Programming, Java, and Javascript

  • HyderBangash Profile Picture

    HyderBangash

    Vacoas,  Mauritius

    Hello! I'm Hyder from the beautiful island of Mauritius. I'm an independent web developer with 4+ years of experience. I'm proficient in PHP, MySQL, jQuery, CSS and HTML. I have extensive experience in working with PHP and the LAMP stack. I offer PHP development services and work with technologies such as CodeIgniter, Laravel and more! I write excellent PHP code with proper standards and good architecture as my number 1 priority. From time to time, I blog about programming at http://youhack.me. Thanks for reading =)

    Java, Javascript, XML, and Script Install

  • programer22 Profile Picture

    programer22

    Varna,  Bulgaria

    Hi I have experience with PHP more than 10 years, including more than 5 years OOP Zendframework. I use and CSS, XHTM ( some experience with CSS3, HTML5) Myqsql, oracle sql, pgsql, js, ajax (jquery, YUI, from scratch ). I use i some degree C++ (qt, gtkmm), java to build desktop application mainly to build application that working with web site, messager other clients.

    PHP, C Programming, XML, and Linux

  • Swaroborno Profile Picture

    Swaroborno

    Dhaka,  Bangladesh

    Desktop Software, Database, Photo Editing, Web Design, Desktop Application, Data Analysis, Data Migration, Data Processing, Web Content, Web Programming, Webmaster, Photoshop, Flash, MS Access, MSSQL, Visual Basic, VB, PHP, MySQL, AJAX

    PHP, Java, Visual Basic, and .NET

  • phpXpertbd Profile Picture

    phpXpertbd

    Dhaka,  Bangladesh

    Custom Website Development E-commerce website development with Opencart Website Data Scraping and saving into XLSX, XLS, CSV, TSV, MySQL, MSSQL, XML, PDF Making another website with the scraped data Website Cloning Issues or bug fixes in the website Ongoing maintenance, administration or supports Etc...

    PHP, Perl, Javascript, and XML

  • wbslivera Profile Picture

    wbslivera

    Minuwangoda,  Sri Lanka

    I am a graduate of BSCIT and an oracle certified professional. I like to work in the programming field and any other technical area which fits. I have done many programming projects.

    PHP, C Programming, Java, and Javascript

  • mxkarasek Profile Picture

    mxkarasek

    Czech Republic,  Czech Republic

    sw developer

    C Programming, Java, Python, and Ruby on Rails

  • FabioFelgueiras Profile Picture

    FabioFelgueiras

    Faro,  Portugal

    Coding is my Life, i love what i do, and i doit good, im perfectionist and can develop the solution that you need.

    Java, Adobe Flash, Visual Basic, and .NET

  • sergioes Profile Picture

    sergioes

    Barcelona,  Spain

    My name is Sergio and I'm the lead of Sergioes, a team committed to provide the best combination of quality and price in Freelancer since 2005. Some areas of expertise: - Agile software project management. Specifications, recruiting, quality assurance and project tracking. - LAMP and MEAN Web development. - Data extraction and analysis. Crawlers, custom search and metasearch engines. Advanced signal procesing, data analysis and statistical decision support programming. - Java/J2EE/J2ME. Highly skilled in distributed computing and web services. JSP, Servlets. GUI design. JDBC. SAX, DOM, JDOM. SOAP (Axis). Netbeans, Eclipse and JBuilder IDEs. Bytecode analysis. Entreprise Java Beans (EJB). - Networking: design, testing, programming, analysis, and simulation. Advanced Routing (RIP, OSPF, BGP). SNMP management. - Databases: Oracle, MySQL, PostgreSQL, MS SQL, Access. Design, programming and administration. - (Technical) Translation: English <-> Spanish (Spain). Professional, accurate and human-made translation. - Linux (Debian, Red Hat, Fedora, CentOS, Ubuntu, SUSE...) administration. Bash scripting. Xen and VMware server virtualization. - Web-related technologies: HTML, XHTML, CSS, XML, DTD, Schema, XPath, XSLT, XQuery, JavaScript, AJAX. Experience in W3C standards Validation. - Low level programming with x86 and ARM7 (Philips LPC2000 family and similar) assembly and c. Keil development tools. Embedded systems design. - Other programming languages: C, C#, Matlab. Some search keywords: project management, manager, crawler, crawl, crawling, mining, scrape, scraping, automated data entry, lucene, nutch, solr, sphider, custom search engine, metasearch, ebay, jabber, paypal, wikipedia, mediawiki, jquery, prototype, prototypejs, cakephp, CRUD, SBML, ANSI ASC X12, jpcap, jnetpcap, datatables, forex, twilio, arduino, wxPython, python, braintree, amazon aws, ses, DynamoDB.

    PHP, Java, Javascript, and SQL

  • mantislin Profile Picture

    mantislin

    ChongQing,  China

    Scraping any data from any website with PHP script, and save data to xls, csv, sql xml or json format. Download images from source websites and save to local folder and zip all images. Automatic scrape data with schedule/cron job.

    PHP, Perl, ASP, and Java