Closed

web scraping - java and Google GEOcoding API

This project received 20 bids from talented freelancers with an average bid price of $182 AUD.

Get free quotes for a project like this
Employer working
Skills Required
Project Budget
$30-$250 AUD
Total Bids
20
Project Description

We need a simple web scrapper with the following requirements. Please indicate the delivery time frame in your response as this is important for this project. The requirements:
- the output must be .csv file. also, the scrapper should retrieve and store images, see below.
- the scrapper must be JAVA based (java 6 will do) utilizing [url removed, login to view] libraries/packages for network communication. The code must be commented and clean (e.g. using constants for all major attributes such as URL to be crawled, etc.)
- the project must be provided in a form of an Eclipse project for easier testing on our side.
- the project needs to use Google GEOcoding API [url removed, login to view] to find exact latitude and longitude of various business addresses. The returned data (xml or JSON) will have to be converted into text format and stored in the .csv
- i am attaching the sample spreadsheet showing the data that needs to be collected.
- the scraping chain will start at [url removed, login to view] where you will have to retrieve and parse data for all businesses covered on this site (e.g. Accommodation in NSW) and will also need to visit 1-2 different sites to extract and add further business information. See attached .xls. Apart, for extracting the required data, you will also need to download and store images for each business (one image per business listing, again from [url removed, login to view]). Also, the Google GEOcoding API will be used to get the latitude and longitude of each business.

***We have a large number of scrapping projects in the pipeline and are looking for a long term partnership. Check our feedback, it speaks for itself.
*** It would be great if this can be done promptly as this is a small and easy (but interesting) project for someone who knows his/hers java and web scraping well.
*** MAKE SURE THAT YOU EXAMINE THE PROVIDED .XLS and VISIT THE RELEVANT SITES BEFORE BIDDING!!!

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online