web scraping - java and Google GEOcoding API
$30-250 AUD
Paid on delivery
We need a simple web scrapper with the following requirements. Please indicate the delivery time frame in your response as this is important for this project. The requirements:
- the output must be .csv file. also, the scrapper should retrieve and store images, see below.
- the scrapper must be JAVA based (java 6 will do) utilizing [login to view URL] libraries/packages for network communication. The code must be commented and clean (e.g. using constants for all major attributes such as URL to be crawled, etc.)
- the project must be provided in a form of an Eclipse project for easier testing on our side.
- the project needs to use Google GEOcoding API [login to view URL] to find exact latitude and longitude of various business addresses. The returned data (xml or JSON) will have to be converted into text format and stored in the .csv
- i am attaching the sample spreadsheet showing the data that needs to be collected.
- the scraping chain will start at [login to view URL] where you will have to retrieve and parse data for all businesses covered on this site (e.g. Accommodation in NSW) and will also need to visit 1-2 different sites to extract and add further business information. See attached .xls. Apart, for extracting the required data, you will also need to download and store images for each business (one image per business listing, again from [login to view URL]). Also, the Google GEOcoding API will be used to get the latitude and longitude of each business.
***We have a large number of scrapping projects in the pipeline and are looking for a long term partnership. Check our feedback, it speaks for itself.
*** It would be great if this can be done promptly as this is a small and easy (but interesting) project for someone who knows his/hers java and web scraping well.
*** MAKE SURE THAT YOU EXAMINE THE PROVIDED .XLS and VISIT THE RELEVANT SITES BEFORE BIDDING!!!
Project ID: #2486006
About the project
16 freelancers are bidding on average $174 for this job
Hello friend, I have checked the the xls file and visited the websites, I think I can complete in 3 days, please consider my serious bid Thanks Bing
Dear Sir, I am an experienced Java/J2EE developer. I have multi previous experiences with web scraping, please check my work history. I have a question in PM.
Hi, I have re?d your requirements, xls data table and I have visited related sites. I can create this application for you if you choose me. Regards!
Hi, I have gone through your requirement and it is fine for me to work on it. We can have technical discussion on same . Get back to ASAP. Thanks , Raj.
