URL information extraction

In Progress

A simple as possible program is needed that extracts specific info from a URL search engine through Java written code and stores it into a simple database in MySQL. I have some broad requirements that are posted below to give an idea of what exactly needs to be done as well as some given code to use in java. I also have some links I can send you privately on examples of what I need. I must stress I DO NOT need a super amazing program written, I'd prefer the project to be completed under the simplest possible terms, I can discuss with you exactly what I mean by this via private messages. Also not ALL the requirements need to be 100% COMPLETELY met, but this can vary. Again, we can discuss this further in detail via private message if you are interested of course. Feel free to ask me any specific questions you have regarding this project.

General Requirements:

- Should have the means to take a URL, retrieve the webpage, separate

the displayed text and images in separate files and store the pathways/file names in a database

associated with the URL and/or keywords and associate a timestamp for that information for further

possible query.

- Demonstrate that it can interact with some website that has a search

engine that when supplied with keywords (provided by your system) will return a number of URLS

related to the search. You are to extract these URLS and obtain all of their

webpages and store the relevant information to the database.

- Integrate a distance function that when querying the database for URLS associated

with the keywords based on distance from a given location to the location associated with the webpages. For any webpage where location info is not available, assign a random zip code to the webpage in order to perform the function. (THIS REQUIREMENT IS VERY BROAD AND CAN VARY ON HOW OR IF YOU INTEGRATE IT, we can talk specifically more about this privately)

- Provide a user-manual (screenshots with descriptions what to do perhaps). Provide a README that explains how to compile and run your program from command line. (AGAIN this requirement can vary)

- Comment major parts of code, comments classes/methods/variables.

Skills: Java, MySQL

See more: url information, java url information, java obtain, java distance, how to program a website in java, amazing store, mysql mean, extract information to, database extraction, d associate, random line program, distance zip code, stress questions, written code examples, retrieve url, associate free, simple webpage database code, mysql compile, java mysql order, provided url, compile java project, Pathways , use extract function, information regarding, text extraction images

About the Employer:
( 4 reviews ) Brookhaven, United States

Project ID: #4522805

Awarded to:


hey,i can finish this job for you,i will make you satisfied!also i will finish it before 20/05/2013.

$111 USD in 3 days
(1 Review)

13 freelancers are bidding on average $186 for this job


Java Expert and rated as best Java Programmer on this site. I understand your requirements and have expertise to do this assignment.

$210 USD in 3 days
(319 Reviews)

please find my private message

$360 USD in 10 days
(89 Reviews)

Experienced java developer.

$272 USD in 5 days
(23 Reviews)

Hello, I have created scrappers for Amzon.com, google.com, alibaba.com and may more sites using java. I can show my work if u like to see. I use java with selenium. I really can help you.Thanks

$136 USD in 3 days
(22 Reviews)

Dear sir, Please check my PM. Thanks.

$210 USD in 7 days
(2 Reviews)

I'm a certified Java expert and would love a whack at this project. This looks right up my alley and I don't think I would have any issues completing it. Read PM for further details. Cheers, Aaron

$155 USD in 3 days
(8 Reviews)

Hi, I'm a Sun Certified Java Programmer with a lot of experience in creating such applications as the one you describe. I can do this for you quickly and professionally, but we need to discuss the details a bit further More

$250 USD in 5 days
(1 Review)

Hi, I'm interested. Please see PM

$105 USD in 3 days
(0 Reviews)

Experienced in this kind of project.

$166 USD in 10 days
(0 Reviews)

Work 4 years as a Software Developer. Familiar with Enterprise technologies (Different Application Servers) and many programming languages. Technical Skills: Programming Languages ( 5 years ) Agil More

$88 USD in 3 days
(0 Reviews)

Iam Java developer with more than 8 years of expereince, i can do this job.

$166 USD in 4 days
(0 Reviews)

- Result oriented professional with 3 years of extensive experience in Software Development. Technical: Languages: JAVA . Database: MySQL ,SQL Server . Web technologies: HTML ,Xml,Servlets,Jsp. Design Pattern: More

$136 USD in 3 days
(0 Reviews)

hello sir i am java developer i can easily code for you

$154 USD in 6 days
(0 Reviews)

I've written code like this before in c# and can write the code you requested in java in a few days.

$155 USD in 2 days
(0 Reviews)