Developing Compilable WebCrawler written in Java

This project received 17 bids from talented freelancers with an average bid price of $220 USD.

Get free quotes for a project like this
Project Budget
$30 - $250 USD
Total Bids
Project Description

Hello there,

I have a java project which I want to develop for my report. The project is simple WebCrawler with no interface included. I have managed to finish most of the parts. All I want is optimisation and changing some features of the project. The reason I want to hire a person is, I have no time to optimise this project for the following 1-3 months.

What I want is;

1st) The database kept on text file. I want to change it into MySQL database to make it more efficient and easy to understand.

2nd) Threads. I am using threads but I want them to work more efficient than current version. What threads will be doing is, they will be assigning to one job only ( for example; Start crawling: [url removed, login to view], dont pick any other job like [url removed, login to view], [url removed, login to view] until it finishes the [url removed, login to view] ). The trick point is, when the thread is crawling the links in [url removed, login to view], it should check the links in the another database ( pool DB for links ) whether it exists or not. If it exists, it shouldnt add it into database to prevent extra work and prevent repeated data.

3rd) I want this code to run properly. It doesn't work efficient currently there are some stucking points and other stuff. I have been using several testing tools but some internal code should be corrected.

4th) I am using [url removed, login to view] file, update it with the never version. ( Pretty simple.. )



I will be giving the whole source-code to you. You will have plenty of time to understand and achieve the goals stated above. As I am giving the source code to you, you would keep it and use it in the future, so please consider this before offering a price. The codes, other stuff and information will be updated as soon as I hire the professional.

The due date is : May 20th 2014 (±5 days)

Thanks in advance!

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online