Files Search Engine - repost


We are looking for someone able to create a public search engine using elastic search and nutch for crawling or the constellio system.

What we need:

1. Crawl [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view] and [url removed, login to view]

2. Use the best technique to crawl up to 1 - 2 million pages per day.

3. extract all the files name + download links

4 stock it in our database.

4. Make it "searchable" inside our search engine.

We have the global idea but looking for someone able to advice us how to realize this project like a consultant and then provide the technology to start the project.

Skills: Human Resources, Internet Marketing, Marketing

See more: nutch constellio, constellio, start up consultant, search engine for marketing, search engine consultant, best marketing idea, best internet marketing system, search engine marketing consultant, Search engine marketing, nutch, make search engine, kat, elastic search, crawling consultant, files internet, need global marketing, search engine marketing project, filestube filestram, search engine files, global search, files search, search engine submission script download, million links, searchable database files, files search engine

About the Employer:
( 0 reviews ) Dhaka,

Project ID: #4557295

6 freelancers are bidding on average $3260 for this job


i can help

$6185 USD in 3 days
(1 Review)

Gladly at your service! Please Check PM

$2666 USD in 45 days
(0 Reviews)

Hi, I am Masters in Computer Science and have 07+ years experience in Object Oriented commercial Software Design and Software Development. I am results-driven, customer-focused, articulate and analytical Software En More

$2894 USD in 45 days
(0 Reviews)

Apache Nutch(Lucene) would be the best framework for your requirement.I have done such a project.Please check PMB.

$2222 USD in 10 days
(0 Reviews)

I am available for doing it please let me know if you were interested

$2500 USD in 3 days
(0 Reviews)

Hi We are interested in your project and read your requirements.We have completed 150+ big projects in last 5 years. Please check private message board for details.

$3092 USD in 20 days
(0 Reviews)