Closed

Files Search Engine - repost

This project received 6 bids from talented freelancers with an average bid price of $3260 USD.

Get free quotes for a project like this
Employer working
Project Budget
N/A
Total Bids
6
Project Description

Hello,

We are looking for someone able to create a public search engine using elastic search and nutch for crawling or the constellio system.

What we need:
1. Crawl [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view] and [url removed, login to view]
2. Use the best technique to crawl up to 1 - 2 million pages per day.
3. extract all the files name + download links
4 stock it in our database.
4. Make it "searchable" inside our search engine.

We have the global idea but looking for someone able to advice us how to realize this project like a consultant and then provide the technology to start the project.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online