I am looking for the creation of a file search engine. The site has to be able to crawl the web or data mine links from the web and index them on our site preferably using sphinx or similar. Our site needs to be fully searchable. We are looking for links from Rapidshare, megupload, filefactory etc.
Please check out filestube or filespump to see what site I am looking for. I will be looking for continued support after the project to iron out any problems.
You must totally understand what it is I require before bidding on this prodject
Also the site needs Today's trends"/"Monthly Trends"/"Last 100 added".
I need to be able to select which links the site crawler should find - rapidshare, Megaupload, Depositfiles etc or all.
- the speed of crawling and searching in the database must be high. Crawler mustn't be banned.
full SEO and great Google indexing with mod_rewrite .html pages
the script has to check for deleted files regularly and show links to them in the search results with another color
In the search result pages must be shown search form, sponsor links, 20 search results (with related SEO meta tags and a random color of the search keywords), 10 mixed searches, 10 related searches, 10 last searches and usual footer navigation (main page, disclaimer)
the pages should have bookmark links and "link to us"
- all links should be fully search engines friendly.
- site must be correctly displayed in IE,Firefox,Opera and Chrome.