A search engine capability.
1) Able to crawl to FORUMS, BLOGS, SITES, DIRECTORY. Support All the popular file hosting sites such as,
Rapidshare, Megaupload, Hotfile, filesonic, wupload,uploaded,[url removed, login to view], fileserve, mediafire,depositfiles, and many more. I'm sure you get what i mean by ALL.
2) Able to sort by Categories e.g GAMES, MOVIES, TV SHOWS, BOOKS . ETC
3) Able to grab links, photos, title, content and display it. ([url removed, login to view])
4) Able to have Today Trends, Yesterday Trends, Monthly Trends
5) SEO URL - SEO META TITLE, TAGS on every pages
6) RSS feeds for Today trends, Search
7) Suggestion for alternative search field. e.g if user type "Gossip girl", our system will generate "gossip girl SE01" , "Gossip girl episodes" . These suggestion must match what we have in our database.
8) Search results can sort by , DATE, SIZE RANGE, POPULARITY
9) On main page, Show top 10 popular title by categories. Show 20-50 recent searches and 10-30 recent added by crawler.
10) Ability to delete,edit links, post added by crawler.
11) Ability to add,edit,delete links and post by admin.
12) Ability to suggest user as they are typing on the search bar(according to database)
13) Able to have archieve list ([url removed, login to view])
14) Ability to add advertisements upon user search landing page([url removed, login to view])
15) Able to rate the content page
16) Able to comment on content page
17) Show these on content page
Added: 2011-11-08 03:52:54
Link(s) source:[url removed, login to view]
Source title: hawk nelson - crazy love
Host: [url removed, login to view]
18) Upon user search and ends at landing page, User should be able to see options on the left side of the website. e.g ([url removed, login to view]+nelson) ([url removed, login to view])
19) Able to check external link if it's been removed ([url removed, login to view])
20) On landing page, should able to show user what people are downloading right now (10 -20 files)
([url removed, login to view])
21) Multiple links supported ([url removed, login to view]) and suggestion of Password: Click here to search for the password)
22) Users able to submit RSS Links to us. Our crawler will queue and try to search for links from the RSS feed they provided upon approval
23) Account: Administrator account only. Easy to use Administrator Panel to edit all the necessary details such as adding, editing, and deleting.
22) Static pages like "About" , "Privacy", "DMCA Policy" , "API", "Submit RSS LINKS"
Please ask any questions before bidding for this project. It's a simple project that requires Web2.0 simple design, organize CSS pages , AJAX, PHP and easy to use framework.
I'm looking for someone who has done this before, or good at crawling pages.