I require a script that can be easily installed on an Apache/Unix server. The script needs to create a search engine that will collect data from the web based on specific keywords and store it in a database. It will then be able to post it on a web-page based on a search conducted for those words.
So, for example - we will set it to crawl the web for the keywords "Thatcher", "Madonna" and "Brad Pitt". It will then keep looking for web pages containing these words (based on meta tags, primarily, which we can also define in the criteria, but also page names). It will store the web addresses of these pages and then a web page with a search-box will also be created, enabling a person to search for these keywords and for the database to show the most relevant results.
We'll need for the script to be easily replicated for different projects.