Here is what I'm looking at High Level.... Do you think you can do this ? If so any examples that you can share ? Will discuss further once we connect...
1. Develop Java/C++ Search Technologies in Developing Search Spiders/ Web Crawlers/Bots/..
2. Search on multiple web sites of our choice. When we search, the results should come from Google, Bing, CNN, NDTV, ..etc. sites; find existing no. of hits on the link, URLs,..etc and store all the results in a database. Then search optimizer should show most relavent ones by removing duplicates and showing most appropriate and relevant ones.
3. Developing Search Spiders, Crawlers,... go out in Web for the keywords that we want to search and store the results in Database. These search words we create and maintain based on our need.
4. This is very basic and we need to build based on it. At least small front is also needed to test the functionality of key words - which is easy to write.
Hello, I'm experienced on developing web crawlers and HTML parsing. I can implement this in Java using MySQL DB. I'm MSc degree fellow and 6+ years experience in Java development.