I'm looking for an experienced developer to develop a spider that will crawl the web for article content and add this information to our database for viewing. Here's what this spider should do:
1. The spider should detect my website's active categories and then it should go out searching the web for content (that's related to the specific category). For example, I have a "Home Based Business" category - so, in this case the spider should go out and look for content that is home based business related.
2. Once the spider finds related content then it must check the database to ensure that the content doesn't already exist in it. If it doesn't exist then the spider should add the content to the database.
3. Once the content is added to the database, then the article will need to be associated with the relevant category.
4. Then the spider should assign the most appropriate keywords to the content that was just added to the database. These keywords should be assigned according to the business rules that I will specify.
Only respond if you have PROVEN experience in this type of programming. Payment based on results.
15 freelancers are bidding on average $243 for this job
I have a ready-made solution, similar to this... Can show you the demo... Regards, Haider Abbas Narsinh eSolutions Technology Inc. http://www.ApnaPakistani.net