Good afternoon,
I will make this as simple as possible. I require a web crawler (or web spider- or whatever else you would like to call it) That will do a few very specific functions. I will describe this as best as I can.
1) Program has to be able to search through websites text/keywords/meta tags to identify appropriate sites by imputing multiple keywords into the program as a search peramiter.
2) at the end of the search (either a timed search or a limit on the amount of links obtained) the program needs to be able to output a list of links to the website (specific page) where it identified the specific keywords or text. ( This can be saved in a txt file but would rather an excel file if possible or practical)
3) the program will be able to identify duplicate links per session and only save one of the duplicate links.
4) *This is not manditory but would prefer to have it either as part of the program or a seperate smaller program*? I need the "Program" To be able to check each link for its "Alexa Ranking" And its Domain Page Ranking.? And output the variables for each in a report as well. *** And if possible Order them in either asscending or descending order for either the Alexa or the Domain page ranking***
If you have any ideas as to how to do this please feel free to make sudgestions. I am open to Ideas. If you have this program written already that would be a plus. I will be prompt with payment and there may be a bonus for a coder who can deliver the program quickly.
I do not have a preference as to what language the program is to be written with.
If you have any other questions please ask and I will answer best as I can. I will be choosing a coder either tonight or tomorrow more then likely. I need this done ASAP!
Andrew