Develop a web crawler in order to crawl web pages such that
* get a table of keywords and corresponding URLs
* get a number of tabs to open for crawling
* get a list of search engines
for each tab,
* randomly select a keyword, open a popular web search engine and search for it using regular browser component
* among the search results, search for the URL (as a prefix match) and open the corresponding link. navigate through pages until the desired URL is matched.
* log the action in a file with URL, time and search engine and rank info
* choose next random keyword and loop
This is supposed to be a desktop application to run on Linux. Please come up with a proposal if more details is necessary.
3 freelancers are bidding on average $607 for this job
Dear Sir, I am Professional Software Developer, I am Linux Advanced Developer, I am Database Developer and designer. I can Handle your job and do everything extremely Grate. Regards,