Develop a simple linux desktop search engine web crawler app

Develop a web crawler in order to crawl web pages such that

* get a table of keywords and corresponding URLs

* get a number of tabs to open for crawling

* get a list of search engines

for each tab,

* randomly select a keyword, open a popular web search engine and search for it using regular browser component

* among the search results, search for the URL (as a prefix match) and open the corresponding link. navigate through pages until the desired URL is matched.

* log the action in a file with URL, time and search engine and rank info

* choose next random keyword and loop

This is supposed to be a desktop application to run on Linux. Please come up with a proposal if more details is necessary.

Skills: Linux, Software Development

See more: web search engines list, web development software list, web development app, web-crawler, Web and app development, search for the application, search engine list, prefix search, popular web development software, is in a prefix, app get linux, web development proposal, number search engine, web development keywords, web search engine, search match, search for url, linux software c++, loop url list, search keywords list, keyword development, component search engine, application crawl, web crawler search engine, linux app run

About the Employer:
( 0 reviews ) Turkey

Project ID: #5206946

3 freelancers are bidding on average $607 for this job


Hi there, I have over 7 years experience working on HTML, Wordpress, Magento, Database administration, OpenCart, Website Design, Logo / Banner Design Joomla, CSS and Linux Administration. I have read the project descri More

$250 USD in 15 days
(236 Reviews)

Dear Sir, I am Professional Software Developer, I am Linux Advanced Developer, I am Database Developer and designer. I can Handle your job and do everything extremely Grate. Regards,

$842 USD in 21 days
(43 Reviews)

A proposal has not yet been provided

$222 USD in 7 days
(1 Review)

can we start it now ?...................................................... Hi, We are very clear with the specification mentioned and ready to start your project immediately. We are pleased about having the opport More

$247 USD in 15 days
(0 Reviews)

I can do this task I have experience of more than 9 years if similar experience of making crawlers.

$730 USD in 16 days
(0 Reviews)