Search Engine Crawler
$30-250 USD
Paid on delivery
We are looking for some one who can build a tool to scrape data from a search engine we have created. We will provide a link to it. The tool should be able to output the data by structure. The results will appear similarly to Google (webpage title, link, webpage content summarization).
The tool should meets the following requirements:
1. To Scrap and save the original (real) URL (when we open the result, initially Google is opened and then redirect us to the original webpage. We need the link for the original webpage, NOT Google;
2. To Scrap and save the title (first line of results);
3. To Scrap and save website content (the summarization under the link);
4. The engine has limit of 10 pages, we need the data from all of it;
5. The search is done by input a key value, we want the tool to be able to search many key values at the same time or so called thread pool pattern (to handle many search tasks in parallel);
6. For data output format, we prefer to be MySQL;
Required information for each webpage:
Key value (keyword)
Data of the search
Webpage Title
Webpage Content (webpage summarization under the link)
Original URL (the one that will redirect us to the original webpage, NOT Google page)
Please note the fifth requirement is quite important.
Project ID: #9387366
About the project
17 freelancers are bidding on average $189 for this job
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
Dear Sir, I am TOP RANKED Java programmer with 10+ years of experience and completed 700+ projects on this site. I am very interested in your crawler project. Please award me this project for good results. Thanks
Hi, I have a lot of ready database that are fresh, clean and bounce rate is very low. So Feel free to let me know if you need a fresh database in a reliable price......thanks
Hello! I understood the task and I can implement the required functionalities. After you award me this project you MUST NOT worry about task's implementation - only wait for the final completed result. All diffic More
Dear sir/madam, We are PR Technologies. We have a team of Experienced Java Developers, who work together and contribute to produce quality products. So, if you show some trust on us, then we will guaranteed you for a b More
I have worked with website automation and have built multiple scrapers in the past. I am available to start right away. Will I be scraping google directly in order to populate your site? or am I scraping another page?
i have done a project like this before. i crawled an education result site and sorted result of students according to their college
