Find Jobs
Hire Freelancers

Search Engine Harvester / URL Gatherer

$100-500 USD

Cancelled
Posted about 13 years ago

$100-500 USD

Paid on delivery
Need a desktop application which can harvest URLs from Google search engine using the API. The following requirements must be met: - Must be UNICODE capable, i.e. support for all UNICODE language characters such as Chinese, Japanese, Thai etc. - Must be multi-threaded (up to 30 connections) - Must have proxy support, and must support multiple AUTOMATICALLY rotating proxies, e.g. change proxy automatically for every X amount of URLs harvested. - Must be able to remove duplicates on BOTH the domain level, and on the URL level - Must be fast and must be able to harvest QUICKLY and for EXTENDED PERIODS of time - Must be able to retrieve maximum 1000 URLs per keyword as specified by Google API - Must be able to save URLs automatically in a text file as time progresses. Once a maximum of 1 million URLs are saved, a new text file will be created, etc. - Must be able to adjust connection timeout settings - Must be able to handle large lists of URLS, up to 1 million URLs, and large lists of keywords, up to 1 million lines - Must show progress at the bottom of the screen, either as a progress bar or number of keywords, e.g. if there are 1000 keywords, progress would be 3/1000 when harvesting the third keyword - Must have two boxes to enter keywords: 1 box for the custom footprint e.g. "Powered by Wordpress", and another box for the keywords, e.g. "dogs, cats, bears, computers" etc. etc. - Must be willing to correct problems if software does not work or has problems in the future. However, additional payment would be made if there are any changes in Google search engine API which would require any major changes to the software.
Project ID: 3007483

About the project

4 proposals
Remote project
Active 13 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
4 freelancers are bidding on average $1,306 USD for this job
User Avatar
See private message.
$3,400 USD in 14 days
4.7 (59 reviews)
5.1
5.1
User Avatar
See private message.
$849.15 USD in 14 days
4.9 (31 reviews)
4.8
4.8
User Avatar
See private message.
$339.15 USD in 14 days
5.0 (16 reviews)
4.5
4.5
User Avatar
See private message.
$637.50 USD in 14 days
4.8 (14 reviews)
4.0
4.0

About the client

Flag of UNITED KINGDOM
Wales, United Kingdom
5.0
14
Payment method verified
Member since Aug 26, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.