Find Jobs
Hire Freelancers

Distribute Outbound Requests to Farm of Proxy Servers

$3000-5000 USD

Closed
Posted almost 10 years ago

$3000-5000 USD

Paid on delivery
I have a web application that for certain interactions must query Google and other sites that do not offer APIs. A HTTP request is made and the page is scraped, The issue is that I am quickly blocked, either straight-up or forced to fill in a captcha. No good. What I would like is a platform that I can configure with many different private proxy accounts. I submit the request through this system. This system intelligently distributes incoming requests to the proxy servers randomly. When blocks are detected, that proxy must be removed from the farm. The details of the system will be more complicated I'm sure - but that's the general idea. Be able to route HTTP requests through a pool of proxy servers in order to avoid getting blocked by sites that prohibit scraping. The system should be housed on AWS or Google App Engine. Google App Engine would be ideal. I will only entertain responses that prove you understand the problem and are willing to work through a decent solution. Canned responses will be ignored immediately.
Project ID: 5992422

About the project

10 proposals
Remote project
Active 10 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

About the client

Flag of UNITED STATES
Evansville, United States
5.0
2
Payment method verified
Member since May 17, 2014

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.