Add proxy list support to web scraper - repost

$30-250 USD

Completed

Posted

over 10 years ago

$30-250 USD

Paid on delivery

I currently have 2 scripts that scrape data from 2 different databases that use api keys. I need proxy support added to the scripts using a proxy list. Each api key needs to be assigned it's own unique proxy and the proxy ip listed in the table. The proxy list will be a txt file that has the proxies manually added and whenever 1 proxy doesn't work it needs to be removed from the list and a new proxy assigned to that api key.

MySQL

PHP

Web Scraping

Project ID: 5205183

About the project

12 proposals

Remote project

Active 10 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@setiawanutama

If your scraper script using PHP cURL, then it won't be difficult as I have implemented proxy support to every scraper script I wrote. Basicly it reads from text file containing proxy list.

$55 USD in 1 day

4.9

(56 reviews)

4.3

12 freelancers are bidding on average $169 USD for this job

@mituld

Hi I work towards providing reliable, relevant and robust IT solutions at most competitive prices to my customers. I ensure 100% customer satisfaction so lets start thanks

$164 USD in 6 days

4.9

(453 reviews)

8.2

@mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$230 USD in 5 days

5.0

(398 reviews)

7.8

@wildlily980

一个有效的提议尚未被提供

$200 USD in 3 days

5.0

(66 reviews)

6.9

@shaeed019208789

Hello, I can do that. I can add the proxy list on your script. Let me know which language using your script & Hire me to start your work ASAP. send me your script also. Thanks

$250 USD in 10 days

3.8

(7 reviews)

4.7

@qido

A proposal has not yet been provided

$111 USD in 1 day

0.0

(0 reviews)

0.0

@Mulder1

Hi! I have a large experience in webscrapping and have my own software to get a proxy list at any time for use it in my scrapping projects. I am a PHP programmer too and have a lot of projects finished, some of them of big size (more than 50.000 lines of code) but all of them in real life.

$177 USD in 3 days

0.0

(0 reviews)

0.0

@liujia83

I just done this task using Python 2 month ago, which we have a list of proxy and check the availability and speed of each proxy and sort them, and the spider scripts will read off the proxy list to go crawl the web pages.

$222 USD in 5 days