Closed

Web Scraping, Server Setup with Proxies & API creation.

We are looking for an expert web scraper to complete a number of more scraping projects. The websites being scraped are sophisticated and such the scraping infrastructure and strategy must be sophisticated to avoid having our scrapers blocked. Only accept this job if you have extensive experience setting the up the server infrastructure.

Job Description:

1. Analyze website from which we are scraping. Determine best way to gather data. Ideally, scrape their JSON if available.

2. Build scrapers using Python and provide the data in JSON format. We will provide the data and JSON format to create.

3. Build a server infrastructure on Digital Ocean using a round robin or equally sophisticated setup.

4. Utilize a squid proxy or equally sophisticated setup.

5. All code will be owned and transferred so that we can completely manage moving forward. The entire process should have no external dependencies outside our control.

Sites and data we will be scraping will be provided upon hiring. In order to be considered for this position, please send an example of a project with the infrastructure you setup and your github and/or project code where we can see your scraping code.

Skills: Data Mining, PHP, Python, Software Architecture, Web Scraping

See more: setup web hosting server, webmin apache web server setup, hylafax web server setup, google scraping proxies, private proxy scraper, rotating proxies, free proxy server, ip rotation python, web scraping ip rotation service, web scraping delay, free proxies for web scraping, setup web hosting server 2003, setup web hosting server services, proxies web scraping, snow leopard server web server setup, api server setup, php web server setup, centos web server setup dns, java web scraping api, java google api web scraping

About the Employer:
( 15 reviews ) Melbourne, United States

Project ID: #19837669

22 freelancers are bidding on average $229 for this job

bianyunzhi95

Hi. Nice to meet you. I have good skills with data scraping. [login to view URL] was built by me and it base the scrapping data from the [login to view URL] I have good experiences with scr More

$1000 USD in 7 days
(98 Reviews)
7.4
keshavkalra90

Hi we can do that via scrapping and curations. I will provide you clean and easy coding that you can owned and transferred so that you can easily manage without external dependencies. Eagerly looking forward for More

$185 USD in 7 days
(192 Reviews)
7.3
hawkscodeau

Hi, I can start work on your project immediately once you confirm me and i am also open for further discussion if you want. I have 7+ years in web designing & development with good experience in following skills More

$250 USD in 4 days
(13 Reviews)
6.6
aftabyounas

ok got it .... this will be done ... message me so we can discuss more ... thanks.............................

$100 USD in 1 day
(90 Reviews)
6.1
androidc

Hello, I have a few questions regarding your shared requirement. Please open the chat so we can discuss. I have 6 years of experience in PHP, Wordpress, Codeigniter, Laravel, Python, Django, JavaScript, Shopify, Mage More

$200 USD in 10 days
(105 Reviews)
6.5
alexwmsoft

Dear, employer. My name is Lee, I am an experienced web developer, and web scraping expert. I have good experiences in web scraping using PHP, Python, Java and so on. I read your job description, and I am interest More

$155 USD in 3 days
(31 Reviews)
6.2
stead121

Dear Sir I am senior web scraping expert with have enough experience of proxy ips. I will use python to make script. If you want to see my skill, please check this video. [login to view URL] More

$120 USD in 3 days
(49 Reviews)
6.0
susanna2018

Hi, Sir!! @$@$@$PLEASE CONTACT ME. I CAN DO IT WONDERFULLY.$@$@$@ ##% Your idea is attracted me to your world.%## I am Python expert. i have various skills. @example@ python selenium and beautiful soup, regular More

$150 USD in 3 days
(32 Reviews)
5.4
kkc264043kkc

can build high scaleable distributed scraping frameworks with Python celery and proxy rotation. can do installation and setup over cloud. can explain more about it These are my skills related to web scraping and cra More

$250 USD in 3 days
(40 Reviews)
5.5
kunitsynartem

Hello! I have 2 years of experience in web scraping using Python and I'm interested in your project for data extraction into JSON, with proxy implementing and Digital Ocean server setting up. I can provide you with som More

$230 USD in 5 days
(28 Reviews)
5.3
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

$100 USD in 7 days
(55 Reviews)
5.0
ShrineWeb

I have done this before and I can do it perfectly. But I have a question. Can we talk on chat please? I have 10 years of development experience.

$30 USD in 14 days
(37 Reviews)
5.3
valiksoin

Hello Thank you for your great job I am Valentin from Russia I see you're looking for a scrap developer proficient in C# to complete your job! Your project reminds me of one of my pervious project called "Amazon Scrap More

$200 USD in 7 days
(18 Reviews)
4.2
hristovelichkov1

Hello, I read your job proposal carefully, and I want to help you bring this to life. With many years of industry experience, I am able to build like any well-rounded full-stack engineer with a focus on mobile develo More

$500 USD in 7 days
(1 Review)
4.4
oswaldoodavidal

Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I hope to work with you!

$222 USD in 5 days
(2 Reviews)
4.0
nikhil929

I am a professional web scraper with more than 6 years of experience and have completed more than 100 scraping tasks successfully with client satisfaction and I can scrape any kind of website for you and can output dat More

$120 USD in 5 days
(3 Reviews)
3.2
ShyamFutureTech

Hi, Thank You for posting your Requirement! I am confident that we would be able to work together on this Project and create something worthwhile. We have team of experienced Python developers who would be glad to h More

$250 USD in 12 days
(3 Reviews)
3.3
WangJinStar

✫✫✫ Dear Hiring Manager ✫✫✫ Wish you a very good day!!! I am a senior Web/App developer who has a good knowledge of Python, Java, javascript, PHP, Codeigniter, C , C#, Qt and etc. So interested in your project. Lo More

$150 USD in 3 days
(3 Reviews)
3.0
muffajalbohra53

Hello, I have gone through your requirement more carefully, Basically ,I am experienced with the various scrapping tools in python (i.e scrappy,selenium etc). I have worked before on scrapping the data from various eCo More

$250 USD in 15 days
(4 Reviews)
2.3
$177 USD in 5 days
(0 Reviews)
0.0