Closed

Maintain and run crawling infrastructure

We've built out a well-tested, docker swarm + typescript + timescale + bull-queue based infrastructure for crawling a variety of food ratings sites. It has full CI/CD to production servers and is ready for crawling the USA. It was fully working a few months ago on runs in SF, so now the job is just fixing up the tests that are breaking in the last couple months, getting proxy rotation working nicely, and scaling it up to run continuous crawling on the US.

Skills: SQL, Database Administration, Docker, Web Crawling, Typescript

See more: code already done built tested simple add requested, code already done built tested simple add, we ve helped buyers find the right software, freelancer we ve lost the utah, we ve sent you an email, we've detected you're using teamviewer on a business network, can we run multiple apps on one server with docker, we've detected suspicious activity on your google account, to run the test, we have to type, we ve detected you re using teamviewer on a business network, we ve encountered an unexpected error please try again error code 3005, your adwords account is suspended - we've detected suspicious payments in your account., to run the test we have to type in angularjs, your account is suspended we ve detected suspicious payments in your account, we've moved cards with envelopes, we've detected suspicious account activity facebook, photographer removes phones from his photos to show how terribly addicted we ve become, test run will use dll(s) built for framework framework45 and platform x86

About the Employer:
( 2 reviews ) Fairfax, United States

Project ID: #32225600

15 freelancers are bidding on average $30/hour for this job

omsoftware

Hello, I understand your requirement to Fix the current crawling System. We do have experienced SQL, Typescript, Docker, Web Crawling, typescript developers in our team who can work on your project. Let me give you a More

$40 USD / hour
(4 Reviews)
7.0
(17 Reviews)
6.2
PandADevelopment

Hello, How are you? I'm a senior software egineer who has over 10 years of experience in Web and Mobile Development. So I'm very proficient in Web Scrappoing using Node.js, Python, BeautirfulSoup, Pupeeter, etc... And More

$45 USD / hour
(1 Review)
5.7
tangramua

Hello Nate W.,   We have 20 years of strong experience in SQL, Database Administration, Typescript, Docker, Web Crawling, as a result, we can successfully complete this project.   Please, review our profile here: https More

$25 USD / hour
(9 Reviews)
4.9
(3 Reviews)
4.6
(1 Review)
4.4
sapnathakur14

Hello, Warm Greetings!!   I read your job description completely, and I found my skills relevant to your project. I am a professional web developer with 7 years of programming experience for a multitude of different More

$25 USD / hour
(1 Review)
2.4
(1 Review)
1.5
NEHABHAT92

Hello, I have read the job details very carefully, and i become very interested in working with you. I'm an expert in this field. I have done several projects like this before. I will provide my best effort to complete More

$25 USD / hour
(1 Review)
0.4
MaksimUshkalov

Hello client! I am very interested in your project. I have 7+ years experience in web scraping with PHP, Python My main target is provide you a 100% work within your deadline. You get a good result after hiring me. I More

$25 USD / hour
(0 Reviews)
0.0
(0 Reviews)
0.0
romanvaraksin

Hello, dear! I am very interested in your project. I have over 10 years of experience with web scraping and crawling. I can use Python andTypeScript for crawling. I can scrape any sites. Please contact me. Best wishes.

$20 USD / hour
(0 Reviews)
0.0
alyxthea

Hello respected client.I am happy to send a proposal on this [login to view URL] you can see, I am a new freelancer on this site. But I know what is first and what is [login to view URL] most important is the credit of the client and the More

$25 USD / hour
(0 Reviews)
0.0
(0 Reviews)
0.0
RomanKor1012

Hello I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I am a senior developer and I have 15+ years in this field. Now I am very interesting your job and More

$45 USD / hour
(0 Reviews)
0.0