Website Scraping and Monitoring using Node.js -- 2

$30-250 USD

Closed

Posted

over 6 years ago

$30-250 USD

Paid on delivery

We have TWO separate scripts written in PHP/CURL that scrape 8,000 URL's a day. We are looking for specific changes to the pages based on requirements from our database. I need someone to review our PHP/CURL code that uses our Database and Proxys to be rewritten in Node.js 1. Review 2 PHP/cURL scripts we are currently using. 2. Replace our code with yours so it works with our database/proxys but performs better. ** Tell me you past experience with scraping. You must be able to use SKYPE and communicate with the Developer of the php/curl code to design the new script.

Project ID: 15852550

About the project

10 proposals

Remote project

Active 6 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

10 freelancers are bidding on average $200 USD for this job

@ramzitra

Hi, I am interested in your project related to convert PHP script. I suugest to use Python and I can use multithreading to accelerate the process. Relevant Skills and Experience web scraping, Python Proposed Milestones $250 USD - deliver script

$250 USD in 3 days

5.0

(528 reviews)

8.6

@pofilippov

Hello. I completely read the description of the project. I have all the necessary work experience. I am a specialist with 8 years of experience. I have experience with a lot of web technologies. I have a few questions on the assignment. I will be very glad to cooperate.

$210 USD in 4 days

5.0

(53 reviews)

7.2

@mayankinnovative

A proposal has not yet been provided

$250 USD in 10 days

4.5

(173 reviews)

4.8

@BoyaVeeresh1456

Having over 3 years experience in developing web & mobile & desktop Applications. I have developed more then 30 projects in web and mobile development. Skills: Front End Technologies (web) - Html, css, java script, jquery, angular JS, Back End Technologies - ASP .Net, MVC, Web API, Node JS, .Net Core, Databases : MS Sql Server, MySql, Redis Cache, No-Sql, Azure Table Storage Mobile Technologies : Cordova , Xamarin Chat Bots Technologies : Microsoft bot framework, Dialog Flow Cloud Technologies : Azure Note : Not limited to only these technologies. I am also eager to learn new technologies as project demands.

$200 USD in 3 days

5.0

(4 reviews)

4.2

@parththakkar12

I have been working with PHP, NodeJS and SQL for several years now, and have deployed 4-5 projects in each. I also have a good knowledge of using Apache or other web servers. Besides, I have done a couple scraping projects - one for scraping results from my college website in NodeJS, and one for scraping results from Google reverse image search for making a small recaptcha breaker in Python (it had slightly better accuracy than random clicking, but scraping did help there). I have done extensive client side js programming, so am fluent with DOM APIs. And I also have written a couple network-heavy web applications. As a result, I know both how to scrap, and scrap keeping network and performance in mind. I have a solid programming experience of 5+ years. You can count on me to be able to deal with old codebase, find my way out and rewrite in NodeJS :)

$200 USD in 2 days

5.0

(3 reviews)

3.1

@mahatiger

I have worked on lucene/solr applications where crawler was written in python. I will need to go through the scripts before i can say anything. How many lines of code are there Relevant Skills and Experience Javascript, node.js, PHP, Web Scraping Proposed Milestones $250 USD - Review of Scripts and Rewriting

$250 USD in 5 days