Closed

Developer needed to build a web scraper

I want to build a web crawler to monitor companies. I have a list of company names with basic information on the company including the company website.

With this information I want to go on websites such as:

- Crunchbase

- Google News

- Company Website

- LinkedIn

- Twitter

- Facebook

- Instagram

- others (TBD)

From these websites I need to retrieve information on the company.

The script should be able to handle thousands of companies at the same time which are updated on a regular basis (each week). Since there will be a lot of crawling on the same site, blacklisting should absolutely be avoided.

Further details can be discussed in detail.

Skills: Python, Web Scraping

See more: bangalore based web developer needed, iphone web developer needed, build basic web scraper java, web scraping job postings, web scraping jobs online, web scraping tutorial, upwork web scraping, web scraping python, web scraping salary, python web scraping jobs, freelance data scraping, web developer needed dubai, build dotnet web scraper, web developer needed board, arabic web developer needed, interspire web developer needed, web developer needed chess, web software developer needed, needed php web developer, php code build web based scraper

About the Employer:
( 0 reviews ) Berlin, Germany

Project ID: #17999284

26 freelancers are bidding on average $1124 for this job

seaanddream

Hi, my name is Selim. I read your `Developer needed to build a web scraper` project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go ahead as soon as w More

$900 USD in 20 days
(250 Reviews)
7.6
mhmhz

Hi Kindly provide the details. I can create multi-threading crawler. Thanks

$2000 USD in 10 days
(92 Reviews)
7.3
Yknox

Hello~!! I am Gang Lee and I read your post. But I have something to ask you. Your idea is amazing and it will change the world! I am a magic talented developer in your skill. If you wanna be the success, hire me More

$1250 USD in 20 days
(41 Reviews)
6.9
mingxiao2008

Hello Dear! I have checked your project carefully and think I can do your job. I have high skills in web scraping. If you share me more details, I can start work. Thanks.

$1000 USD in 20 days
(41 Reviews)
6.9
schoudhary1553

This is Vibrant Webtech and I was glad to see that you're looking for help for project Developer needed to build a web scraper. I've delivered more than 400 + projects in the last 5 years and this makes me very confi More

$1000 USD in 10 days
(28 Reviews)
6.0
AzzkaNoor

Greetings. I just have a visual over your project's details and feel privileged to tell you that this correlates with my domain of expertise. Please message me as I will like to ask a few questions. I have a lot to d More

$1250 USD in 20 days
(10 Reviews)
6.2
adeelpirzada

Hi there, i have done scrapping almost on Half of Worldwide web including eCommerce giants(Amazon,eBay,craigslist) News Feed, Social media websites, API's. I develop my own tools based on client requirements with More

$777 USD in 20 days
(14 Reviews)
5.3
langlangFan

Hello, I have much experience in C# development. I develop WCF, Win Forms, WPF program by using C#. I have solution to develop various kinds of applications such as finance app, enterprise app. I want discuss furth More

$1250 USD in 20 days
(4 Reviews)
4.3
ilushawebdev

I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest More

$1000 USD in 14 days
(6 Reviews)
3.3
rwhitesnow125

Hi, as a senior Web Scraping guru with 6+ years of experience, I have developed hundreds of scrapers for wide range of purposes like gathering information from different types of business directories, e-commerce sites More

$1250 USD in 20 days
(4 Reviews)
3.5
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

$1000 USD in 20 days
(5 Reviews)
2.7
siguro

Hello! I am professional software engineer and devealoper of automated web scraping and crawling solutions for more than 8 years yet a newbie on Freelancer. I use Python/Scrapy for development of different scrap More

$1100 USD in 20 days
(1 Review)
2.7
RAZAQ786

hi,sir/madam I am providing All types of Online and Offline Data Entry, Web Research Jobs. Whether you need an enthusiastic Virtual Assistant or Office Admin Support I'm very willing to work with you. I'm fully capabl More

$1250 USD in 20 days
(1 Review)
2.4
alexkorentsvit95

Hi, I have a great experience in writing scrapers (more than 70 for such web sites as [login to view URL] or [login to view URL]). Сan complete your project quickly, efficiently and qualitatively. Regards.

$755 USD in 14 days
(1 Review)
0.1
Hero33

Dear Hiring Manager, I am a PHP developer My FIrst goal will always be to meet your needs and deadline. When working on a new project, I like to speak with the client, so that I can have a clear understanding of his More

$750 USD in 7 days
(0 Reviews)
0.0
binarycodersvw

Hi.I am a Visual Basic .NET programmer with 14 years experience(others say this too but I can show proof). This is not another automated bid like the ones you see around. I have read the description of your project an More

$1974 USD in 20 days
(0 Reviews)
0.0
mohamed8383

Dear Sir , i could deliver your scraper in 27 day Keyword : Java , [login to view URL] , AKKA , Actor system , OpenNLP , NoSql , Apache Solr , SQL i have develop some software like that to scraper and crawl some web s More

$888 USD in 27 days
(0 Reviews)
0.0
$1111 USD in 3 days
(0 Reviews)
0.0
NTD3V

Web-Crawling can be problematic on social platforms as most of them require some sort of authentication in order to view the full content of the requested result/content. I also would prefer a different language. More

$1100 USD in 10 days
(0 Reviews)
0.0
$750 USD in 3 days
(0 Reviews)
0.0