Closed

Data scraping: Google & Bing search results

Note: Experience/willingness to work with AWS, specifically Elastic IP is a must for this task.

Description of task:

i have an excel file with one column with celebrity names

i need to know the number of google search results and number of bing results in 2 additional columns. In addition Bing many times has the person's occupation and short 1 paragraph bio and these need to be pulled into 2 columns.

there are about 11000 rows

the script you write should work for other single column excel sheets

IMPORTANT: i found a plugin for excel that has a formula to pull google numbers but google blocks these requests after couple hundred rows... same for bing, so an important part of this will be to rotate the IPs

(using a service like aws elastic ip) to avoid blocking. Using public proxies doesn't work and Google will continue to block. We have also tried using Google Scraper on github without success.

If you are unable to scrape this info (e.g if we fail) then I ask that you complete the job using only the Bing API, but I will only pay a discretionary bonus.

Bing also has an API that handles 5000 requests per account, so that may be a way to pull this information from Bing

Skills: Amazon Web Services, Python, Web Scraping

See more: web scraping api, a web service for scraping, scraping google search results urls, google search results scraping, scraping google search results url, web scraping google search results, push search results page google search, delphi scraping google search results, scraping google search results, virtuemart shop data google search results, google search results type data display asp net , bring search results top google

About the Employer:
( 2 reviews ) new york, United States

Project ID: #8294271

12 freelancers are bidding on average $191 for this job

e3d

Hi, I can avoid google/bing to ban ip by using proxies and I have huge experience in that. Let me know if you want me to do it

$199 USD in 3 days
(44 Reviews)
7.2
phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel o More

$200 USD in 3 days
(36 Reviews)
6.3
Maariyaa

Hello Dear, HERE Ready to start!!! I can perfectly do it and interested for this project. I have lot of experience related and different types of projects. I am waiting to your quick positive reply. Feel free as More

$180 USD in 3 days
(55 Reviews)
5.5
sajidmahmud

Hello I am sajidmahmud I see your project and i do it as your acceptation.I have 3 years experience to work in a any kind data process Web Scraping, Web Search, Excel,SEO,Internet Marketing,Social Media,Lead,Telemarket More

$250 USD in 5 days
(95 Reviews)
5.2
cowboy14

Hello sir, Consider it as done within 3 days!! I checked your excel file and i am able to complete the file within 72 hours from both bing and google. I have registration on ipsocks and so ip is not a problem for More

$200 USD in 5 days
(24 Reviews)
4.9
prasannakumar20

Thank you for inviting me to bid on the project. I have worked on AWS. I have also scrapped results from google search and bing search. SO, I can easily do this task. Let's discuss in chat. Thanks.

$184 USD in 3 days
(13 Reviews)
5.2
sobujprantor

Hi Really i am unable to do this project using the scraper but i have a team so i can do this work [login to view URL] you are interested to me so message me.Thanks.

$222 USD in 8 days
(18 Reviews)
4.3
mirniyazuddin92

Dear Sir/Ma'am, I am a Web research and Data Entry expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can find and extract the information from differen More

$200 USD in 3 days
(16 Reviews)
4.1
pnvasko

Hello, i can scrap google & bing use elastic ip or use tor network. all be written in Python Best regards, Vasiliy

$177 USD in 3 days
(7 Reviews)
3.6
adeelpirzada

Hi there i have done scrapping almost on Half of Worldwide web including ecommerce giants(Amazon,ebay,craigslist) News Feed, Social media websites, API's. I develop my own tools based on client requirements with Muli More

$250 USD in 3 days
(4 Reviews)
2.9
oneskybd

Hi, I am writing in response to your advertisement. After carefully reviewing the experience requirements of the job description it seems to me that my experience is suitable to match for the job. I have excellent More

$155 USD in 3 days
(7 Reviews)
1.8
lalmansari

Hi, I am an IT professional with 4+ years of experience in VBA programming and Macro development. 24/7 nonstop and timely support with high enthusiasm and dedication. My past projects covered projects like Gene More

$100 USD in 3 days
(0 Reviews)
0.0
mojians

I have done a project similar to this before. I switched vpn to avoid google ban while bing didn't ban IP at all.

$155 USD in 10 days
(0 Reviews)
0.0
IsrarKhan1993

I can create a Python script that will get the amount of results on each celebrity. However looking at the excel sheet you have provided, i have a few questions for which i think it is best to discuss on private messag More

$250 USD in 5 days
(0 Reviews)
0.0