Note: Experience/willingness to work with AWS, specifically Elastic IP is a must for this task.
Description of task:
i have an excel file with one column with celebrity names
i need to know the number of google search results and number of bing results in 2 additional columns. In addition Bing many times has the person's occupation and short 1 paragraph bio and these need to be pulled into 2 columns.
there are about 11000 rows
the script you write should work for other single column excel sheets
IMPORTANT: i found a plugin for excel that has a formula to pull google numbers but google blocks these requests after couple hundred rows... same for bing, so an important part of this will be to rotate the IPs
(using a service like aws elastic ip) to avoid blocking. Using public proxies doesn't work and Google will continue to block. We have also tried using Google Scraper on github without success.
If you are unable to scrape this info (e.g if we fail) then I ask that you complete the job using only the Bing API, but I will only pay a discretionary bonus.
Bing also has an API that handles 5000 requests per account, so that may be a way to pull this information from Bing
12 freelancers are bidding on average $191 for this job
Thank you for inviting me to bid on the project. I have worked on AWS. I have also scrapped results from google search and bing search. SO, I can easily do this task. Let's discuss in chat. Thanks.
Hi Really i am unable to do this project using the scraper but i have a team so i can do this work [url removed, login to view] you are interested to me so message me.Thanks.