Completed

Create web scraping tool to get Instagram profile for a list of names

I have a list of 5,000 names and countries of social media influencers and I want a script to automatically lookup their instagram account information. If I google "site:[login to view URL] [name]" 99% of the time the first search result returned is the correct one and if go their profile ([login to view URL][username]) Instagram returns inside the .html a JSON object with their information (name, follower count, etc). I want a script to do this automatically. I created a basic one myself with simply curl "[login to view URL][name]' and then pulled the first "[login to view URL]" link, fetched that URL from Instagram to get the json object with the profile information. However, Google blocked the script after about 50 requests, even though i could still search manually using Chrome. I assume there is a better way to do this so the script can run and not get blocked.

I will provide a spreadsheet with 2 columns, an ID and the names to search, and 5,000 rows for the influencers. The deliverable is:

1. A spreadsheet with 3 columns: the same ID from my spreadsheet, the instagram ID, and the JSON object with the profile information.

2. The script that does this or an explanation how I can do this again myself later if needed.

It is not important that this be completely accurate. You do not need to do any validation that the instagram account is the correct one, and if the search result does not return an instagram id or returns the wrong one, that is ok. I just need a script that will do this and correctly simulate a human searching with a browser or similar so that it gets past the bot filters. The script can be bash, python, perl, etc. I have access to Windows, Linux, and Cygwin. So whatever language and o/s you use is ok.

In your offer, please indicate what o/s and language you will use.

Skills: Web Scraping

See more: tool cut photoshop file create web page, php tool create web interfaces database, create web master tool script dns, proxy list web scraping google search, web scraping tool, web scraping create database, web profile list, create custom lettering tool web site, create web based skills assessment tool, scraping tool visual web ripper, best web scraping tool, all in tools web scraping tool, best tool for web scraping, create my logo for instagram profile, web scraping tool free, web scraping tool open source, searching for web for info related to list of names, Create a web scraping script max budget 10$ with fees, how to build a web scraping tool, web scraping tool php

About the Employer:
( 3 reviews ) Medellin, United States

Project ID: #20154038

Awarded to:

stead121

Hello, Glad to meet you I will use Python on Windows/Mac OS to implement your requirements. I have strong experience and skill in Instagram scraping. After reviewing your project description carefully, I am confiden More

$120 USD in 3 days
(17 Reviews)
4.9

18 freelancers are bidding on average $127 for this job

e3d

Hi, you won't have lots of luck scraping google without loads of good proxies, but I can suggest using bing or duckduckgo - they won't ban you for 5k requests and search quality should be on par for your use case. send More

$99 USD in 3 days
(239 Reviews)
8.7
brianconey

Hello How are you i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting

$50 USD in 2 days
(17 Reviews)
5.5
chrisvwn

I am experienced with web scraping using Python. I have similar jobs without getting blocked. Conversant with Excel data processing from python thus I will format the output in the required structure.

$140 USD in 7 days
(3 Reviews)
5.0
limondteam

"Hi, How are you? I saw your description carefully and I am confident I can full fill your requirement. So I provide my skills in hopes of working with you. I am full-stack developer and I have 2+ years of ample experi More

$50 USD in 1 day
(3 Reviews)
2.5
romansokolv708

Hello.sir. How are you? I read your description carefully and am very interesting in your project. I can start right now and can help you. I have much experiences and also have good skills about your project. So it is More

$250 USD in 7 days
(1 Review)
2.3
xinglong717

*******************************Scrapping ****************************************** Hi, How are you today? I have been developed scrapping program like this project. and I have sample program. I will finish this projec More

$140 USD in 3 days
(3 Reviews)
2.4
shahida772

Hi Thank you for giving me the opportunity to bid on this project.I have an experience in such projects.I can finish project on time and within your budget.I can do it with [login to view URL] will be satisfied with the res More

$140 USD in 7 days
(1 Review)
0.3
jinridong19713

Hi thanks for your posting. I have read your post. I am a expert who have many experiences in web scraping development, so if you hire me, I can complete this project in short time as you want. I am available for now a More

$140 USD in 7 days
(0 Reviews)
0.0
uelionobre

Hi client. I am a full stack developer. I have read your project with care. Thank you for give a chance to prove me by my skills. Your project is very fit to my skills. If you would award it to me, I am sure that I can More

$140 USD in 7 days
(0 Reviews)
0.0
brightstar928

⭐⭐⭐⭐⭐⭐⭐⭐⭐⭐ Hi I read your job description carefully and I can do your job perfectly. I have scraped a lot of websites So I can know what you mean and I am ready for you now. If you hire me, I will finish your job ASAP More

$100 USD in 1 day
(0 Reviews)
0.0
fivestarOne

Hi, Client. Thank you for your job posting. I read your description very carefully and then I think your job is very suitable for me. (***What is required of me is to give the customer enough satisfaction over money. A More

$140 USD in 7 days
(0 Reviews)
0.0
Aishwaryakumari

Dear Client, I can Build a Tool to Fetch Instagram Profile. I have excellent experience of Data entry, Web Scrapping,MS Office and Web Research for more than 4 Year’s. Never ends up until you are 100% satisfied with e More

$120 USD in 1 day
(1 Review)
0.0
rdmrla

Hello. I can help with your Instagram scraping project. I'm a senior full-stack developer with over 15 years of experience. I can implement this using Perl and on the Linux platform. I will write this so that it sim More

$150 USD in 7 days
(0 Reviews)
0.0
quan19950122

Hello Sir. Thanks for your project offer. I have lots of experiences with google apis. Please hire me, then i will show you my skills. Thanks alot

$100 USD in 1 day
(0 Reviews)
0.0
RenarsG

I have a Python script that is able to extract the JSON you are looking for, pretty much ready to go - this is the reason why I put the offer price as low as I did.

$65 USD in 2 days
(0 Reviews)
0.0
ChrisKostas

Hi ,I have already done something similar and indeed you do get blacklisted for scraping on some sites . I can try to scrape all you need python selenium /beutifulsoup ,and provide you a highly reusable script.

$200 USD in 3 days
(0 Reviews)
0.0
blackwhite123

Hello, I am pleasure with your job for Create web scraping tool to get Instagram profile for a list of names. Thank you for the job posting. It’s a pleasure to meet you. I’d really like to work with you on this one if More

$140 USD in 7 days
(0 Reviews)
0.0