Completed

Developer needed for a WEB SCRAPING Project

Hi,

I need to extract some information from a number of websites.


I am building a centralized database from information scraped from government websites. I have already scraped 10 of 50 sites, we need help with the remaining 40.

All the websites are public and any data extracted will be credited / attributed back to the source website.

Some of the sites provide a SQL database with the needed information, some provide CSV and Excel files, a select few provide a RESTful API, and many simply provide a website with search abilities.

The centralized database I have built integrates with each site’s system separately, with a mix of file downloads, API calls, and headless browser web scraping. Therefore, all the information that has been/and will be scraped is stored in one place, but can be accessed quickly and easily, through API calls to the central database.

Please reply with details of which technologies / languages you intend to use. Please do not just reply with "I can do this". I would like to understand what detailed knowledge you have in web scraping. If you can show me a previous web scraping project you've done, then even better.

Please feel free to ask any questions.

Thanks

Skills: JSON, MySQL, PHP, Software Architecture, Web Scraping

See more: php web scraping expert needed, bangalore based web developer needed, investment needed web project, python web scraping jobs, data scraping jobs online, upwork web scraping, web scraping salary, web scraping job postings, data scraping work, freelance data scraping, web scraping projects, web scraping project, iphone web developer needed, web developer needed dubai, web scraping project payment amount, web developer needed board, arabic web developer needed, interspire web developer needed, website developer needed project, web developer needed chess

About the Employer:
( 2 reviews ) Providence, United States

Project ID: #18121507

Awarded to:

p4logics

Hello Sir, We are expert in web scrapping using java jsoup and selenium, we are very good and fast in the same. I can share my recent work details and you also can go through my freelancer profile. I will be the per More

$105 USD in 15 days
(31 Reviews)
5.1

31 freelancers are bidding on average $589 for this job

langlangFan

Hello I have much experience in web scrapping My previous target was eCommerce web site. I fetch price, product image, name, category etc. I have solution to overcome ip block, catpcha and session. I usually use P More

$700 USD in 15 days
(52 Reviews)
7.3
pytho

Hello, Basically I can scrap anything. Give me the links and info(you want all the info?) to see what need to be done. I am looking fw. to get in touch and discuss more details, Marius

$833 USD in 10 days
(46 Reviews)
7.0
superman1987417

Hi, Dear zoeorch I am expert Data Miner with high experienced Data Scrapping and Site Crawling & Data Processing Skills. I am using some technologies for scrapping. PHP, Python, Chrome extension, and also curl, mul More

$500 USD in 5 days
(67 Reviews)
7.0
polarjin2017

Hello? How are you? I have good experiences in "Developer needed for a WEB SCRAPING Project" as you can see my profile for these (JSON, MySQL, PHP, Software Architecture, Web Scraping). I have been working for 7 yrs More

$555 USD in 3 days
(108 Reviews)
6.9
AwaisChaudhry

Hi there, I have checked the details I have rich experienced with JSON, MySQL, PHP, Software Architecture, Web Scraping. Please initiate chat so we can discuss this job.

$555 USD in 10 days
(48 Reviews)
6.8
seemasit

Hi I have been specializing in mobile (native, React native, hybrid,) and web(website, backend) for 6+ years. I have rich experiences in - VoIP mobile/web app using webRTC, 3rd party, streaming server - On demand More

$555 USD in 10 days
(61 Reviews)
6.8
hiramalik321

Hi there, I've read your project description and I am confident enough that I can handle this project according to your expectations. I have done similar projects before and I want to take over this project as well. I More

$600 USD in 10 days
(45 Reviews)
6.4
Mickelson

Hi Nice to meet you. I'm python expert and my last project on freelancer.com is also python scraping task. My past works: Youtube comment scrapping Real estate property list to csv Job-site content to csv And sc More

$500 USD in 10 days
(66 Reviews)
6.3
CrazyWebGuru

Hello! Thanks for your posting. I've read your post carefully and I am very interested in your project. I am an experienced and talented web developer and I have rich experience with JSON, MySQL, PHP, Software Archi More

$555 USD in 10 days
(56 Reviews)
6.1
AdhamSoft

Please check that link for what I have to make sure I can do what you need This link is wordpress site we created [login to view URL] Please check this as a sample By checking that l More

$250 USD in 10 days
(50 Reviews)
6.0
MyAwesomeTeam

Hello mate, I checked requirement and i think this is you need: + you need to extract some information from a number of websites. + you would like to understand what detailed knowledge you have in web scraping More

$553 USD in 3 days
(39 Reviews)
5.9
Janghero

"I can do this". *** Project Manager *** I am a project manager. We are Web Experts. Please look at my review. We have 10 years of IT experience. Skills: - PHP, CodeIgniter, Wordpress, Laravel, Magento More

$555 USD in 10 days
(25 Reviews)
5.9
AutomationAdept

Hello! My bid amount & timeframe are simply placeholders until we discuss further details. This is my area of expertise. You can have a look through my reviews for examples of similar projects I've completed here More

$500 USD in 10 days
(36 Reviews)
5.6
stylesiva

We have already done the scrapy project. You can please see our sample at [login to view URL] . Login with password 1 SAmple scraps were made from : [login to view URL] More

$500 USD in 6 days
(13 Reviews)
5.3
C3guru

Hi, sir! I have good skills in web scraping. thanks. d d d d d dd ddddddddddddddddddddddddddddddddddddddddddddddddddd

$750 USD in 10 days
(20 Reviews)
5.5
Vedtechnology

Hi There, I am a professional PHP developer with an experience of more than 6 years in creating and customizing PHP based websites, themes and plugins/modules. I have been working with MVC architecture using CodeIgnit More

$650 USD in 14 days
(46 Reviews)
4.4
superbpartner

hello,dear. I have read all your requirements for 'Developer needed for a WEB SCRAPING Project' and I fully understood it. I am confident and I am sure that I am able to finish this project. Please come in contact with More

$555 USD in 3 days
(10 Reviews)
4.8
avto35217

Hi,dear. I've just checked all requirements of your project 'Developer needed for a WEB SCRAPING Project'. I'm a senior software developer and I'm able to fulfill your project requirements ,you may be interested in me. More

$555 USD in 3 days
(9 Reviews)
4.6
xiongjiezhao222

Hi. I have good experiences with data scraping. I have many experiences with crawling and search system using solr, hbase and nutch based hadoop for image search engine. I have good skills with Selenium ,HtmlUtil More

$1000 USD in 10 days
(22 Reviews)
4.7
DarkKnight2206

I am a python developer. I have great experience in web scraping and I am an expert in it. I have all necessary skills by which I can scrape any website. I have even scraped sites like google, whatsapp web, etc. which More

$500 USD in 2 days
(21 Reviews)
4.9