My client is looking to replicate a big database that is found online. To this end I need to hire a professional web-scraper. The scraping is a multi-step process and I would require four different delivarables: I first need to seek out certain ID’s using keywords, and then search for the ID’s to get all the data for that particular ID. I then need to find ID’s “close by” using regexp, and then find all the data for those particular ID’s. Thirdly, I’d like a copy of the full DB using some clever scripting. Finally, I’d like updated data each month after the first complete batch was delivered. The output should be done to CSV’s iterated so that no single CSV contains more than 65k lines.
In order for me to consider you for this project I need you to
• Briefly describe 3 web-scraping projects you’ve previously completed
• Tell me which language/tools you’ll use for this
• Tell me how to handle “anti-scraping-protections” (I don’t know if these are in place, but if they are we need to go around them somehow).
After reviewing your offer I will give more detailed instructions and give you the URL for the website, so that you can review it prior to accepting the project.
f you have not done this before and cannot do this fast and comprehensively DO NOT BID.
27 freelancers are bidding on average $181 for this job
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work