Extract Websites From Common Crawl Dataset

Looking for an experienced big data specialist to use the common crawl data set to get websites that offer tours and travels to [login to view URL] the successful candidate should have experience with the common crawl data set and how to implement the processing of this data with Map Reduce and running it on AWS EMR. You should be able to do this as cheaply as possible. In case we don't get the desired results the freelancer should advice on an alternative web crawling strategies/solutions.

Skills: Amazon Web Services, Data Mining, Elasticsearch, Python, Web Scraping

See more: extract data from websites like yelp, extract clips from, extract audio from a youtube video, common crawl search engine, common crawl python, common crawl get started, common crawl index, common crawl domain list, common crawl tutorial, common crawl url, common crawl examples, excel, python, web scraping, data mining, common crawl php script, use common crawl corpus php script, common crawl, common crawl corpus, python common crawl

About the Employer:
( 3 reviews ) Nairobi, Kenya

Project ID: #17344880

19 freelancers are bidding on average $502 for this job

$555 USD in 5 days
(241 Reviews)

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of web scraper development experience such this projects. And I have good skills with this program languag More

$444 USD in 10 days
(81 Reviews)

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$333 USD in 5 days
(77 Reviews)

Hi enjogu, Hope you are hale & healthy. I have gone through your project Extract Websites From Common Crawl Dataset I am a full stack developer with strong knowledge of your required skills Amazon Web Services, Da More

$525 USD in 12 days
(8 Reviews)

Hi there..... Warm Greetings We came along with your request for Extract Websites From Common Crawl Dataset and we reviewed your project description. We'd like to help you with confidence and satisfying results.. More

$555 USD in 10 days
(40 Reviews)

Hey Dear I am Bob I am python expert as well as data scraping You can know it when you see my portfolio I scraped all USA City estate data in a few seconds without block Data minning or scraping is very interestin More

$555 USD in 5 days
(18 Reviews)

Hello sir, I'm Web Scraping Specialist. sample task [login to view URL] [login to view URL] [login to view URL] [login to view URL]

$250 USD in 10 days
(23 Reviews)

nice to meet you. I am a good scraping expert. I have a lot of experience in scraping. My reviews will help you get to know me better. Let's have a good discussion about your project with me. If you hire me, I wil More

$555 USD in 10 days
(11 Reviews)

Hi, nice request! based upon my experience, we can successfully realize it via a fully transparent service that configure and filters the database. I use A.I. driven automatic crawlers to interface and select the More

$499 USD in 15 days
(1 Review)
$833 USD in 10 days
(1 Review)

Hello Sir. I am Python Developer. And I am looking for some Scrapping projects to improve my work experience in Scrapping projects. I guaranty you the complete delivery of project on time. Thank You. Relevant Skills a More

$254 USD in 10 days
(0 Reviews)

Hi.I am a Visual Basic .NET programmer with 14 years experience(others say this too but I can show proof). This is not another automated bid like the ones you see around. I have read the description of your project an More

$555 USD in 10 days
(0 Reviews)

§Have professional experience(1 year @ Onsite) at various stages of Application Software Development using Oracle, Pl/sql, Big data technologies, Amazon Web Services, Pro C, Python, Java, REST service JSON and SOAP ser More

$722 USD in 20 days
(0 Reviews)

Hi, Warm Greetings.!!! I have been really very happy to see a job posting which is 100% fit for my skills. According to the job description, you need a Python developer to assist you in your project. -I am More

$555 USD in 10 days
(0 Reviews)
$277 USD in 5 days
(0 Reviews)

Hi, I can build u the setup of octoparse to scrape data from website.U only have to download the octoparse free version and task building would be done in order to scrape the data. thanks soanli

$277 USD in 10 days
(1 Review)

Hello, I can help you with this project to extract your website including responsive for all the devices and others features. I have very good experience in website designing and development using WordPress, PHP, More

$500 USD in 10 days
(1 Review)

Greetings!! 800+ satisfied clients in different business verticals. We at Krishaweb are 100% recommended with 5.0 rating due to our excellent client support and delivery perfection. With over 10 years' experienc More

$744 USD in 10 days
(0 Reviews)
$555 USD in 6 days
(0 Reviews)