Closed

Extract Websites From Common Crawl Dataset

Looking for an experienced big data specialist to use the common crawl data set to get websites that offer tours and travels to [login to view URL] the successful candidate should have experience with the common crawl data set and how to implement the processing of this data with Map Reduce and running it on AWS EMR. You should be able to do this as cheaply as possible. In case we don't get the desired results the freelancer should advice on an alternative web crawling strategies/solutions.

Skills: Amazon Web Services, Data Mining, Elasticsearch, Python, Web Scraping

See more: common crawl search engine, common crawl python, common crawl get started, common crawl index, common crawl domain list, common crawl tutorial, common crawl url, common crawl examples, extract data from websites like yelp, extract clips from, extract audio from a youtube video, common crawl php script, use common crawl corpus php script, common crawl, common crawl python

About the Employer:
( 3 reviews ) Nairobi, Kenya

Project ID: #17344880

19 freelancers are bidding on average $502 for this job

$555 USD in 5 days
(229 Reviews)
6.9
bestit4u

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of web scraper development experience such this projects. And I have good skills with this program languag More

$444 USD in 10 days
(70 Reviews)
6.6
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$333 USD in 5 days
(52 Reviews)
6.4
mmadi

Hi enjogu, Hope you are hale & healthy. I have gone through your project Extract Websites From Common Crawl Dataset I am a full stack developer with strong knowledge of your required skills Amazon Web Services, Da More

$525 USD in 12 days
(7 Reviews)
5.9
schoudhary1553

Hi there..... Warm Greetings We came along with your request for Extract Websites From Common Crawl Dataset and we reviewed your project description. We'd like to help you with confidence and satisfying results.. More

$555 USD in 10 days
(30 Reviews)
6.0
maximwang8661

nice to meet you. I am a good scraping expert. I have a lot of experience in scraping. My reviews will help you get to know me better. Let's have a good discussion about your project with me. If you hire me, I wil More

$555 USD in 10 days
(11 Reviews)
4.3
istiyaqueahmed

Hello sir, I'm Web Scraping Specialist. sample task [login to view URL] [login to view URL] [login to view URL] [login to view URL]

$250 USD in 10 days
(17 Reviews)
4.1
stead121

Hey Dear I am Bob I am python expert as well as data scraping You can know it when you see my portfolio I scraped all USA City estate data in a few seconds without block Data minning or scraping is very interestin More

$555 USD in 5 days
(5 Reviews)
3.6
$833 USD in 10 days
(1 Review)
3.5
rushabhsudame

Hello Sir. I am Python Developer. And I am looking for some Scrapping projects to improve my work experience in Scrapping projects. I guaranty you the complete delivery of project on time. Thank You. Relevant Skills a More

$254 USD in 10 days
(0 Reviews)
1.0
binarycodersvw

Hi.I am a Visual Basic .NET programmer with 14 years experience(others say this too but I can show proof). This is not another automated bid like the ones you see around. I have read the description of your project an More

$555 USD in 10 days
(0 Reviews)
0.0
rajeetbgl

§Have professional experience(1 year @ Onsite) at various stages of Application Software Development using Oracle, Pl/sql, Big data technologies, Amazon Web Services, Pro C, Python, Java, REST service JSON and SOAP ser More

$722 USD in 20 days
(0 Reviews)
0.0
BissiEU

Hi, nice request! based upon my experience, we can successfully realize it via a fully transparent service that configure and filters the database. I use A.I. driven automatic crawlers to interface and select the More

$499 USD in 15 days
(0 Reviews)
0.0
divumanocha

Hi, Warm Greetings.!!! I have been really very happy to see a job posting which is 100% fit for my skills. According to the job description, you need a Python developer to assist you in your project. -I am More

$555 USD in 10 days
(0 Reviews)
0.0
$277 USD in 5 days
(0 Reviews)
0.0
agarwalsonali198

Hi, I can build u the setup of octoparse to scrape data from website.U only have to download the octoparse free version and task building would be done in order to scrape the data. thanks soanli

$277 USD in 10 days
(0 Reviews)
0.0
wadmad

Hello, I can help you with this project to extract your website including responsive for all the devices and others features. I have very good experience in website designing and development using WordPress, PHP, More

$500 USD in 10 days
(1 Review)
0.0
krishaweb

Greetings!! 800+ satisfied clients in different business verticals. We at Krishaweb are 100% recommended with 5.0 rating due to our excellent client support and delivery perfection. With over 10 years' experienc More

$744 USD in 10 days
(0 Reviews)
0.0
$555 USD in 6 days
(0 Reviews)
0.0