Ruby: Write a Rake task that scrapes information from web pages.

Please write a Rake task that scrapes job information from pages on Indeed and outputs the data in JSON. You should be able to pass a search term to it on the command line (e.g. “sales”).

Your script should attempt to extract:

the company

the job title

the wage

the summary/description

Some data will be harder to get than other and it is next to impossible to get perfect data when scraping so don’t spend forever on it! What’s more important is making sure you are pleased with your code quality and have something interesting and working. Some extra points which you might choose to consider:

unit / integration tests

modular / extensible code

extracting website / email / phone

scraping from the linked job pages in addition to the main search page

scraping multiple search results pages

using git to show your progress

This job is kinda urgent and it would be great if this can be done by tomorrow.

There will be bonus if you finish this in time.


Skills: Ruby, Ruby on Rails, Web Scraping

See more: taxi calculator web pages, forms letters web pages, book web pages, web scraping ruby on rails, ruby web crawler, how to do scraping in rails, ruby web scraping gem, ruby on rails scrape web page, scraping javascript rendered web pages ruby, web scraping ruby vs python, nokogiri web scraping, web pages design bogot, firefox copy past web pages, link web pages google local listing, dream web pages pvt ltd, creating cover flow style web pages, write script read web pages, write php program parse web pages, write script reads web pages, parse information web pages

About the Employer:
( 0 reviews ) Curtea, Suceava, Romania

Project ID: #18287141

17 freelancers are bidding on average $188 for this job


Hello There, I have 6+ years of experience in ruby on rails, AngularJS and Node.js. I can do this tasks in very fast and easily. I have created my own gems also you can visit this on my github url that is "https://gi More

$200 USD in 2 days
(43 Reviews)

Dear, I have 6+ years experienced in Web Development. I'm full stack Ruby On Rails developer, I have experience in developing the application like you want with, i can do this job very well. Specialties: Ruby More

$222 USD in 3 days
(55 Reviews)

I have gone thoroughly your project description. I feel very excited to be a part of your project and I love to share my great experience to deploy this project. I have 5+ years experience in Ruby on Rails with other More

$555 USD in 3 days
(29 Reviews)

I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid More

$220 USD in 3 days
(15 Reviews)

Hello Andrei, Thanks for the invite, I can do the job, please send me a message so we can discuss more, i will start your work ASAP. Thanks!

$133 USD in 3 days
(21 Reviews)

Hello Andrei, I can scrape the data as per your requirement, please send me a message so we can discuss further, i have done similar job before. Thank you!

$100 USD in 3 days
(7 Reviews)

Hello, I can finish your job in the given time frame, Will extract the company name,job title etc. Let me know if you are interested. Thanks, Amit

$155 USD in 3 days
(20 Reviews)

Greetings!! I am glad to bid for your project. I am a software developer with an experience of more than 5 years in technologies like Ruby on Rails, Ruby, MySQL, Postgresql, Mongo/Couch No SQL, Jekyll, Heroku CS More

$133 USD in 1 day
(10 Reviews)

Hello there, First of all, thanks for giving me an opportunity to bid on this project. I would like to work with you on this project. I have worked on many large projects in different domains like Hotel managemen More

$250 USD in 5 days
(15 Reviews)

dear I've read your requirements and I think I can do it. i am very familiar in ruby on rails. and i have many experiences in web scrapping. I have been working for 6+ years on this kind of job. I have many previo More

$150 USD in 3 days
(8 Reviews)

Dear, employer. My name is Xungxiao, I am an experienced web developer, and web scraping expert. I am a new freelancer here, but I have good experiences in web scraping using PHP, Python, Java and so on. I read yo More

$111 USD in 3 days
(8 Reviews)

I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest More

$100 USD in 5 days
(6 Reviews)

Hi, there. I am very interested in your project. I have 8 years of experiences in web scraping using Ruby. So I can help you and I am ready to start now. Looking forward to hearing from you soon. Regards.

$140 USD in 3 days
(2 Reviews)

I specialize in Python, ML & AI, application development, PHP, Django, JS and other technical skills which are useful in application development. Tools I know: Web scrapping keras tensorflow sklearn pyhton sci More

$155 USD in 3 days
(0 Reviews)

Hi! My name is Miguel Montalvo, I am a Spanish Ruby on Rails developer with more than 8 years of experience in this technology, living now in London. Have professional experience working in a wide range of different pr More

$222 USD in 1 day
(0 Reviews)

Hi, I just went through your job posting and here are my details: I have over 7 years of experience working in Ruby on Rails, AngularJS, BackboneJS, MeanStack, MongoDB, NodeJS and CoffeeScript. I have developed a nu More

$200 USD in 3 days
(0 Reviews)

'cause this is my day to day job to write rake tasks to automate stuff like web scraping, deployment and etc...

$155 USD in 1 day
(0 Reviews)