Simple scraping done in ruby



Here is a link example: [url removed, login to view],2&org=engine&BCLANNpg=1

For this project, you'll need to write a scraper with Ruby (we can talk gems, but mechanize and nokogiri would be perfect) to scrape all the entries for the many pages available starting from some given urls. The output will be a single table (csv for example), that will have to be clean (some regexp will have to be applied to clean phone numbers for example). The columns are yet to be determined but the data will be easily accessible in the html. (probably ~10 regexp to be written)

The code will need to be well-written and commented. Some simple spec coverage required for future maintainability.

There will be follow-up projects, e.g being able to run the scraper daily for updates.

Looking forward to it!



Skills: MySQL, Ruby on Rails, Web Scraping

See more: ruby on rails org, ruby on rails gems, regexp example, mechanize web scraping, web scraping ruby, recherche , recherche web, nicolas, gems, clean ruby, web scraping table data, ruby rails web, table csv, html rails, ruby nokogiri, table scraper, ruby html project, www gems, simple web scraping, rails mechanize, csv scraping, web scraping engine, scraping engine, web scraping code, example web scraping

Project ID: #4106351