In Progress

URGENT - Fix Bugs in Ruby based web application

Experienced developer needed to fix bugs in Ruby/Ruby on Rails web application and "fine tune" the script if needed.

The application has already been developed, but is not usable as bugs makes it impossible to generate exportable .csv files. (see below)

The application is an automated web scraping application which can identify from large lists of website URLs (over 500K), business websites from non-business websites, by checking all intranet links against a set of keywords that have been input before hand.

The application script works the following way:

1. It verifies whether each URL corresponds to an active website.

2. It browses the website homepages (only the homepage) and identifies "intra site" links (internal links)

3. It determines whether the text in any of the homepage internal links includes a particular keyword. (from a pre-determined set of keywords - such as "about us", "services", "company", "clients"...)

for example: www. website .com/[url removed, login to view] - this link will give a "positive" result since the word

"services" appears in the link. (the word "services" would have been pre-determined by the user)

The application is multi-threaded and runs on a high powered dedicated server for maximum processing speed

A web interface allows the user to

- upload a list of URLs to scrape (up to 500K URLs per list)

- add keyword/remove keyword

- start the "mining" process

- Display of the real-time count of URLs processed

- Download as .CSV the URL list of active websites, positive-identified websites and negative ones

This last feature has been developed, but it is not fully working. This makes the app not usable. This is what needs to be fixed.

To resolve the bugs, there may need to be a "fine-tuning" of the script


Skills: Data Mining, Linux, MySQL, Ruby on Rails, Web Scraping

See more: fix bugs website ruby rails, what ruby on rails, website developed in ruby on rails, web scraping process, web scraping business, web scraping application, web of ruby, web developer ruby on rails, web developer homepage, services fix, server for ruby on rails, ruby on rails websites, ruby on rails server, ruby on rails linux, ruby on rails last, ruby on rails download, ruby on rails bid, ruby on rails app for server, ruby on rails app, need ruby on rails developer, need developer web based application, list services linux, linux list services, homepage intranet, fix services

About the Employer:
( 105 reviews ) London, United Kingdom

Project ID: #2649042

Awarded to:


I'm interested.

$250 USD in 5 days
(37 Reviews)

5 freelancers are bidding on average $340 for this job


Hi , I am interested in taking this project. Please check my PMB for more details.

$500 USD in 7 days
(5 Reviews)

Ror Expert !!!

$300 USD in 3 days
(3 Reviews)

Hi, I'm a experienced Rails developer. I Can do this easly. See PMB, please.

$250 USD in 5 days
(1 Review)

I have some ruby on rails experience and this shouldnt be a problem.

$400 USD in 10 days
(0 Reviews)