URGENT - Fix and optimization of Ruby based web application

URGENT - Fix and optimization of Ruby based web application

Developer needed to fix bug in Ruby/Ruby on Rails web application and optimize application speed.

The application has already been developed, but is not usable as a bug in it makes it impossible to generate .csv files. (see below)

The application is an "intelligent" automated web scraping application which can identify from large lists of website URLs (over 500K), business websites from non-business websites, by checking all intranet links against a set of keywords that have been input before hand.

The application script works the following way:

1. It verifies whether each URL corresponds to an active website.

2. It browses the website homepages (only the homepage) and identifies "intra site" links (internal links)

3. It determines whether the text in any of the homepage internal links includes a particular keyword. (from a pre-determined set of keywords - such as "about us", "services", "company", "clients"...)

for example: www. website .com/[url removed, login to view] - this link will give a "positive" result since the word

"services" appears in the link. (the word "services" would have been pre-determined by the user)

The application is multi-threaded to optimise the processing speed.

A web interface allows the user to

- upload a list of URLs to scrape (up to 500K Urls per list)

- add keyword/remove keyword

- start the "mining" process

- Display of the real-time count of URLs processed

- Download as .CSV the URL list of active websites, positive-identified websites and negative ones

This last feature has been developed, but it is not fully working. This makes the app not usable. This is what needs to be fixed.


Skills: Data Mining, Linux, MySQL, Ruby on Rails, Web Scraping

See more: optimize app fix bug, what ruby on rails, website optimization services, web site optimization services, website developed in ruby on rails, web scraping process, web scraping business, web scraping application, web of ruby, web it developer, web developer ruby on rails, web developer homepage, site web from developer, services fix, ruby on rails websites, ruby on rails linux, ruby on rails last, ruby on rails download, ruby on rails bid, ruby on rails app, list services linux, linux list services, link optimization, interface of website, homepage intranet

About the Employer:
( 105 reviews ) London, United Kingdom

Project ID: #2646485

6 freelancers are bidding on average $223 for this job


I'm interested.

$150 USD in 4 days
(37 Reviews)

Hi sonovan Please check the pmb. Thanks much. Janky

$250 USD in 5 days
(7 Reviews)

Can we discuss this in detail before start this project,for more detail please check in PM.

$190 USD in 7 days
(7 Reviews)

I was been specialize in web scrabing / parsing longtime, using many scripts languages (including Perl, PHP, Python), now working in RoR. I like optimize and modify for best script's working. Grea experience in MySQL u More

$250 USD in 6 days
(6 Reviews)

Ror Expert !!!

$250 USD in 7 days
(3 Reviews)

I have about a year working xp with ruby on rails. I can take a look at it.

$250 USD in 5 days
(0 Reviews)