Closed

Perl programming for a simple text parsing script

We are mining a database of English articles and need a Perl programmer to assist us in generating some simple Perl scripts for this purpose.

The following task is one of the many upcoming projects and we a looking to hire somebody with a longer term employment relationship in mind.

The task:

We have a large tab-delimited file, the 6th columns of which contains the data of our interest. On the 6th column of each row is a set of comma-separated English words that we have already reduced to their dictionary form. We require a script that loops through all the sets of words and generates the following statistics as output.

1. A list of all unique words present over the entire column. Associated with each unique word should be term frequency, term rate (term frequency of current word divided by total number of all words in the file), document frequency (number of rows the word appears in) and document rate (document frequency of current word divided by number of rows).

2. All of the above statistics, but this time for bi-grams: bi-gram frequency, bi-gram rate, and document frequency and rate for bi-grams. Bi-grams are neighboring pairs of words. For example in the previous sentence, the bi-grams would be (all,of), (of,the), (the,above), etc. but NOT (of,all).

Please include both cost and duration estimates in your application. Please also include a brief sample of your previous Perl code.

Update Feb 26, 2014:
We just need a simple barebones script that reads the file, splits the columns, splits the words, counts them and outputs to STDOUT. For a competent Perl programmer, this job should take no more than 30 minutes. Please bid accordingly, taking into account both your working hours needed and your hourly rate.

Skills: Perl

See more: parsing text perl, parsing output script, parsing perl scripts, simple programming projects in c#, set of pairs, programming words, programming scripts, programming projects for hire, programming loops, programming in perl, programming dictionary, programming articles, programmer dictionary, perl programmer for hire, one word for many words dictionary, mind programming, loops programming, loops in programming, hire programmer perl, hire dictionary, hire a perl programmer, hire a database programmer, c programming loops, cost of a programmer, a hire programmer

About the Employer:
( 0 reviews ) United Kingdom

Project ID: #5486727

22 freelancers are bidding on average $60 for this job

TarasKuzyo

Hi! I have some experience in perl but I suggest you python for this task. I can write high quality and efficiend code for this task using python. If it is ok for you please, contact me. I can send you my samples of py More

$50 USD in 1 day
(62 Reviews)
5.6
zkutch

Hello. More 20 years programming experience. I do not find possibility to add attachment near this message, so if/when I receive answer from you I'll be able to attach and send example of my perl scripts from general More

$50 USD in 7 days
(25 Reviews)
4.8
SuiGenSolutions

Hello Sir, We can do this task very quickly. We have used perl scripts in many of our projects for text processing as well as web scraping. It shouldn't take more than a couple of hours for us to write the script More

$30 USD in 1 day
(2 Reviews)
3.8
SigmaVisual

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of our experience: Amazon/Ebay Bots: [url removed, login to view] More

$206 USD in 5 days
(13 Reviews)
5.3
sveralex

A proposal has not yet been provided

$190 USD in 7 days
(3 Reviews)
3.0
rapunzelme

Hi, I have good knowledge of perl including complex regular expressions. Let me know if I should start. Because of privacy reason I can not show you the previous code of work, However you can check hte reviews given More

$90 USD in 3 days
(3 Reviews)
2.6
ranganathp

Can help... I am an Expert... Lets Start! Please start a Discussion with me and we can get started from there... Please check the past projects I have handled and check my reviews for what employers have to say about More

$100 USD in 1 day
(1 Review)
1.9
burhan102

I have 3+ years of experience in c, c++, perl programming. I can easily finish your task.. Lets discuss in detail.

$40 USD in 2 days
(1 Review)
0.2
razvand70

Hi, expert perl programmer here with over 15 years experience - please see my ratings. I've made hundreds of perl scripts.

$61 USD in 1 day
(0 Reviews)
0.0
ashishkumar18

A proposal has not yet been provided

$25 USD in 1 day
(0 Reviews)
0.0
abhishekisnot

well versed perl programmer, with experience on CSV parsing. Send the sample file and I can share how output would look like. If it looks ok, we can move forward.

$111 USD in 7 days
(0 Reviews)
0.0
blueegg

Hello, I am at ease with Perl for 5+ years, mainly to process text file and data using regular expression. Can help you with this script, though it is not fair for just 30$. Looking also for a long term Perl dev ro More

$55 USD in 2 days
(0 Reviews)
0.0
jaga44

my prevous perl code - 1. To find files with following extensions : jpg,gif,bmp,mp4. 2. Source and destination directory are configurable. code - #!/usr/bin/perl -w my $SourceDir = <STDIN>; chomp($SourceDir); More

$50 USD in 1 day
(0 Reviews)
0.0
prateekmotwani5

A proposal has not yet been provided

$25 USD in 1 day
(0 Reviews)
0.0
clickitpro

This is an easy job. I can complete it within an hour. My hour rate is US$10. I have enclosed a portion of a sample script anchor,pl that I have written to extract anchor text and links from HTML documents. #!/usr/ More

$15 USD in 1 day
(0 Reviews)
0.0
madhurikulukuru

I have done these type of tasks before as part of my job. And can do this too. I would be using regular expressions for the same.

$55 USD in 1 day
(0 Reviews)
0.0
swamis71

I have worked extensively on perl, bioinformatics, and xml/text parsing and integrating with mysql. When perl was in vogue I had designed several dynamic websites also using this scripting language. I have 20+ years More

$30 USD in 2 days
(0 Reviews)
0.0
sandybioteck

I can do it in just a day. Although i am new in freelancer (as u can see from my profile) but I am a grad student in data mining and I use perl for data mining. I even have made web databases which are purely wor More

$15 USD in 1 day
(0 Reviews)
0.0
weldja

Hi I have several years Perl scripting experience (mainly Unix environment - UK based). Please let me know if you would like any more information - heres a sample script. #!/usr/bin/perl -w use strict; use Dat More

$25 USD in 5 days
(0 Reviews)
0.0
gk81

Hello, I have a ready implementation. Sample: use strict; use List::Uniq qw(:all); use Data::Dumper; my $ColumnIndex=6; my $ColumnsDelimiter=';'; my $WordsDelimiter=','; my %R=(); open ('FH',$ARGV[0]); More

$15 USD in 1 day
(0 Reviews)
0.0