Python Basic NLP project

This project is to be coded in Python 3.

Given an input CSV file that has at least three columns titled annotations, year and field, I would like the code that you will create to count the occurrences of all words and produce two CSV output files.

Example input file (columns will not always be in this order but will always have these three columns. There will always be a header to the CSV file):

annotations | year | field

word1 word2 word3 | 2010 | field1

word3 word4 word5 | 2011 | field2

word1 word5 | 2010 | field1

word1 |2010 | field2

I want you to count the frequency of the words within the column "annotations" given its appearance in a field and year. The output is a CSV file that has the following columns:

word | frequency | year | field | normalised frequency | normalised frequency * 1000 | percentage

As an example output line we would have:

word1 | 2 | 2010 | field1 | 2/5= 0.4| 0.4*1000=400 | 0.6667

The percentage column is based on the number of times the word appears for this field (on this year) given the number of times the word appears overall for that year. Example

Word1 appears two times in field1 and once in field2 in 2010. Therefore it appears .6667 in field1 and .3334 in field2. If we were to add this line in our example file:

word1 |2011 |field2

This line would not affect our results, because the percentages are based on the year.

The second CSV output file is as follows —

word | year1_field1_percentage | year1_field2_percentage | … (as many columns as fields) … | year2_field1_percentage | year2_field2_percentage | … as many columns as fields … (and so on for every year in the input file)

Years columns are to go in ascending order (i.e. 2012_field1_percentage … 2013_field1_percentage … 2014_field1_percentage .. etc)

Skills: Python

See more: visual basic database project stored excel, visual basic booking project, visual basic rename project, nlp preprocessing python, nltk tutorials point, understanding nlp, nlp tutorial, natural language processing code, natural language processing: python and nltk pdf, natural language processing projects in python github, natural language processing with python source code, basic photoshop project, visual basic sample project, basic payroll project, basic net project, visual basic graduation project, vbnet msaccess project source code want, visual basic pharmacy project, visual basic blackjack project, visual basic animation project

About the Employer:
( 0 reviews ) Sydney, United States

Project ID: #19038937

Awarded to:


I am a data scientist proficient in machine learning and web scrapping. My expertise in Python and R have comes from my experience in Natural Language processing, statistical analysis, web scraping etc. I also have a s More

$100 AUD in 2 days
(72 Reviews)

29 freelancers are bidding on average $147 for this job


Hello. I have reach experience for the python NLP module. I have already created several similar projects. i can do your task completely.

$200 AUD in 3 days
(17 Reviews)

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. More

$250 AUD in 4 days
(23 Reviews)

Dear sir. Your project attracted my attention at first glance, because I've extensive experience in Python & NLP Programming. I'm really confident about your project, and very eager to join your project. If we have More

$250 AUD in 3 days
(27 Reviews)

Hi, Dear Employer! I am really interested in your project. I have enough experience in Python, C/C++, C#, java programming. I am 100% sure I can satisfy your requirements perfectly. User-Friendly Interface And Cle More

$250 AUD in 3 days
(7 Reviews)

Hello! This project is very interesting. I have many experiences in NLP and data analysis. so can help you with implementing this project. Python is my first skill. Thanks.

$150 AUD in 3 days
(16 Reviews)

Hi. My name is Uzair.I did my masters in Electrical Engineering. I have done my thesis in biomedical signal processing and Machine learning. I have more than 3 years of experience in Python/MATLAB specially in Machin More

$155 AUD in 3 days
(13 Reviews)

*** Python *** Hi I have read your project description very carefully so I am confidence to complete your project I have finished lots of such projects successfully. I am an experienced and skillful python devel More

$100 AUD in 3 days
(21 Reviews)

Hi, I'm professional web developer and I lead a team of developers as well. We have great Python developer in our team and we are ready to help you. Lets discuss the details in private chat For the last year we More

$150 AUD in 3 days
(7 Reviews)

Hello, dear! I am interested in your project. I have extensive experience in Python. As a developer with rich experience, I am confident about your project. I will provide perfect results in a short time. If you w More

$200 AUD in 3 days
(4 Reviews)

Relevant Skills and Experience: I have good experiences developing code in Python Programming language for scientific application ,data science and Machine learning projects. For your task i think i can do it most More

$45 AUD in 2 days
(11 Reviews)

Hi,i'm a data scientist with a BS degree in computer science i will do your task as fast as i can and i will achieve it exactly as you want,don't worry about any thing contact me for discussion

$50 AUD in 3 days
(12 Reviews)

I have good Python coding skill, and have experience in text data processing using Python. I am very interested in your project. Please contact me, thank you. I have good Python coding skill, and have experience in te More

$155 AUD in 10 days
(9 Reviews)

Hi, I hope you are doing good. well regarding this project, I have good experience in Machine learning (NLP, Computer Vision, Image processing) problems using Python. I understand the work which is very easy becaus More

$50 AUD in 1 day
(2 Reviews)

Hello Dear Employer, I have over 5 years of experience in Python development. I have worked with CSV files and I can do this task in around a day time. I am new to freelancer but not to python. Please refer to my po More

$160 AUD in 1 day
(1 Review)

this is a very basic python task for us we will deliver you working python script with in 24 hours please share with us the csv file so we can discuss it further

$100 AUD in 1 day
(1 Review)

I've been working in Python machine learning for over decade. This is a relatively simple task and I will have no issue getting it to you prompt and correct in a short amount of time for a more sensible fee.

$55 AUD in 3 days
(1 Review)

I am good in Python and have the overall development experience of 5 years. I already did similar kind of development and have the code for it. What i need to do is just need to change the code i have in few areas and More

$177 AUD in 2 days
(0 Reviews)

Hi there,I see you're looking for somebody to build python code that create to count the occurrences of all words and produce two CSV output files. I am expert in the following C++,C#, .NET,Software Architecture,Windo More

$188 AUD in 3 days
(0 Reviews)

Vast knowledge in python and working experience with Natural Language Processing. i have also worked on projects like next word prediction which had a lot to do with techniques like n grams and various other measures l More

$70 AUD in 6 days
(0 Reviews)

Hello I am professional software developer with bachelor degree IN electronics. Can do it for a week.

$73 AUD in 7 days
(0 Reviews)