In Progress

Python expert for Analyze and existing dataset and extract extra features from an existing one

first column K in the excel sheet (description ) has several alarms and events, we need to explore the relationship between those alarms /events and find the statistical relations between that events, and identify if there is any coloration between those events /alarms that are considering a specific Sid ( which represents a single device in a single location ),s detailed Exploratory data analysis required.

the second request for column G, this column contains raw msgs from the different protocols ( the msg format explained below ) the raw column contains lots of information, Account like identifying format to receiver, Event code, Zone Number, etc ) our concern is to :

a) extract the Zone number from the raw column ( G)

b) combined the zone number with the respective Sid number ( column B ) for each row in the data set,

c) the combination of the zone and sid will create a new column which will have a new unique ID ( zone + SID)

d) the new column can be used to compare the timing between the event/alarm that happened at each raw and the restoral event that happened after word maybe next raw or next few raws, we will use the ( zone + sid ) to distinguish each alarm and restoral.

e) calculate the delta between the event and restoral using column (H) uatime column,

f) we need to build logic around delta by which if delta is lower than 5 minutes, the event and restoral will be tagged as a false event ( creating a new column as a target column ) if delta is more than 5 minutes the alarm and event will be considered as true,

Analyze an existing dataset and extract extra features from an existing steam ( specific format ), basically to extract a known field using Regex or any other suitable method, also compare the extracted features ( event and response ) occurrence timing to create a new column for the dataset as a label, this label column will be the target in the training dataset in the later stage.

thank you.

Skills: Python, Data Processing, Data Mining, Statistics, Machine Learning (ML)

About the Client:
( 130 reviews ) Siem Reap, Cambodia

Project ID: #34360776

Awarded to:

mohamedabdelall4

Hi, I am sure that I can do this job. I'm artificial intelligence engineer experienced in statistics, data science, data analysis, data visualization & machine/deep learning. I accomplished many projects like yours & I More

$90 USD in 5 days
(15 Reviews)
5.0

9 freelancers are bidding on average $69 for this job

suyashdhoot

Hi I am a very experienced statistician, data scientist and academic writer. I have completed several PhD level thesis projects involving advanced statistical analysis of data. I have worked with data from several comp More

$250 USD in 7 days
(167 Reviews)
7.3
MamukaB

hello I can help with the project. hat. will do within day I Can do it using Python but I prefer to use Excel VBA. That is 14 time faster and include more powerful functions for excel data I have 15+ year experience More

$50 USD in 1 day
(25 Reviews)
4.3
avinashdubeyg209

Hi there, I am an ML engineer. I can start right away and deliver within the deadline. So, Let’s have a quick conversation. I can be more specific once we get all the requirements and information required to execute th More

$25 USD in 7 days
(15 Reviews)
3.6
markoradivojevi4

Hi, Manager I am a senior python developer with over 6 years of experience. I read your requirements carefully and I'm very interested in it. I believe my skills would be ideal for your project. I have rich experience More

$50 USD in 7 days
(2 Reviews)
1.2
ayesharifatmed

Hello There! This is Ayesha Siddiqua. Nice to meet with you. I am an M.B.B.S doctor. I have completed my graduation from North Bengal Medical College under Rajshahi University. A versatile and professional Web & Mobil More

$50 USD in 3 days
(1 Review)
1.0
fetouhyacine

Hello. I am an expert in Big Data analytics and have 3 years of experiences in this field. And I have been worked as a data analyst in big data project team and mastered data sources(Strucutred and undstructured data), More

$40 USD in 3 days
(0 Reviews)
0.0
adriroma07

Hello, I can help you in the project. Computer engineer expert in Big data. Throughout my professional career I have developed my expertise in implementing data storage, transformation and visualization solutions. Hig More

$40 USD in 7 days
(0 Reviews)
0.0
Rasel1928

I am Data entry [login to view URL] word, Excel, power point, Call handling, email management, Microsoft, Internet research, web research, customer support, chat support is among the skills obtained . I have good communication s More

$30 USD in 7 days
(0 Reviews)
0.0