In Progress

Simple log analysis script using apache Pig

Analyze log files using pig script.

Some simple data to extract:

Users (ie unique session ids)

Responsecodes

Percentage of 500 errors per month

Count of 500 errors grouped by month

Count of 500 errors grouped by day

Percentage of 404 errors per month

Count of 404 errors grouped by month

Count of 404 errors grouped by day

unique paths producing 404 errors

Access log should also exclude calls from pingdom / searchspiders etc (some at least)

Se sample file below

Skills: Hadoop, SQL

See more: apache log analysis pig, pig script analyze apache log files, log analysis using pig session, pig log file analysis, pig log analysis, analysis using pig, pig script apache log file analysis, apache access log analysis using pig, pig script, sql data analysis, pig, log files, hadoop, session script, script 404, analysis log file, simple data analysis, 404 errors, apache access, sql analysis, simple sql extract, extract ids, sample data analysis, sql unique file, simple count script

About the Employer:
( 7 reviews ) Bruvik, Norway

Project ID: #4338147

Awarded to:

freelancerj2ee

Please kindly check the PMB.

$250 USD in 10 days
(0 Reviews)
0.0

6 freelancers are bidding on average $232 for this job

siva5

I have 2 years of experience in hadoop echo system. A best solution can be given to you within a week. I have done similar projects previously

$240 USD in 4 days
(0 Reviews)
0.0
bigdata21

I can complete easily.

$200 USD in 4 days
(0 Reviews)
0.0
lisawongvworker

I have tons of hands on experience with Pig/Hive and am an active contributor to Hadoop.

$200 USD in 5 days
(0 Reviews)
0.0
sverma71

Hi, Can do this easily. Please see private message for details. Thanks

$250 USD in 10 days
(0 Reviews)
0.0
skmohankr

we have expert in sql

$250 USD in 25 days
(0 Reviews)
0.0