Closed

BASIC EMR ON MAP-R V3 AND AWS S3 - repost

1- Scope:

Providing with a basic Hadoop Map-R V.3 environment over Amazon Web Services. Basic trial environment in this phase. No need to provide 24 x 7 tools or extra code.

Main aim is to analyse data from several text S3 input sources and start trial period.

2- Tools:

We provide Project AWS account for the Project and Map-R V.3 Hadoop clusters. Free administration for implementing this project.

3- Deliverables:

- Scripts code for AWS API based automatic MAP-R V.3 Set-up for a given number of masters and computing nodes.

- Set up scripts capable of using EC2 on “demand nodes”

o For real time 24x 7 live queries

o For batch night processes.

- Java basic code for providing basic routines like:

o Joints tables form several text sources.

o Gauss statistics: Mean, deviation, etc.

o Basic counting and basic mathematics routines.

o Output text or Mysql computed tables.

- skype sessions for 4 hours to train skilled informatics from de php and javascript world.

- Documented source code.

4- Input sources:

The project is intended for analysing and creating logs joints form distant connected devices and central text tables.

- Several TEXT files for remote devices stored on S3 files.

o Characteristics of remote devices (>400.000 TV sets)

• Brand

• Programed parameters

• Available channels o

• Geo location

o Log text of distant

• Real time logging of visits

• Number of visits

• Duration

• TV station tuned in in each moment

• Type home demographics where the device is installed.

o TV Stations programming scheduling

• Show type: movie, talk show, debate

• Start time, end time.

• Celebrities involved in the show.

6- Expected outputs.

- Several combinations of the above.

- - Mean time per TV set type expend in each type of show.

o Mean time

o Standard deviation

o Top celebrities watched

- Samples of joints form several sources.

- Real time queries set up in case of need real time response.

- Batch set up for long time consuming queries of whole set of queries.

7- Time table.

- Needed in four weeks / January end – first September week.

- We provide AWS zone with all the text sources inside ready for use.

- Week days 9- 18h CET e-mail /skype contact for immediate support for any doubt or clarification needs.

8- References:

- No project will be awarded without clear and outstanding references on hadoop implantations over AWS ,

- MAP-R is a plus.

Skills: Big Data, Hadoop, Java, Map Reduce, NoSQL Couch & Mongo

See more: x on demand, web informatics, use case tools free, use case map, use case amazon, tv remote programming, top mathematics, tools needed for programming, tools needed for java programming, the n and o, skype api for php, scheduling javascript, real clear world, Programming with R, programming tv remote, programming remote to tv, programming a remote to a tv, o log n, number mathematics, masters in programming, location services api, location based services api, location based devices, java programming tools, java programming services

About the Employer:
( 0 reviews ) India

Project ID: #5280739

5 freelancers are bidding on average €2422 for this job

freelancerj2ee

I have done a couple hadoop/cloud computing related projects: [url removed, login to view] [url removed, login to view] More

€1527 EUR in 10 days
(7 Reviews)
4.0
innovese

Hi, I have worked with many startups and previously, and I had worked on a startup which was sold off to the German Bertelsmann Group. Now I have started this company called algoscale focusing on building highly sc More

€1444 EUR in 20 days
(4 Reviews)
3.7
aczireonline

Hi Will do this for you. Being working in the BigData domain for more than 3 years and a Cloudera and IBM certified Hadoop developer, I hope this is my domain. Well, that was to just introduce myself, now on to More

€2888 EUR in 60 days
(3 Reviews)
3.5
meljux

Hi, I can use my own account to start hadoop on AWS. Training on this topic is very expensive and really wide wide wild.... I belong to a team of web developers and web designers who are excited by all the possibilitie More

€5000 EUR in 7 days
(0 Reviews)
0.0
naveenamp

I am expert in Java. I have over 8 years of experience in designing and developing Java, Hadoop,Map Reduce and web applications. I understand your requirement and able to deliver you project as per your expectation wit More

€1250 EUR in 20 days
(0 Reviews)
0.0