In Progress

Need docker environment that is capable of running my application which needs java, python, hadoop, spark and hbase

I have a spark application which pulls information from a HDFS file system and insert data to HBase or vise versa. I need need a docker environment where i can test my spark application. The docker environment can be either single standalone node with java, python, hadoop, spark and hbase

running in it or a cluster running spark and hbase on different nodes. I want in such a way that if i execute the spark submit command then request should go through the docker spark containers and insert the data to hbase container.

Refere : [login to view URL]

Go through the above reference I want similar kind of environment but with updated versions as below. You can work with docker-compose and create a cluster where my application is running in one container and communication with other containers.

Required versions

Java - 1.8

Spark - 2.2.1

Hbase - 1.1.8

Hadoop - 2.7

Python 3.5 or latest

Note: Git hub reference is just for giving an idea how the project looks like, please don't copy that work.

Skills: Docker, Hadoop, HBase, Linux, Spark

See more: spark docker standalone, apache spark docker image, spark 2.0 docker image, spark-submit docker, spark 2.1 docker, spark 2.2 docker image, hadoop ecosystem tutorial, apache spark docker tutorial, java python hadoop, need memory dump running application, running application website, application needs flash, need multi socket gmail mailing application, net running application without gui, create soduku game using java application, red5 video application needs track number users time, need find someone write blackberry application, need lookign developer programmer create application program, need create report service web application using oracle, winwordexe process running application closed

About the Employer:
( 0 reviews ) United States

Project ID: #17225972

Awarded to:

lpalamede

I can do it the same way, but I need to know if you want to do your test with production data, or with a test database?

$55 USD in 3 days
(0 Reviews)
0.0

5 freelancers are bidding on average $60 for this job

$25 USD in 1 day
(0 Reviews)
0.0
$55 USD in 5 days
(0 Reviews)
0.0
THREEPRAVEEN

Hi Obtain a Linux administrative position where I can maximize my technical experience in installation, configuration, and maintenance of Linux server based system and network applications.

$55 USD in 3 days
(0 Reviews)
0.0
$111 USD in 3 days
(0 Reviews)
0.0