Closed

Kafka, Cassandra, Hadoop, and Spark cloud solution in the backend. Please read complete description.

I am developing an IoT solution for which i am expecting large data from edge devices to the cloud. looking for a freelancer to help me in:

- writing requirements

- designing solution

- implementation

- integration with Azure/AWS Cloud and other pieces of the solution

- ongoing support

for:

- managing data streaming from edge (Kafka and probably spark/akka) that include connector/producer/consumer functionalities

- storing the data in NoSQL (Cassandra)

- analyzing and visualizing the data (Hadoop)

SCOPE:

Your scope of work start from the point the data leaves the edge network.

- Receiving the data stream (NiFi or Kafka Connector)

- collecting/consuming the data stream in Kafka (Kafka, Spark)

- Storing the Data in NoSQL DB (Cassandra)

- Analyzing and visualizing the data (Hadoop or its alternative)

Need your help in starting from writing "specifications" to "GoLive" to "Ongoing Support".

I already have:

One engineer taking care of Firmware for Edge.

One engineer taking care of APIs.

One engineer taking care of Mobile App and Website.

You will be interacting with these engineers during project execution.

Please find below my project schedule:

1. Requirements Phase:

Duration 1 month: Expecting at least 10 hours of time per week

Tasks: Documenting specifications, tools/platforms/framework to be used, all interfaces defined

2. Design Phase:

Duration 1 month: Expecting ate least 10 hours of your time every week

Tasks: Documenting Low Level Design/architecture, APIs to be used at all interfaces, Data Modeling/Analysis/Visualization defined

3. Implementation/Integration Phase:

Duration 2 months: Expecting ate least 10 hours of your time every week

Tasks: Coding, Implementation, Configuring, Provisioning, Integration (as applicable)

4. Testing, Automation, Stabilization, Fixing all bugs

Duration 1 month: Expecting ate least 10 hours of your time every week

Tasks: Fixing all bugs, identifying any last minute gap based on my feedback or performance and implementing those

5. Cloud Hosting/Integration/GoLive

Duration 1 month: Expecting ate least 10 hours of your time every week

Tasks: Continue fixing bugs, GoLive on one of the cloud hosting environment (Azure or AWS)

6. Ongoing Support for 6 months after GoLive that does not include new feature

Duration 6 month: Expecting at least 4 hours of your time every week

Tasks: bug fixing, questions and answers on any code/document/design aspect of your part of code, documentation update if needed

Skills: Cassandra, Hadoop, Java, Scala, Spark

See more: what is spark in big data, big data spark tutorial, freelance cloud solution, producer consumer problem unix solution, producer consumer solution, solution producer consumer problem, producer consumer problem solution, cassandra shark spark, i need a gospel music producer, i need a music record producer, i need a tamil film producer, what do i need to include in my company log, cassandra hadoop, i want to be a producer, freelancer hadoop spark, hadoop spark freelancer, hadoop spark projects freelancer, how do i get hold of a producer called tweezy, i need the best music producer, I have installed Magento 2 locally using MAMP. After install and logging into the backend I receive the following System Alert:

About the Employer:
( 1 review ) San Jose, United States

Project ID: #17044636

20 freelancers are bidding on average ₹85667 for this job

anuragiitk

I am an IITK graduate and I have 11 years of experience in software development. I have 100% completion rate and I have finished projects with the highest level of customer satisfaction. I have a team of rock star dev More

₹62500 INR in 20 days
(22 Reviews)
5.4
₹77777 INR in 30 days
(23 Reviews)
4.5
waheni

i am interested with your project please send private message thanks ************************** ****************************************

₹62500 INR in 60 days
(8 Reviews)
4.5
dirisalagopal

Big data expert.

₹60000 INR in 10 days
(8 Reviews)
3.6
akshaynaidu9

Hello, I am willing to work on your project. It project requirement matches with my daily job profile. I work as Hadoop Administrator in a start-up company. Creating and managing pipelines involving Kafka, sqoop, hdf More

₹62500 INR in 20 days
(5 Reviews)
3.2
Thesynapses

Hi there, I'll not take much time. We have 4+ years of experienced Data Scientists, Big Data Engineers and developed a critical ingestion pipeline to process over 300 TB of data. We have experience on different d More

₹62500 INR in 20 days
(1 Review)
2.3
donnyforu

Hello, We are an IT company based in India and we work extensively on AWS Devops Azuure Cloud technology. We have a vast experience and have great track [login to view URL] are sure we can provide you quality work. We can di More

₹100000 INR in 30 days
(1 Review)
2.2
hemantjhalani

Hello I am expert in Kafka and Casandra , PHP so I am one of the suitable candidate for this project. Feel free to contact me. Thanks Hemant

₹70000 INR in 20 days
(3 Reviews)
2.2
imranchaushit

hi my name is imran Chaush i am having 5 year of experience in hadoop Administrator. i gone through your project requirements. and would like to work with you.i am good at AWS but also know GC & AZURE. which hadoop dis More

₹100000 INR in 150 days
(0 Reviews)
0.0
German75

what I propose to you: - use nifi to receive data and send it to the kafka - with spark you consume the data from the topic and send it to cassandra server I know very well NIFI, kafka, spark and cassandra. I have More

₹83333 INR in 30 days
(0 Reviews)
0.0
MilesChino

Hello, We developed major Enterprise Systems such as HammerForMac APPLE OSX. Please open communication by sending us a message. OUR PORTFOLIO: WEB PLATFORM FOR PDF REPORTS AND REPORTING -ENTERPRISE LEVEL h More

₹62500 INR in 20 days
(0 Reviews)
0.0
HalosysIndia

ear Client, have 7+ years of experience in IoT applications. I have implemented 6 solutions already for different industry verticals and private homes. Not just the programming, I have excellent know how of hardware More

₹62500 INR in 20 days
(0 Reviews)
0.0
₹66666 INR in 20 days
(0 Reviews)
0.0
prianshuhasija

As per your project description, I find my profile apt. I have already worked on data modelling and spark streaming jobs using kafka as intermediate connectors in micro jobs and saving data to Nosql DB at the end and w More

₹66666 INR in 60 days
(0 Reviews)
0.0
Rohita23

I have finished 2 similar projects as of your requirement, can help you go live with my expertise in Big Data, Spark, Scala and cloud. 60k per month.

₹62500 INR in 30 days
(0 Reviews)
0.0
vw6689669vw

I have more than 14 years of industry experience in various technology. Majority I have worked on backed databases/applications. This would be best fit for my work criteria. Provide More detail. / Contact details More

₹88888 INR in 20 days
(0 Reviews)
0.0
MetaoriginLab

We are a Team of Data Scientists having healthy experience into Big Data technologies like Scala/Spark/Akka, Hadoop,MapReduce and Data Analytics like R,HBase etc. The Team has qualified engineers having expertise in More

₹375003 INR in 3 days
(0 Reviews)
0.0
₹62500 INR in 20 days
(0 Reviews)
0.0
₹62500 INR in 20 days
(0 Reviews)
0.0
₹62500 INR in 20 days
(0 Reviews)
0.0