Kafka topic - Compare previous message with a new message -- 2

I would like to implement a functionality in my scala and kafka stream application.

Every message I receive in kafka has a “id” or “name” key attribute and a “status” in the avro schema. So for every message I receive I would like to check the “status” of each “id” and whenever a “Id” has it’s “status” changed from previous message to a different “status” in new message send that record to a output topic

Skills: Scala, Data Science, Cloud Data, Apache Hadoop, Spark

See more: apache kafka, kafka delete topic, kafka consumer from beginning, kafka tutorial, a _______ is a structured commit log to which records are appended continually., kafka log compaction, kafka also provides better ordering guarantees than a traditional messaging system using ________., kafka client, vbscript compare previous row, compare email marketer interspire message business, compare previous mysql, mysql compare previous record current record, design a new marketing message, new year message video, new 2 bhk flats in pimple saudagar, kafka topic, kafka topic authorization, magento 2 message queue, vba compare data in 2 spreadsheets, compare and contrast 2 movies

About the Employer:
( 1 review ) Bellevue, United States

Project ID: #23937644

7 freelancers are bidding on average $34 for this job


I am a data scientist and have experience in big data technologies like Spark Streaming and Kafka. I have hands-on experience in writing scala and java codes for kafka to consume messages and process them. I have read More

$45 USD in 1 day
(21 Reviews)

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with ha More

$61 USD in 3 days
(2 Reviews)

Hi sir, I can complete your project on time and within your budget. 2)I have worked on similar projects to what you are looking for, and I am confident I can exceed your expectations. 3)I can achieve the results that y More

$20 USD in 1 day
(0 Reviews)

Hello, how are you today? I am interested in working for this project and I believe I can do this job very well. Currently, I am not committed with any other jobs and hoping we can discuss more about the project that y More

$15 USD in 3 days
(0 Reviews)

Hi Sir /Madam I'm really interested in assisting you with this task. I am a qualified document specialist / data analyst with 10yrs experience. I would be grateful if you considered me for this project. Many thanks.

$20 USD in 2 days
(0 Reviews)

A Data Scientist with experience in SPSS, CALCULUS, Advanced Excel, R programming, R Shiny, R studio and anything related to data science and python Master in Engineering, Electrical and Electronic Engineer, who is dyn More

$25 USD in 1 day
(0 Reviews)

I am currently working as a data scientist and have good knowledge on spark with scala and java along with kafka and working with avro file format. I am looking forward to work in this senario. Thanks

$55 USD in 5 days
(0 Reviews)