Find Jobs
Hire Freelancers

Kafka expert to import csv and to call rest api

$10-150 USD

In Progress
Posted 3 months ago

$10-150 USD

Paid on delivery
We require a highly skilled Kafka expert, who can access e-mails. this emails contain a csv, this csv itself contain data, which need to be converted into reasonable values. Afterwards this data is getting posted via an REST API to a different system. Both the csv and the converted data shall be accessible for debug purposes after being processed. A re-execution by an admin is also mandatory, if something went wrong during parsing or processing. This is a test simple test task to find the right candidate. We will assign you later more work, if this implementation works well. Key functionalities required: - read e-mails via connector (event source) - fetch the csv from the e-mail - import the data into kafka - convert/parse the data properly inside kafka - ensure both csv, and parsed data are available for later debugging/re-execution - post the parsed data to a REST api connector (event destination) - provide a docker-compose to startup the kafka - if coding => java/JDK17 - if framework => springboot (latest stable) Strong expertise on Kafka and how to read data from one system, parse this data reliably with options to debug later and finally post data to the destination system What is not required: - HA solutions of kafka - high load => the availability is a single node since (for this task) and the HA is therefore also not relevant MS0: - suggest connectors (IMAPTLS, REST-api via https) - suggest the parsing/processing - provide docker-compose for starting up kafka MS1: - implement the fetching via e-mail - implement the csv parsing (if custom coding, preferably opencsv based) - implement the persistency of both states (unparsed csv, and parsed data from csv) MS2: - implement the REST api caller Budget? will not be disclosed, place your best bid to get considered What is next? We will share you a NDA and afterwards a paid test task. Payment? - you estimate in a WBS (optimistic, expected, pessimistic, where optimistic < expected < pessimistic) after getting the task - we discuss about clearances and effort - we mutually agree to effort - we assign you the task after mutually agreed - you implement, test and deliver - you provide also unit /integration tests to ensure code is always working - you document each required step to make interaction of systems to work - we test on our premise (you maybe help to fix issues) - we pay (basically the rules of freelancer) Closed book vs open book? We work only on open book. Closed book means you are unwilling to define a WBS for the work and you add only a price tag to the task. We are sorry we will not hire you in such a case! Deliveries? - in our on premise git (access will be granted to you) - full sources - multiple samples of body and responses of the api in test/resources which will be used as unit tests - maven - libs, need prior confirm and we prefer to use mostly latest stable versions - JDK 17 (mostly LTS) - your code is working on our end too - your code passes our CI build (with provided maven [login to view URL] can be checked) - you may require to help us here on setup - docker compose to startup all required runtimes - we require, depending on availability and on complexity 2-4 weeks test time per milestone. Usually clearly less
Project ID: 37786580

About the project

13 proposals
Remote project
Active 3 mos ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi there, I would love to work on this as it looks a very interesting project to me. Best regards Rab
$10 USD in 7 days
4.9 (7 reviews)
4.3
4.3
13 freelancers are bidding on average $86 USD for this job
User Avatar
Hello, As experienced and expert professionals in Kafka and Java development, we have successfully executed similar tasks in the past, ensuring reliable data parsing and seamless integration with destination systems. We pride ourselves on our ability to deliver high-quality solutions that meet and exceed client expectations. To better understand the specifics of your project, we would like to inquire about the preferred email connector and parsing/processing methods you envision. Additionally, we seek clarity on any specific requirements or constraints to ensure a tailored solution that aligns perfectly with your needs. We invite you to join us in a chat to discuss your project in more detail. This will allow us to gain a deeper understanding of your expectations and provide you with a comprehensive proposal tailored to your requirements. Best regards, ITSolution24x7
$80 USD in 7 days
5.0 (1 review)
4.7
4.7
User Avatar
Dear Client, I am writing to express my interest in the Kafka expert position for your project. With my expertise in Kafka and extensive experience in data processing, I am confident in my ability to meet and exceed your expectations for this project. As a skilled Kafka expert, I understand the importance of accessing emails containing CSV files and converting the data within them into meaningful values. I have successfully worked on similar projects where data extraction and transformation were critical components. I am well-versed in utilizing Kafka to handle data streams efficiently and securely. Furthermore, I recognize the significance of providing administrative capabilities for re-execution in case of parsing or processing errors. I will implement robust error handling mechanisms and admin functionalities to ensure prompt re-execution whenever necessary, thereby minimizing downtime and maximizing system reliability. In summary, my expertise in Kafka, combined with my experience in data processing and system integration, makes me the ideal candidate for your project requirements. I am committed to delivering high-quality results within the specified timeframe and exceeding your expectations. Regards, Lalit
$140 USD in 7 days
5.0 (15 reviews)
4.3
4.3
User Avatar
Hello, How are you doing? I am Anel. I read your Kafka expert to import csv and to call rest api. I have 5 years of experience working on similar projects. I am very familiar with Apache Kafka, Java and Spring Boot I am pretty sure I can complete your project without a problem. I can start work immediately. Looking forward to working with you on this project. Sincerely, Anel
$90 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, there! Having confirmed the job posting Kafka expert to import csv and to call rest api, I truly feel that you're looking for Spring Boot, Apache Kafka and Java. I have worked with similar projects so that I can provide you with a satisfied result. I am fully available to get started on your project immediately and you will find it interesting to discuss the project details. Regards
$90 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
As an experienced developer with a deep understanding of Java and Spring Boot, I bring over 8 years of expertise to your project, making me the ideal candidate for this Kafka-centric task. With my prior use of Kafka in messaging tools and distributed architecture, I am well-versed in not just reading data from one system but parsing and posting it reliably to destination systems like REST API connectors - all crucial aspects of this task. Additionally, I have considerable experience working with email integration using IMAPTLS as well as REST-api via HTTPS - two connectors that can be utilized in this best-fit solution for you. To complete these functions successfully, I will provide a docker-compose for starting up Kafka so that both CSVs and parsed data are persistently available for debugging, re-execution by administrators or any other needs that may arise. My open book approach is aligned with yours, guaranteeing transparency and efficient task management. From estimating the effort needed for each milestone to delivering effective unit/integration tests and thorough documentation of every interaction between the systems, you can rest assured of top-notch delivery. Upgrade your project with my proficiency today!
$80 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am working as a Professional software developer at a Startup and have 2+ years of experience in Java + Spring Boot including but not limited to Kafka, email readers, etc. I believe my work here at the startup will be of great value here in this project.
$10 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello I’ve carefully checked your requirements and really interested in Kafka expert to import csv and to call rest api. I am confident for your project because I have skills of Apache Kafka, Java and Spring Boot. I’m ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details. Sincerely, Yehor.
$90 USD in 4 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Work everyday with parsing and server being rebuild using ansible and reinstalling all the configs, I'm new on the freelancer platform, but i've experience on getting data from different places and types of extension, getting them on kafka and send it whatever It's needed. Let's chat and i can show you more on how we can work together and make this happen. Replies at moment
$50 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am eager to begin my freelancing career, it would be my first task, hope we can cowork well, and the project is quite easy
$80 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Yes I have read your project and understood requirements but have some doubts. please message me so we can discuss in detail. i am ready to start work.
$80 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of GERMANY
Herrenberg, Germany
5.0
56
Payment method verified
Member since Mar 13, 2016

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.