Find Jobs
Hire Freelancers

Databricks Engineer for Large Scale Data

$8-15 USD / hour

Closed
Posted 11 days ago

$8-15 USD / hour

As the professional handling this project, you'll engage with big data exceeding 10GB. Proficiency in Python, Java, and Pyspark are vital for success as we demand expertise in: - Data ingestion and extraction: The role involves managing complex datasets and running ETL operations. - Data transformation and cleaning: You'll also need to audit the data for quality and cleanse it for accuracy, ensuring integrity throughout the system. - Handling Streaming pipelines and Delta Live Tables: Mastery of these could be game-changing in our pipelines, facilitating the real-time analysis of data.
Project ID: 38026190

About the project

35 proposals
Remote project
Active 5 days ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
35 freelancers are bidding on average $19 USD/hour for this job
User Avatar
Hi Good afternoon , How are you? I just saw your job posting . I see you have been looking for someone experience with these technologies Java, Data Mining, Python, Hadoop and Big Data Sales. I believe this is some thing I can help you with because I have 9 years of experience working with these tech stacks and 8 years of experience working on freelancer.com which you can confirm from my profile: https://www.freelancer.com/u/AwaisChaudhry I have few questions: 1. These are all the requirements of your job or do you have more? If yes, Please provide detailed requirements. 2. Do you currently have anything done like Wireframes, UI/UX? Or this job has to be done from scratch? 3. What is the timeline to get this job done? Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Portfolio: https://www.freelancer.com/u/AwaisChaudhry Timings: 9am - 9pm Eastern Time (I work as a full time freelancer) Lets start the chat and discuss your job in detail and we will continue from there. Regards, Awais
$25 USD in 27 days
4.9 (67 reviews)
7.9
7.9
User Avatar
*** Python Expert for your project *** I read your project description very carefully. I have a deep understanding and experience in the areas of python that you mentioned. I've previously worked on so many projects for other employers. Here is my profile URL: https://www.freelancer.com/u/Fazeennazar Check out my past reviews and skills. So, I would like to go through more specific discussions with you to provide successful results. Thank you, Mohamed F.
$25 USD in 40 days
5.0 (239 reviews)
7.4
7.4
User Avatar
Hi there,I'm biddin on your project "Databricks Engineer for Large Scale Data" I have read your project description and i'm an expert in Python and machine learning therefore i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the project. Thanks. .. .
$50 USD in 853 days
4.9 (48 reviews)
7.3
7.3
User Avatar
Hello Mate, As an IT expert, I bring extensive experience in handling large-scale data projects. Proficient in Python, Java, and Pyspark, I'm equipped to excel in data ingestion and extraction, managing complex datasets, and executing ETL operations seamlessly. Additionally, my expertise extends to data transformation and cleaning, ensuring data integrity and accuracy through rigorous quality audits. With mastery in handling Streaming pipelines and Delta Live Tables, I can revolutionize your pipelines, enabling real-time data analysis and driving impactful insights for your organization. Please note that this is a placeholder proposal, we can be more specific once we get all the requirements and information required to execute the project.
$15 USD in 40 days
4.9 (36 reviews)
6.7
6.7
User Avatar
Dear Brighton C.,   We carefully studied the description of your project and we can confirm that we understand your needs and are also interested in your project. Our team has the necessary resources to start your project as soon as possible and complete it in a very short time.   We are 25 years in this business and our technical specialists have strong experience in Java, Python, Data Mining, Big Data Sales, Hadoop and other technologies relevant to your project.   Please, review our profile https://www.freelancer.com/u/tangramua where you can find detailed information about our company, our portfolio, and the client's recent reviews.   Please contact us via Freelancer Chat to discuss your project in details or let's appoint time for Zoom meeting to meet and discuss your project in details.    Best regards, Sales department Tangram Canada Inc.   
$25 USD in 5 days
3.9 (37 reviews)
7.1
7.1
User Avatar
I will show you my recent projects related to large Dataset for ETL operations Python, Java, and PySpark then we will move forward. So it's surety for you to get perfect solutions from my side. Also, if you want demo-type things or initial work for your project, then I will show you, and after that, we will finalize our project deal and payment milestones. I am from India, GMT +5:30, and I am available from 8:00 a.m. to 11:00 p.m. We have 16+ years of experience in software development. We have developed over 600 projects and research papers in the fields of machine learning, artificial intelligence, image processing (GIS), network, and SEO-based web and mobile apps. We have successfully completed the projects ChatGPT, Deep Learning, Computer Vision, Natural Language Processing (NLP), Encryption Decryption, Face Detection, UML Diagram, OCR, Big Data, Data Mining, Data Analysis, Statistics, Trading, Text, Image, Multiclass Classification Using Azure ML, Tensorflow, R Programming, OpenCV, Matlab, Hadoop, Artificial Intelligence Program Using PROLOG, Robotics Software, TCP-UDP Networking Project, Cloud Computing, etc. Note: The project has QA, testing, and comments in the code, so it's easy to understand the flow of the project.
$25 USD in 40 days
4.9 (28 reviews)
5.6
5.6
User Avatar
Hi, I hope you’re doing well! I’m interested in the job you posted. Based on my experience as a senior software engineer, I believe I could be a good fit. Are you open to a quick chat to discuss the details? I’d love to discuss more about it, and share about my own qualifications. I look forward to hearing from you. Thanks & Regards!
$15 USD in 40 days
5.0 (9 reviews)
5.3
5.3
User Avatar
Hi, I am thrilled to present my application for the Databricks Engineer position specializing in large-scale data management using Python. With a robust background in data engineering, extensive experience with Databricks, and proficiency in Python programming, I am eager to contribute to your team's success in leveraging data for strategic insights and decision-making. Introduction: In the era of big data, organizations face the challenge of harnessing vast amounts of information effectively. Databricks has emerged as a powerful platform for managing and analyzing large-scale datasets, and Python serves as a versatile tool for data manipulation and processing. As a Databricks Engineer proficient in Python, I am committed to maximizing the potential of these technologies to drive innovation and efficiency in data-centric projects. Expertise: Proven track record in designing, implementing, and optimizing data pipelines using Databricks, ensuring scalability, reliability, and performance. Proficiency in Python programming language, with expertise in data manipulation libraries such as Pandas, NumPy, and PySpark for distributed computing. Strong understanding of cloud platforms such as AWS, Azure, and Google Cloud, with hands-on experience in deploying Databricks clusters and managing resources. Familiarity with best practices in data engineering, including data modeling, ETL processes, data warehousing, and data quality assurance. Sincerely,
$15 USD in 40 days
4.8 (3 reviews)
5.2
5.2
User Avatar
Dear Brighton C., I have extensive experience in Java, Python, and Data Mining, as reflected in my portfolio and customer reviews. I am confident in my ability to deliver high-quality results for your project. I am also willing to work in the South Africa time zone and provide real-time updates on the progress. I look forward to discussing your project further and exploring how I can contribute to its success. Best regards,
$8 USD in 7 days
5.0 (1 review)
4.6
4.6
User Avatar
⭐ Hi, My availability is immediate. I read your project post on Python Developer for large scale data project. We are experienced full-stack Python developers with skill sets in - Python, Django, Flask, FastAPI, Jupyter Notebook, Selenium, Data Visualization, ETL - React, JavaScript, jQuery, TypeScript, NextJS, React Native - NodeJS, ExpressJS - Web App Development, Data Science, Web/API Scrapping - API Development, Authentication, Authorization - SQLAlchemy, PostegresDB, MySQL, SQLite, SQLServer, Datasets - Web hosting, Docker, Azure, AWS, GPC, Digital Ocean, GoDaddy, Web Hosting - Python Libraries: NumPy, pandas, scikit-learn, tensorflow, etc. - ML Toos: ChatGPT, Llama, Google Bard, OpenAI, Artificial Intelligence, - AWS SageMaker, AWS Bedrock, AWS Machine Learning Services, AWS AI Services - Azure Cognitive Services, Azure Bot Service, Azure QnA Maker, Azure Vision, Azure Document Intelligence, Azure OpenAI - Tableau, PowerBI - AI: Generative AI, Langchain, LLM, RAG - Artificial Intelligence, Machine Learning, Deep Learning, Chatbot Please send a message So we can quickly discuss your project and proceed further. I am looking forward to hearing from you. Thanks
$12 USD in 40 days
4.3 (14 reviews)
4.1
4.1
User Avatar
Hi there,Good evening I am Talha. I have read you project details i saw you need help with Python, Hadoop, Java, Big Data Sales and Data Mining I am pleased to present my proposal, highlighting our extensive experience and proven track record in delivering exceptional results. Our portfolio of success will showcase past projects that demonstrate our ability to meet and exceed client expectations. Glowing testimonials from satisfied clients will attest to our professionalism, dedication, and the quality of our work Please note that the initial bid is an estimate, and the final quote will be provided after a thorough discussion of the project requirements or upon reviewing any detailed documentation you can share. Thanks for considering my proposal. I'm eager to collaborate and contribute to your project's success. Let me know if you need any more information. I will wait for your text to discuss the project in further detail. Regards. Talha Ramzan
$10 USD in 32 days
5.0 (2 reviews)
3.1
3.1
User Avatar
Hello Brighton C., I am Sadat Saeed, with 8 years of experience in Java and Python. I have carefully reviewed the requirements for the Databricks Engineer project. I propose to handle the data exceeding 10GB by utilizing my expertise in Python, Java, and Pyspark. I will manage data ingestion, extraction, transformation, and cleaning, ensuring data integrity and real-time analysis using Streaming pipelines and Delta Live Tables. Please review my portfolio at https://www.freelancer.ca/u/DGM999 and let's discuss further. Best regards, Sadat Saeed
$15 USD in 7 days
5.0 (2 reviews)
2.9
2.9
User Avatar
With a rich experience encompassing data engineering, Python programming and hands-on work with Databricks, I am the perfect match for your large-scale project. Having worked on similar projects dealing with massive data volume, I grasp the intricacies of handling and extracting insights from such datasets. My knowledge of Python, Java, and Pyspark dovetails perfectly with your project demands. Beyond proficiently managing complex datasets and skillfully running ETL operations, I am well-versed in the crucial tasks of data transformation, quality auditing and cleansing. This ensures that not only will your data be safely managed but you'll also benefit from high-quality, accurate and reliable insights throughout our entire system. Furthermore, my mastery of handling streaming pipelines and Delta Live Tables could be a game-changer for you. Real-time analysis of data is no longer just a competitive edge; it has become indispensable for successful business strategies. Rest assured that in bringing me on board, you'll have a seasoned professional who consistently prioritizes customer satisfaction paired with a steadfast commitment to top-notch product quality. Let's revolutionize your big-data so that it starts working more intelligently for you than ever before!
$12 USD in 40 days
5.0 (1 review)
0.6
0.6
User Avatar
I am a skilled Databricks Engineer with expertise in Java, Python, and Big Data technologies. With experience in data ingestion, extraction, transformation, and cleaning, I am well-equipped to handle large-scale datasets exceeding 10GB. I have a strong understanding of ETL operations and can ensure data quality and integrity throughout the system. My proficiency in handling streaming pipelines and Delta Live Tables makes me a valuable asset for facilitating real-time data analysis. I am excited about the opportunity to work on this project and contribute my knowledge and skills to achieve success in managing complex datasets effectively.
$15 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello Brighton C.! I have keenly read your project requirements, and this is something I can comfortably do. I have years of experience in Big Data Sales, Hadoop, Java, Data Mining and Python I am available to start immediately. In case you need additional details on how I can complete this task, please feel free to reach out. Warm Regards
$8 USD in 19 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello Brighton C. how are you? Thank you for your job posting. I read your project, "Databricks Engineer for Large Scale Data" description carefully and got interested. As a senior full-stack engineer, I am sure that I can provide you the best result. I have hands-on experience in Data Mining, Python, Java, Hadoop and Big Data Sales. I'd like to share my experience with a similar project and discuss more about this project in detail. I don't like to ramble like other developers in proposal. Looking forward to working with you. Best Regards, Darko Djokic
$25 USD in 37 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello Sir/Ma'am, We've come across your project brief and are eager to collaborate with you to achieve your project objectives. GlobalGeek Infotech is a dynamic and agile tech firm based in India. Our team is highly skilled and dedicated to delivering top-notch services. We are confident that our comprehensive range of services will effectively address your business needs and exceed your expectations. With over 10 years of successful experience, our pro-experts specialize in design, development, and various IT solutions. We ensure 100% client satisfaction through multiple iterations and unlimited revisions. Our team comprises industry experts proficient in: • Over 20 popular programming technologies and 30 frameworks • Website/CMS/Mobile app development • Graphic design, brand identity, and custom user interface design Are there any details you would like to discuss with us? Please feel free to connect with us via chat to discuss your goals for this project in detail so we can immediately start working on your project! We look forward to potentially contributing to your project and enhancing your business assets. Best Regards, Team at GlobalGeek Infotech
$92 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, Dear. On the front-end, I am proficient in HTML, CSS, and JavaScript, with expertise in modern frameworks such as React and Angular. On the back-end, I have experience with server-side languages like Node.js, as well as databases such as MongoDB and MySQL. And I have rich of experience in CMS such as WordPress, Shopify, Magento, and Joomla. I am also adept at troubleshooting and debugging complex issues, with a keen eye for detail and a commitment to delivering high-quality code. I'd like to discuss more details via chat. Best Regards.
$10 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, how are you? I just saw your job posting and noticed that you are looking for someone with expertise in Python, Hadoop, Big Data and ETL. I have a vast amount of experience in these technologies. I can certainly assist you with this project and deliver it as soon as possible. Please leave a message through chat so that we can discuss the details of the project. Thank you.
$20 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, there, With my talent in python, java, and pyspark will be contributed to your project. I have some experience in python, data mining, and java. The requirements what you want is fine to develop python or java. But I prefer python. Data ingestion and extraction, transformation, cleaning is used to develop with python. Anyway, let's discuss more details via chat Thank you Nikolozi
$12 USD in 40 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of SOUTH AFRICA
johannesburg, South Africa
5.0
12
Payment method verified
Member since Sep 10, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.