Completed

Data lake implementation in AWS for Amadou

We need an expert big data freelancer that could implement a data lake in AWS. The data lake components must include loading, transformation and cleaning capabilities.

The following task have to be completed:

-Configure a SQL data origin as an input of the data lake

-Configure an API data origin as an input of the data lake

-Configure flat file data origin as an input of the data lake

-Define a loading daily job from the previous origins defined

-Develop and define a data transformation job

-Develop and define a data cleaning job

-Develop and define a data destination as an output for the jobs

We also need that the freelancer gives us advice about which services are relevant for this kind of implementation (AWS EMR, AWS Glue, other services).

For this kind of advisoring we need to have:

-Architecture of the AWS components and why every service was selected

-Estimated monthly budget for this implementation for a quantity of data

-An explanation of the behaviour of the componentes and the scripts

Hands-on experience implementing data lakes in production environments is a must. Feel free to ask for more details.

Skills: Amazon Web Services, Spark, PySpark, Hadoop

See more: web data entry implementation java, data mining implementation, data structure implementation graph save file, aws data lake quickstart, aws data lake whitepaper, aws data lake architecture, aws data lake solution architecture, aws data lake tutorial, aws data lake solution github, aws data lake, analyzing big data with hadoop aws and emr, aws data lake formation, aws data lake reinvent, data lake implementation roadmap, s3://aws-bigdata-blog/artifacts/glue-data-lake/data/, aws data lake blog, data lake aws, big data vs data warehouse vs data lake, data lake implementation, hadoop data lake implementation

About the Employer:
( 4 reviews ) lima, Peru

Project ID: #31389070

Awarded to:

ahmadndiayee

Hi, I am an experienced Data Engineer with a solid Background in building Datalake. Let's have a call for more details about the project. Regards

$1500 USD in 20 days
(2 Reviews)
3.0

8 freelancers are bidding on average $1283 for this job

chrisjordanmax

Hey Mate, I'm certified solution architect with over 10+ years experience across cloud platform(AWS, Azure, GCP etc)  with containerized technology(Kubernete, EKS, AKS, Docker etc.) programming expertise in python, Ru More

$1500 USD in 15 days
(14 Reviews)
4.1
MohammedSulhi

I read your project description carefully. I am bidding on your project because I am very much familiar with Big Data and Data Engineering and Automation. I am an experienced Data Scientist and Machine Learning Engine More

$1000 USD in 10 days
(2 Reviews)
2.7
hmrizak

Hello, With solid experience in data analysis and Microsft certifications in Data managment and analysis, Sql Server and business intelligence, python programming, Azure and AWS Services i could be valuable for your More

$1111 USD in 5 days
(1 Review)
2.0
developer2581

Hi, I read the details about your project "Data lake implementation in AWS for Amadou".I can Design and Develop your Mobile & Web app within the given time and develop it using the Technologies Mentioned. I have 10 y More

$1125 USD in 7 days
(0 Reviews)
0.0
devendrathakur12

Hi, your job posting (Data lake implementation in AWS for Amadou) has caught my attention, and I wish to have a conversation about the project. I read and understand your job post. With reference to that, I'm Data Lake More

$1400 USD in 7 days
(0 Reviews)
0.0
ranjanab92

I would like to discuss all your points in detail at chat-box. I'm just posting this basic template for taking stand in your first page list. Hey, Greetings Hope you it's a good day I am new on Freelancer. So, Now I More

$1125 USD in 7 days
(0 Reviews)
0.0
vbtise

Certified AWS Expert Here I have checked your description and understand your requirements. We have Hands-on experience implementing data lakes in production environments. All these task are doable without any issue. More

$1500 USD in 7 days
(0 Reviews)
0.0