-End-to-End experience on AWS GLUE jobs.
-Expertise in Scala or PySpark coding.
-Experience working with AWS S3, AWS Data Pipeline, AWS EMR clusters, AWS Athena
-SQL expertise working with Hive scripts in Athena job automation.
--> [Need for Scala or PySpark SQL query to modify existing AWS GLUE script]---> To update primary key fields in Athena.
dt=2018-08-22/ Name:Rogue, age: 21
Name:June, age: 9
dt=2018-08-24/ Name:Rougue, age: 25
Name:June, age: 15
*Need an update in Glue script to update metadata table in Athena
(There might be chances where we can get Rogue logs in a day for 4times, but the script need to pick updated time values to drop age field and update)
16 freelancers are bidding on average $782 for this job
Hi there, I have read the details I am experienced with Amazon Web Services, Hive, Python, Scala, SQL. I can help you with this job, Please come to chat so we can discuss this job.
Hello, Dear. How are you? I have experiences in Hadoop, pyspark, map reduce... for big data processing. Hope to meet you soon for more discuss. Best Regards.
Hi We are a team of Certified Professionals who are industry experts and have migrated over 100 projects to AWS and other cloud platforms. We have expertise in Big Data, DevOps etc.
Certified Hadoop Admin Certified Hadoop Developer Certified RHEL Admin Expert in Devops AWS Certified Solutions Architect End to End Solution with free troubleshooting and support post task completion