Closed

Hadoop on AWS

AWS requirement:-

-End-to-End experience on AWS GLUE jobs.

-Expertise in Scala or PySpark coding.

-Experience working with AWS S3, AWS Data Pipeline, AWS EMR clusters, AWS Athena

-SQL expertise working with Hive scripts in Athena job automation.

Key Responsibility:

--> [Need for Scala or PySpark SQL query to modify existing AWS GLUE script]---> To update primary key fields in Athena.

Ex: data:-

dt=2018-08-22/ Name:Rogue, age: 21

Name:June, age: 9

Name:Rogue,age: 22

dt=2018-08-24/ Name:Rougue, age: 25

Name:June, age: 15

*Need an update in Glue script to update metadata table in Athena

(There might be chances where we can get Rogue logs in a day for 4times, but the script need to pick updated time values to drop age field and update)

Skills: Amazon Web Services, Hive, Python, Scala, SQL

See more: search data fields mysql database, data entry ten key sight touch, key touch numeric data entry, python, hadoop, key word writing data entry, photoshop cs3 custom metadata xmp fields, exciting hadoop aws big data weather analysis project, python hadoop aws, net hadoop aws, copy & compare data from several websites (10/6/15), data entry work 24 hrs, hadoop aws, data entry administrator shailer park $25.22 p hr in brisbane qld, ssc data entry operator online form 2014 15, we have business in data entry projects 24 7 weekly payout business opportunities franchise pune, data entry islamabad 24 2 16, data entry services 24 7, EX DATA ENTRYCEL, We need all data routed through an Encrypted Proxy for the Brave for iOS web browser. You\ ll need to get a build working -- we

About the Employer:
( 0 reviews ) United States

Project ID: #17638353

16 freelancers are bidding on average $782 for this job

AleenaIlyas

Hi there, I have read the details I am experienced with Amazon Web Services, Hive, Python, Scala, SQL. I can help you with this job, Please come to chat so we can discuss this job.

$800 USD in 10 days
(16 Reviews)
6.4
Gaosong2017

Hello, Dear. How are you? I have experiences in Hadoop, pyspark, map reduce... for big data processing. Hope to meet you soon for more discuss. Best Regards.

$764 USD in 10 days
(33 Reviews)
5.9
tudiptechnology

Hi, Greetings! To quickly apprise you about our model, our engineers would be working full time on your project only and would be completely integrated into your team. By complete integration, I mean, they would More

$800 USD in 15 days
(8 Reviews)
6.2
schoudhary1553

Hello Sir, I am the expert freelancer here. I am on the 6th position through out the world to deliver the quality job. I have deliver here more than 390 + projects with 100% client satisfaction. I can help you More

$800 USD in 10 days
(24 Reviews)
5.5
$1111 USD in 10 days
(10 Reviews)
5.6
deytps86

Hello I am working in Bigdata/Hadoop technologies for years. And I work Spark, Kafka, Cassandra, ELK stack etc using Java, Scala and Python. In fact my currently In Progress 2 Spark/Kafka projects are in Scala More

$800 USD in 7 days
(13 Reviews)
4.5
dirisalagopal

big data expert.

$666 USD in 1 day
(19 Reviews)
4.4
khannanav

---------------------------------------Dedicated AWS expert available for your project-------------------------- Hello there, We are a team of expert AWS architects and developers with rich industry experience an More

$1500 USD in 10 days
(8 Reviews)
3.8
r0nysl

Hello i got experience in AWS GLUE / PySpark / Hive scripts Lets have a discussion on this project if available

$722 USD in 10 days
(5 Reviews)
3.6
nmogilip

Hi, I have very good experience in developing the application using Hadoop ecosystem. I delivered many projects as like this. Moreover I am certified hadoop developer. . Lets connect and discuss more on this to ge More

$722 USD in 10 days
(1 Review)
2.2
$500 USD in 7 days
(1 Review)
1.9
hybridskill

Hi We are a team of Certified Professionals who are industry experts and have migrated over 100 projects to AWS and other cloud platforms. We have expertise in Big Data, DevOps etc.

$777 USD in 15 days
(1 Review)
0.5
$700 USD in 8 days
(0 Reviews)
0.0
anandkiller143

Certified Hadoop Admin Certified Hadoop Developer Certified RHEL Admin Expert in Devops AWS Certified Solutions Architect End to End Solution with free troubleshooting and support post task completion

$500 USD in 5 days
(0 Reviews)
0.0
$797 USD in 15 days
(0 Reviews)
0.0
$555 USD in 14 days
(0 Reviews)
0.0