Closed

Pyspark & EMR developer needed

Job Description:

Total Experience : 4+ years to 7 years

Designation : Sr. Data Engineer

Mandatory skills : Pyspark & EMR

Location : Pune /Remote

Job Description -

1) Hands-on experience with Python, Spark, EMR

2) Proficient understanding of distributed computing principles

3) Proficiency with Data Processing: HDFS, Hive, Spark, Scala/Python

4) Independent thinker, willing to engage, challenge and learn new technologies.

5) Understanding of the benefits of data warehousing, data architecture, data quality processes, data warehousing design, and implementation,

6) Table structure, fact and dimension tables, logical and physical database design, data modeling, reporting process metadata, and ETL processes.

Requirements --

1) Client-facing skills: Solid experience working with clients directly, to be able to build trusted relationships with stakeholders.

2) In-depth understanding of Data Warehouse, ETL concept and modeling structure principles

3) Expertise in AWS cloud native services

4) Hand-on experience in developing data processing task using Spark on cloud native services like Glue/EMR.

5) Good to have experience Snowflake SQL queries against Snowflake Developing scripts using java scripts to do Extract, Load, and Transform data

6) Good to have experience with Snowflake utilities such as SnowSQL, SnowPipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.

7) Excellent verbal and written communications skills

8) Ability to collaborate effectively across global teams

Please apply if you're an independent freelancer only & available for a full-time contractual job.

*Agencies please do not apply*

Skills: Hadoop, Python, PySpark, Hive, Spark

About the Client:
( 0 reviews ) Delhi, India

Project ID: #35338957

11 freelancers are bidding on average ₹109091 for this job

bizzarriandrea81

PYSPARK EXPERT HERE!!! "Satisfy the client with my ability and passion" This is my slogan here. I hope you will be interested in me. Thanks.

₹112500 INR in 3 days
(13 Reviews)
4.5
AmolZinjadeP

Hi, I have more that 7+years of experience in Hadoop technologies like HDFS, MapReduce, python, pyspark, Kafka, Java, Scala, Hive etc. Please review my profile for skills. contact me. Streaming: Azure event hubs, Kafk More

₹150000 INR in 7 days
(13 Reviews)
4.6
h87md3h

Hello there I'm a software engineer and I have 6 years of experience in data engineering pipelines using Spark pyspark scala. I've worked on gcp AWS platforms. Let's discuss more in details thanks

₹112500 INR in 7 days
(5 Reviews)
3.7
dataspro

Hello: After reading in detail the requirements of your project and concluding that they match my areas of knowledge and skills, I would like to introduce myself. My name is Anthony Muñoz and I am the lead engineer More

₹112500 INR in 7 days
(1 Review)
3.8
Work12345x

I can do this for you. Please view my past submitted work in my portfolio's Portfolio Items section.

₹112500.01 INR in 14 days
(5 Reviews)
2.5
srsumitroy

Hi, I cam across your job posting. It is interesting. I have over 12 years of experience in Big Data and 8 years in Cloud. I have worked in Oracle Cloud, AWS and Rackspace. Already have implemented multiple projects i More

₹112500 INR in 30 days
(0 Reviews)
0.0
KavitaThoratK

•I have 4+ years experience as an Data Engineer. •I have hands on experience on python, pyspark, pysparkSQL, SQL, AWS services, data visualization, data modelling, ETL Tool talend, execl etc. • I Have hands on experien More

₹112500 INR in 7 days
(0 Reviews)
0.0
angelineaishu

I'm fresher looking for opportunities. I have good knowledge in hive, hdfs and spark. Please help me to accept my bid

₹75000 INR in 7 days
(0 Reviews)
0.0
unixsam

I have an experienced python team, I trust that my team can deliver all of your requirements on te with the desired quality. Hire use and you will not regret it.

₹75000 INR in 15 days
(0 Reviews)
0.0