Cancelled

I need help with Spark

There are two csv files available “[login to view URL]” & “[login to view URL]”.

I need to create a notebook and produce this output from a couple csv files. I am looking for the code that would help me accomplish #3 and #4.

Create a RDD for each file:

Create RDD to access department

department = [login to view URL]("/FileStore/tables/[login to view URL]")

[login to view URL](5)

#Create RDD to access employee

employee = [login to view URL]("/FileStore/tables/[login to view URL]")

[login to view URL](15)

Filter out header rows:

filter out header department csv

header = [login to view URL]()

department1 = [login to view URL](lambda row : row != header)

[login to view URL](1)

filter out header employee csv

header = [login to view URL]()

employee1 = [login to view URL](lambda row : row != header)

[login to view URL](1)

3 Provide a output that has employee count by department ID

4 Provide a output that has top two department name with most employee ID.

Lastly, here are the header names for "Emp" table:

'empno,ename,job,mgr,hiredate,sal,comm,deptno

And for the "Dept" table:

'deptno,dname,location',

I am definitely not a programmer and have tried multiple codes without luck. I would also like to have an attached explanation of what has been done and why it is needed so I can help wrap my mind around it.

Skills: Python, Spark

See more: spark email review, spark 2 readdle, spark email not syncing, why is spark free, spark email tracking, spark email windows, spark pricing, spark email calendar, i need help advertising my website, i need help designing a form, i need help designing a shirt, i need help designing clothes, i need help designing my van wrap, i need help find worker, i need help finding a manufacturer, i need help finding a shoes designer, i need help from an engineer, i need help from scientist, i need help getting my book edited not much money, i need help in designing a powerpoint presentation for a conference

About the Employer:
( 0 reviews ) Saint Paul, United States

Project ID: #18980924

3 freelancers are bidding on average $30 for this job

shraboniadhikary

Hello there, I have reviewed your project requirements and understood your requirements as mentioned above. We are working here as team and have more then 5+ years of experience in this field. We have skills men More

$30 USD in 1 day
(1 Review)
1.3
albertpopov46

Hi,Dear. I have many development experiences,getting work about . As I am interested in your project,I want to do work it. I've read the project description and definitely can develop your task. If you hire me, I More

$35 USD in 1 day
(2 Reviews)
0.3
BoyVit85

How are you. Credit is my motto. I am expert web scraping. I can do your job with BS4 and Seleinum framework of python. I can do any project in your demand completely by my good experiences of last ago. I think thi More

$25 USD in 1 day
(0 Reviews)
0.0