Hi , I have 6 years of experience in Big data technology with python and java as well. I can work any work related to Spark DataSet, MapReduce, MongoDB, HBase, Hive. I am expert to optimize and fine tuning of spark application in production enviroment. I understand your requirement i will do you task.
My Key Skill to optimize Spark Application.
1) Buckeing
2) Partitioning
3) Use BroadCast Hash Join
4) Avoid using udf, use lamda
5) Avoid data skewness problem.
6) Experience to handle 50-60 TB of data in daily basis.
Many More.
Please contact.