I am looking for professional who are very familiar with Python and Big data processing

Cancelled Posted 6 years ago Paid on delivery

$250-750 USD

Paid on delivery

Cancelled Paid on delivery

Looking for an Expert in:

· Build Custom Data Pipelines in Python that Clean, Transform and Aggregate data from many different sources

· Big Data Technologies such as: MapReduce, Hadoop, Spark, HBase, Hive, Elastic Search

· Data Structures and Data Processing Algorithms and Frameworks

· Data Migration, high throughput Data Pipelines

· Massively Parallel Processing using Python Tools

· Ability to analyze Performance Issues in Big Data Environment

· Data Modelling, Data Transfer and Storage, Partitioning, Indexing and caching Techniques

Well experienced with:

· Large Scale Data Modelling from Big Data perspective

· Big Data Structures in Python

· PyData, Anaconda, numPy, PyTables, DataFrames, Jupyter Notebook

· PyHive, PySpark

· JSON/Parquet Data formats

· Real time streaming with either Spark Streaming of Kafka

Good to have:

· Familiarity with PyPi

· Workflow Management Tools such as Luigi, Apache Airflow, Snowflow or similar

Big Data Sales Java Python Software Development

Project ID: #14511861

About the project

7 proposals Remote project Active 6 years ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

7 freelancers are bidding on average $546 for this job

webbookstudio's Profile Picture
webbookstudio

Hello, my name is Michael. I represent Ukrainian based IT-company Webbook Inc that provides services in the IT-sphere for international business. We were carefully reviewing the requirements of the job description, so More

$500 USD in 10 days
(1 Review)
4.5
nakous's Profile Picture
nakous

Hi, I'm interested in your project. Please send me a message so that we can discuss more. waiting for your response . Relevant Skills and Experience Big Data, Java, Python, Software Development Proposed Milestones $5 More

$555 USD in 10 days
(1 Review)
0.4
hafizkamal007's Profile Picture
hafizkamal007

Hi, Immediately available! I have 4 years of experience in website design and development . Relevant Skills and Experience I have experience in Web Design, PHP, CSS, Bootstrap, HTML, Word Press, Codeigniter Shopify More

$450 USD in 10 days
(0 Reviews)
0.0
Zoftcast's Profile Picture
Zoftcast

Hello, My name is Josh, I am a specialist CMS developer. My expertise includes website development using Drupal, Wordpress and Django. My skills include: -- Drupal Website development -- Wordpress site More

$707 USD in 10 days
(2 Reviews)
0.0
Post a project like this