Filter

My recent searches
Filter by:
Budget
to
to
to
Type
Skills
Languages
    Job State
    5,150 spark jobs found, pricing in USD

    Total Experience : 4+ years to 7 years Designation : Sr. Data Engineer Mandatory skills : Pyspark & EMR Location : Pune /Remote Job Description - 1) Hands-on experience with Python, Spark, EMR 2) Proficient understanding of distributed computing principles 3) Proficiency with Data Processing: HDFS, Hive, Spark, Scala/Python 4) Independent thinker, willing to engage, challenge and learn new technologies. 5) Understanding of the benefits of data warehousing, data architecture, data quality processes, data warehousing design, and implementation, 6) Table structure, fact and dimension tables, logical and physical database design, data modeling, reporting process metadata, and ETL processes. Requirements -- 1) Client-facing skills: Solid experience working with clients ...

    $1326 (Avg Bid)
    $1326 Avg Bid
    9 bids
    The Spark 2 4 days left

    I would like to recreate a moment; the moment a "spark" was felt at the beginning of a relationship. A couple rides a super swing, the Orlando Starflyer, and they hold hands for the very first time as the ride takes them hundreds of feet into the air. In the thrilling moment when their hands touch a spark is felt and they both know it is the beginning of something wonderful! I would also like a few notable landmarks in the drawing like the nearby castle hotel and Ferris wheel. I have included photos of these landmarks and the swing. I'm looking for a cartoon/ line drawing, a slightly whimsical line drawing with splashes of color and the couple and the "spark" to be the subject. I would like it title "The Spark" at the bottom. ...

    $304 (Avg Bid)
    $304 Avg Bid
    38 bids
    Trophy icon Brainstorm science fiction titles 3 days left

    Hey, I’m looking for some title ideas for Military Scifi and Action/Adventure Scifi stories. Title should be between 1-4 words. Preferably no fancy words that nobody understands, simple is often better. Just by reading the title it should already spark your imagination. Titles like “Space Shift” are completely useless since its too abstract. Obviously no titles which are already well known like “Star Wars”. Multiple winners for this contest possible, I will award every person which is able to develop a useful entry. Below are some awesome examples: Backyard Starship Empire of Man Sentenced to War Scrapyard Ship Starship for Sale Terms of Enlistment First Colony Good luck with your ideas!

    $103 (Avg Bid)
    Featured Guaranteed Sealed
    $103
    196 entries

    Live TV Anwar of Malaysia becomes prime minister, ending a protracted wait Reuters story, updated at 5:57 AM Eastern Time 24 November 2022, Thursday In Perak, Malaysia, on November 5, 2022, Anwar Ibrahim welcomes his fans. Malaysia's Kuala Lumpur Anwar Ibrahim of Malaysia was sworn in as prime minister on Thursday, ending a three-decade political journey that saw him go from being...ending a three-decade political journey that saw him go from being Mahathir Mohamad's apprentice to leading protests, being imprisoned for sodomy, and leading the opposition. His appointment puts an end to the historic post-election crisis that lasted five days, but his competitor, former prime minister Muhyiddin Yassin, may challenge him to demonstrate his majority in parliament, which might s...

    $306 (Avg Bid)
    $306 Avg Bid
    14 bids
    UBEK PowerSupply 2 days left

    ...Connector for cooling fan Power ON / LED for each power supply Soft start to ensure proper power up from GND. Output ripple voltage maximum 0.005V @5A. Outputs are rated with a continuous current of 10A with short bursts @15A (current cut-off 20A). Output includes independent under-voltage protection (13.5V) Overvoltage feedback loop for all outputs. Oversized FET in the input stage. -> Nearly spark-free connection. Control/power switch option. If no switch is connected unit must auto-power after 2-5 seconds If the digital part fails, then the unit must arm itself within 3 sec. This emergency power on the circuit must run parallel to the main control and be fully independent. Once armed, it can be only disarmed with a positive signal from the switch above 1500us. Please provid...

    $25 (Avg Bid)
    $25 Avg Bid
    4 bids

    Spark Use Case (Movie Review Analysis) IMBD is an online database of movie-related information. IMBD users rate the movies and provide reviews. They rate the movies on a scale of 1 to 5; 1 being the worst and 5 being the best. The dataset also has additional Information, such as the release year of the movie. You have to analyze the data collected and answer the following questions. You need to find: 1) The total number of movies 2) The maximum rating of movies 3) The number of movies that have maximum rating 4) The movies with ratings 1 and 2 5) The list of years and number of movies released each year 6) The number of movies that have a runtime of two hours Steps to follow: 1. Create a table in RDBMS (MySql, MSsql, Oracle) and load the data in table (usign bul...

    $171 (Avg Bid)
    $171 Avg Bid
    9 bids

    Hi there! I’m looking for a software engineer with python and spark proficiency. Specifically, we need that two functions of an ipython jupyter notebook file (.ipynb) will be converted, or re-written, into spark code. The former script use mainly “pandas” and “numpy” libraries for data treatment, we need the same function using spark data treatment functions. Deliverables: • Jupyter notebook file with the new two functions using spark compatible code • List of libraries or additional packages if they would be needed I will give you: • Original notebook file • Requirements file (Spark 3.3.1) Feel free to ask for more information.

    $26 (Avg Bid)
    $26 Avg Bid
    5 bids

    Hi there! I’m looking for a software engineer with python and spark proficiency. Specifically, we need that two functions of an ipython jupyter notebook file (.ipynb) will be converted, or re-written, into spark code. The former script use mainly “pandas” and “numpy” libraries for data treatment, we need the same function using spark data treatment functions. Deliverables: • Jupyter notebook file with the new two functions using spark compatible code • List of libraries or additional packages if they would be needed I will give you: • Original notebook file • Requirements file (Spark 3.3.1) Feel free to ask for more information.

    $20 (Avg Bid)
    $20 Avg Bid
    2 bids

    Hi, I need to stream Elastic search data to Spark Data frame as structured streaming in real time. Need to write this application in java.

    $420 (Avg Bid)
    $420 Avg Bid
    4 bids

    Hi there! I need a fullstack developer to create a SAAS web app with Laravel and Spark. Designs are complete in XD, and some portions of the frontend are complete in React.js - but you're free to use whatever you're most familiar with. We're looking for an experienced freelancer with excellent communication skills who will work to fully understand the project before diving in. Include the word maple in your bid, so it's clear you have read this. We're looking to have this project complete within the next 14 days - so require someone with availability to match. We'll send across designs to shortlisted candidates, and full details. All the best!

    $874 (Avg Bid)
    $874 Avg Bid
    114 bids

    It is generally said that the parquet format is better in terms of storage than JSON and CSV. The ...format than CSV or JSON". to an external site. to an external site. Now, let us try to demonstrate this. Download this CSV file (with 50,000 rows). to an external site. Load the file as dataframe in Spark and save the dataframe again in JSON and Parquet format and check their file sizes. Do you see differences in file sizes? Report here. Parquet is supposed to run faster than CSV. Show one query result to demonstrate that (such as finding the number of unique values in a certain column or so).

    $8 / hr (Avg Bid)
    $8 / hr Avg Bid
    1 bids

    Position: Data Engineer Type: Remote Screen Sharing Duration: Part-Time Monday to Friday Up to 5 hours a day Salary: 52,000 INR per month ($650 USD) Start Date: ASAP We are looking for Data engineers with experience in Azure with Python. And also have experience with Spark, Python, SQL, Pyspark, and Azure Synapse. We are looking for someone who can work in the EST time zone connecting via remote i.e zoom, google meet on a daily basis to assist in completing the tasks. Here we will be working via screen share remotely, no environment setup will be shared.

    $607 (Avg Bid)
    $607 Avg Bid
    13 bids

    I need of help for a creative spark. I am working on a country comedy album. I just placed a record on an album that was released with Epic and I need some follow up material. It is a mix of County with more of a hip-hop drum line. Needs to be funny but not corny. I am looking for funny lyrical content. I have tons of instrumentals. Here is a link to a song I just did with an artist on Epic. I am looking for more of the funny stuff like this hook. That is me singing the hook. ** I have had an overwhelming response to this ad. It would be ideal if you could send an example of your comedy work or I could send you an instrumental to write a few bars to like a chorus to see if we are a good fit for the project.

    $19 / hr (Avg Bid)
    $19 / hr Avg Bid
    7 bids

    Need bigdata and Hadoop tools some them like spark sql, Hadoop, hive and databricks , data lakes

    $29 (Avg Bid)
    $29 Avg Bid
    7 bids

    Hi, I need to stream Elastic search data to Spark Data frame as structured streaming in real time. Need to write this application in java.

    $167 (Avg Bid)
    $167 Avg Bid
    4 bids

    Hello I am building a real time streaming analytics system, that will be used to analyse and trade the stock markets. I am looking for a Kafka expert who can pipeline the data from the broker, and then set up machine learning in Spark ML for me. You will be paid hourly for your time. You will get on call with me and advise me while I work hands on. If you know deployment of the models then that is plus points.

    $26 / hr (Avg Bid)
    $26 / hr Avg Bid
    4 bids

    Need someone who has epxerince in spark with python/Scala and any cloud experience will be good

    $384 (Avg Bid)
    $384 Avg Bid
    18 bids

    Skill sets: Python programming language, Spark, Kafka / Kinesis, EMR / Glue, S3, Redshift, Airflow, Jenkins) Activities developers need to perform Load data in S3 Perform ETL functions in glue Data tiering on S3 Filter, join, aggregation Move data to Redshift EMR Apache Airflow for overall orchestrator They will use pipeline on Glue Python skill Move code from Dev to Production

    $70 (Avg Bid)
    $70 Avg Bid
    3 bids

    I Have A Character That is Rigged And Animated Using Mixamo That I Need To Get To Spark AR Scene

    $152 (Avg Bid)
    $152 Avg Bid
    13 bids

    A project that needs to be developed in python and executed on a Windows OS. PyCharm editor will be used as an IDE. Hardware Requirements: Processor: Pentium i3 or higher. RAM: 4 GB or higher. Hard Disk Drive: 20 GB (free). Peripheral Devices: Monitor, Mouse, and Keyboard. Operating system: Windows 8/10. IDE Tool: PyCharm Coding Language: Python 3.6 APIs: NumPy, Pandas, Spark, Matplotlib • Users will be able to search for applications that have been previously entered into the system. • Search results should display any exact matches first. • The system shall offer three user roles: Fraud Analyst, Fraud Investigator, and Fraud Manager. • The status of an application will be feasible for review and updated by the relevant users if necessary. • The im...

    $200 (Avg Bid)
    $200 Avg Bid
    28 bids

    I would like to recreate a moment; the moment a "spark" was felt at the beginning of a relationship. A couple rides a super swing, the Orlando Starflyer, and they hold hands for the very first time as the ride takes them hundreds of feet into the air. In the thrilling moment when their hands touch a spark is felt and they both know it is the beginning of something wonderful! I would also like a few notable landmarks in the drawing like the nearby castle hotel and Ferris wheel. I have included photos of these landmarks and the swing. I'm looking for a cartoon/ line drawing, a slightly whimsical line drawing with splashes of color and the couple and the "spark" to be the subject. I would like it title "The Spark" at the bottom....

    $335 (Avg Bid)
    $335 Avg Bid
    86 bids

    We have a Pipeline in which we are doing data enrichment. We aim to process a more than 30 TB data. Currently, we are only processing little less than 2percent (~200 GB) of that data, but we are facing memory issues. Our Use case is very specific as we aim to do data enrichment on a huge, very huge dataset. Please read carefully attached document before sending your proposal. These are mainly errors we encountered: Error 1 ``` ExecutorLostFailure (executor 6 exited caused by one of the running tasks) Reason: Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues. Check driver logs for WARN messages. `` Error2 ``` : Java heap space at () ``

    $1115 (Avg Bid)
    $1115 Avg Bid
    9 bids

    Hello, We need resources on below expertise. Please reply only if matches with JD. Primary skill : Azure, ADF, Azure DevOps, Python, Databricks, Data Lake, Kafka, Lakehouse, Snowflake, Spark 5+ years hands-on experience with architectures in a Microsoft Azure based platform Solid experience leading data teams in developing data fabric platforms. Good working knowledge of Azure Data Bricks, Data Bricks Delta Lake, Azure Data Factory (ADF), ADF metadata driven pipelines, Azure DevOps, Azure, Data Lake, Kafka, Lakehouse, Snowflake, Spark, Python and PySpark Knowledge of Azure connectivity in general, Azure Key Vault, Azure Functions, Azure integration with Active Directory. Knowledge of Azure Synapse Analytics, Synapse Studio, Azure Functions, ADLS SQL coding to write...

    $636 (Avg Bid)
    $636 Avg Bid
    4 bids

    Stack : DATA ENG 1. AWS 2. SPARK / HADOOP 3. PYTHON 4. Terraform

    $13 / hr (Avg Bid)
    $13 / hr Avg Bid
    3 bids

    Use the serverless Kafka and integrate it with Pyspark so the messages can be processed through Spark. You must be familiar with Kafka, Python, Spark and GitHub

    $36 (Avg Bid)
    $36 Avg Bid
    7 bids

    I need typsette and interior book design for my book that will be printed through Ingram Spark /Lightning Source. The draft is close to 190 pages in microsoft word. This needs to be completed in 3-5 days.

    $405 (Avg Bid)
    Featured Urgent NDA
    $405 Avg Bid
    27 bids

    identify differences in implementations using Spark versus MapReduce, and understand LSH through implementing portions of the algorithm. Your task is to find hospitals with similar characteristics in the impact of COVID-19. Being able to quickly find similar hospitals can be useful for connecting hospitals experiencing difficulties and finding the characteristics of hospitals that have dealt better with the pandemic

    $189 (Avg Bid)
    $189 Avg Bid
    17 bids

    Real-Time Visualization of Sensor Data with Spark Streaming, Kafka, and Kibana

    $169 (Avg Bid)
    $169 Avg Bid
    13 bids

    spark sql exercises...........

    $26 (Avg Bid)
    $26 Avg Bid
    10 bids

    years java development experience with JSE/JEE, Java based Micro-services framework and implementation, Spring framework, Hibernate framework, SQL etc Hands on experience on Spring boot & SPARK Microservices and OSGi specifications Strong knowledge of micro-service logging, monitoring, debugging and testing Implementations experience of micro-service integration, packaging, build automation and deployment At least two years experience in SOA & Micro services based process applications using BPM (Activiti/JBPM/Camunda) Object Oriented analysis and design using common design patterns. Insight of Java and JEE internals (Classloading, Memory Management, Transaction management etc) Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate) Experience...

    $1205 (Avg Bid)
    $1205 Avg Bid
    20 bids

    For our grandson's 12th birthday, we would like to match him up with a game developer to shadow for a day? We don't know much about this ourselves, but we know he loves to play games and watch videos on his iPad. We would love for him to see what it takes to create and design, in hopes that this might spark an interest for him! Please let us know if this is a possibility. We are in Illinois, but we will take him where ever we can for him to experience this!

    $672 (Avg Bid)
    Local
    $672 Avg Bid
    7 bids

    We are looking to have a deep learning based approach to identifying Cable Termination Joints and finding the no of terminations in the image along with total no of loose contacts and chances (Probability) of spark generation to predict failure

    $342 (Avg Bid)
    $342 Avg Bid
    21 bids

    Skills : java,Architecture Knowledge,Devops and Containers,etc. Requirements : 5 years java development experience with JSE/JEE, Java based Micro-services framework and implementation, Spring framework, Hibernate framework, SQL etc Hands on experience on Spring boot & SPARK Microservices and OSGi specifications Strong knowledge of micro-service logging, monitoring, debugging and testing Implementations experience of micro-service integration, packaging, build automation and deployment At least two years experience in SOA & Micro services based process applications using BPM (Activiti/JBPM/Camunda) Object Oriented analysis and design using common design patterns. Insight of Java and JEE internals (Classloading, Memory Management, Transaction management etc) Excellent knowl...

    $1342 (Avg Bid)
    $1342 Avg Bid
    21 bids

    Hi I need help in production support for spark and etl project. Person need to find out the issue from ticket and propose probable solution for particular tickets and close the ticket. This is a job support work. Person need to work on screen sharing

    $19 / hr (Avg Bid)
    $19 / hr Avg Bid
    12 bids

    Need someone who has experience in spark with scala/python and any cloud experience

    $340 (Avg Bid)
    $340 Avg Bid
    9 bids

    ...exponentially. CURRENT ARCHITECTURE In our current architecture, we have • A Spark cluster of 10 nodes (16 CPU, 64 GB RAM, 256GB Disk) to process raw files • A s3 storage to store processed data in parquet format • A PostgreSQL Database to store sessions, history and some meta-data. • A web app built with Play framework (Scala) from which all requests (Spark jobs included) are triggered. • (Non Optimized) Elastic search cluster of 5 nodes (16 CPU, 64 GB RAM, 700GB Disk). Indexation of ~170GB of data (~900 millions of rows) takes 5 hours. OUR APPROACH AND PROBLEMS 1. After data transfrmation, we save resuting data in S3 (in parquet format). 2. Then we read these parquet files with spark in a dataframe. 3...

    $620 (Avg Bid)
    $620 Avg Bid
    12 bids

    I have written my project. It needs to present me in my website. What I need to do is: I am, I do, I teach The goal is to spark interest with a text of 150-250 words. It’s too personal to send now. Please let me know or you can do this

    $342 (Avg Bid)
    $342 Avg Bid
    17 bids

    Need a python spark expert to help me with my code. i will share all details in the chat.

    $30 (Avg Bid)
    $30 Avg Bid
    5 bids

    Hi Avinash D., I noticed your profile and would like to offer you my project. We can discuss any details over chat.

    $49 (Avg Bid)
    $49 Avg Bid
    1 bids

    I am looking for an Expert in Python apache spark

    $319 (Avg Bid)
    $319 Avg Bid
    15 bids

    I am looking for an Expert in Python apache spark

    $331 (Avg Bid)
    $331 Avg Bid
    11 bids

    to develop a code to achieve specific requirements.

    $114 (Avg Bid)
    $114 Avg Bid
    9 bids

    ...Bricks ,Run and execute them ,Analysis of ADB Logs Analyzing test results and reporting to the development team. Good in SQL / Python and Spark coding . Experience in Monitoring performance, scalability, and reliability of any of ADF/ADB/Synapse Doing CI /CD Documenting technical issues. Help troubleshoot issues Conduct post-release/ post-implementation troubleshooting. Work with cross-functional teams to ensure quality throughout the software development lifecycle Requirements Proven experience in Azure Cloud and its components Good Exposure of ADLS and Data and Delta Lake Good Exposure on ADF /ADB /Synapse Good Exposure on Python / Spark and Sql Code . Familiarity with Agile frameworks and regression testing is a plus Ability to document and troublesho...

    $1052 (Avg Bid)
    $1052 Avg Bid
    6 bids

    I'm looking for someone to help me in optimizing azure blob storage while writing data spark consumers. We need experience candidate who can work by sharing screen in calls. Deadline next Wednesday 2nd Please only experience dev ops with azure blob storage.

    $190 (Avg Bid)
    $190 Avg Bid
    11 bids

    Hi all, I am Looking for an SPARKS TECHNOLOGIES, JAVA-SPRINGBOOT Resource for a Freelancing Projects He/she should have experience of more than 2 years.. Monday to Friday 1.5-2 hrs Weekly Payment : Please connect with me Thanks

    $12 / hr (Avg Bid)
    $12 / hr Avg Bid
    8 bids

    Need Spark and Scala to work for part time 2 hrs a day from mon-fri. We will give 25 to 30k per month

    $368 (Avg Bid)
    $368 Avg Bid
    4 bids

    Need Spark and Scala to work for part time 2 hrs a day. We will give 22 to 25k per month

    $306 (Avg Bid)
    $306 Avg Bid
    1 bids

    ...10 TB and will grow exponentially. In our architecture, we have a Spark cluster of 10 nodes (150 CPU and 500 GB RAM) to process raw files and store them in S3. We aim to build a hot layer upper our data lake, using ELK. This layer should allow us to migrate existing data from s3 to Elasticsearch and process fast queries. Query results will be used for data analysis. Our requirements are mainly: - Set up a very cost-effective and efficient ELK cluster (or Optimize our existing one) - Allow fast migration of existing data from spark. (Data is transformed in Spark data frame that will be stored in Elasticsearch as Document in one or many indexes using Spark ES connector) - Detect any bottleneck in communication between Spark and ED Cluster - Opti...

    $614 (Avg Bid)
    $614 Avg Bid
    18 bids

    Hi Ravikant P., I noticed your profile and would like to offer you my project. We can discuss any details over chat. Do you know Spark Ada.

    $50 (Avg Bid)
    $50 Avg Bid
    1 bids

    Aware2Act developed the (un)Game, an online discussion board that encourages conversations about discrimination to stimulate awareness, spark action and create change; thus, encouraging diversity and inclusion. We are using a template for our game from and want to create our own platform so that we can be self-reliant. Seeking an experienced web developer with game experience who can help us make our game our own, as well as create a visually exciting and more interesting online game board to attract participants. Find the (un)Game here: I bet you can create something so much better!

    $20 / hr (Avg Bid)
    $20 / hr Avg Bid
    20 bids

    Top spark Community Articles