Map Reduce jobs

Map Reduce is a programming model created to process big data sets. It's oftentimes utilized in the act of distributed computing for different devices. Map Reduce jobs involve the splitting of the input data-set into different chunks. These independent sectors are then processed in a parallel manner by map tasks. The framework will then sort the map outputs, and the results will be included in "reduce tasks." Usually, the input and output of Map Reduce Jobs are kept in a file-system. The framework is then left in charge of scheduling, monitoring, and re-executing tasks.

Map Reduce can be used in jobs such as pattern-based searching, web access log stats, document clustering, web link-graph reversal, inverted index construction, term-vector per host, statistical machine translation and machine learning. Text indexing, search, and tokenization can also be accomplished with the Map Reduce program.

Map Reduce can also be used in different environments such as desktop grids, dynamic cloud environments, volunteer computing environments and mobile environments. Those who want to apply for Map Reduce jobs can educate themselves with the many tutorials available in the internet. Focus should be put on studying the input reader, map function, partition function, comparison function, reduce function and output writer components of the program. Hire Map Reduce Developers

Filter

My recent searches
Filter by:
Budget
to
to
to
Skills
Languages
    Job State
    28 jobs found, pricing in USD
    spark developer 6 days left

    Hadoop/spark developer only female

    $555 (Avg Bid)
    $555 Avg Bid
    4 bids
    Hadoop Admin 6 days left

    Cloudera and Hortonworks

    $558 (Avg Bid)
    $558 Avg Bid
    6 bids

    a. Guide the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, application design and development, testing, and deployment. b. Provide technical and managerial leadership in a team that designs and develops path breaking large-scale cluster data processing systems. [url removed, login to view] in Big Data architecture, Hadoop stack including HDFS cluster, MapReduce, Pig,Hive, Spark and Yarn resource Management [url removed, login to view] on Programming experience in any of the programming language like(Python/Scala/R/Java) [url removed, login to view] and support proof of concepts as Big Data technology evolves Spark and Scala experience is a must. [url removed, login to view] to work with leadership team and define the learning and unlearning metrics

    $19923 (Avg Bid)
    $19923 Avg Bid
    2 bids
    EXPERT IN TECHNICAL WORKS 4 days left
    VERIFIED

    JAVA, HADOOP, AWS, SCALA, PYTHON, ETC

    $28 (Avg Bid)
    $28 Avg Bid
    15 bids

    Implement the K-means on MapReduce programming Skills required: Hadoop MapReduce HDFS

    $32 (Avg Bid)
    $32 Avg Bid
    7 bids

    Video Course on Big Data Hadoop. It would be screen recording and voice over. Should cover the course using practical examples. The recording will be approx 10 hrs

    $180 (Avg Bid)
    $180 Avg Bid
    9 bids

    code deployment on AWS Elastic Map Reduce . Code exists already only need to run with one minor modification . 10 programs need to be run by creating clusters on my AWS free tier account via team viewer. my friend developed code and is perfect but i added just two statements (if there is error due to this , you need to correct it in python). also, you need to place a minor code to get output in my desired text file format. Deadline is one day to three . 5 days.

    $21 (Avg Bid)
    $21 Avg Bid
    3 bids

    Homework A) Using Hadoop hdfs & Spark-scala programming Source dataset: [url removed, login to view] download data for 1999,2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008 1) Download and combine all data for the years specified about 2) Data Cleanup: Find and remove /filter out outliers & bad data 3) Perform statistics analyis on the data: counts /averages /sums / min /max 3) Using spark/scala programming on the entire dataset, what percent (%) is a) on-time flight b) cancelled flight c) Delays flights d)TOP 5 Causes of delays e) Most causes of flight delays f) Airlines with the most delays to a destination g) Airline with the most cancellations h) Airline with the most on-time i) Flight on-time / delays and cancellation national averages J) Perform some visualization in Tableau (Send me output data file,I will do visualisation myself) K) All of the above Code in a separate PDF file B) Create 10-15 pages (in word) to include the following topics: 1) Data source 2) Description the data and its schema 3) Data pre-processing required (parsing, filtering, etc.) 4) Any bad data issues encountered 5) Describe Your Spark algorithm 6) Describe any other ecosystem or additional tools used 7) Describe the output 8) How did you verify that your output is correct? 9) discuss the Performance/scale characteristics 10) what would you have done differently if you did this again? 11) Draw a conclusions from this excercise Please NOTE: This must be your original work. Someone else code cannot be copied from online and used in this project. Doing so will cause you an F grade in this course Deliverable Timeline: 1) Code in separate document -- Deliver by NOV 25 2) Documentation (10-15 pages in word) -- Deliver by NOV 27 3) Output dataset file --- Deliver by NOV 30 Deadline: NOV 30 for all of the above NB: Your personal hadoop cluster or I can provide access to cloud based hadoop cluster with data files already download onto HDFS folder

    $167 (Avg Bid)
    $167 Avg Bid
    6 bids
    spark with Scala 5h left
    VERIFIED

    Need a Hadoop ,AWS Experienced dev for New Applications streaming Structured and Unstructured Data using Spark with Scala Code

    $207 (Avg Bid)
    $207 Avg Bid
    14 bids

    segregating account holders with same pan number from different bank datasets and calculating their daily transaction in all bank accounts

    $31 (Avg Bid)
    $31 Avg Bid
    2 bids

    代码连接: 1,代码使用python框架进行开发; 2,平台需要中文和英文版本; 3,平台需要把英文版本的开发地图变为中文的; 4,把现有的功能集成到百度地图上面实现功能 5,把一个地址列表加到百度地图里面并且搜索框可以搜索到;

    $508 (Avg Bid)
    $508 Avg Bid
    6 bids

    Need to interact with clients, contractor and consultant to arrive at the MEP testing and commissioning witness scheduling

    $126 (Avg Bid)
    $126 Avg Bid
    3 bids

    Are you familiar with Hadoop Spark/Scala and know Java? If yes, please bid and we can discuss in detail Please mention your experience in these areas

    $216 (Avg Bid)
    $216 Avg Bid
    25 bids

    Install and implement and analyze instances of your chosen data storage and management systems. Contact me for more info

    $189 (Avg Bid)
    $189 Avg Bid
    4 bids

    you’ll install the QuickStart version of Cloudera’s Express distribution of Hadoop. You’ll also write your first MapReduce program

    $68 (Avg Bid)
    $68 Avg Bid
    3 bids

    DOMAIN : BIG DATA AND HADOOP TITLE : REAL TIME PROJECT - INSURANCE LANGUAGE : JAVA VM : CLOUDERA QUICKSTART VM 5.5 IDE : ECLIPSE IDE ABSTRACT : Analyze health reports across years for the US market and find the average of privately and public insured people from years 2001-2011. The Project was processed by MapReduce method and output achieved.

    $20 (Avg Bid)
    $20 Avg Bid
    9 bids

    Video Training on Big Data Hadoop. It would be screen recording and voice over. The recording will be approx 10 hrs

    $933 (Avg Bid)
    $933 Avg Bid
    5 bids

    Project consist of technologies like spark with java, hadoop, mapr

    $27 (Avg Bid)
    $27 Avg Bid
    13 bids

    The project should predict the best film of the year 2017 by using sentiment analysis aalgorithm which is a supervised machine learning [url removed, login to view] have to use film based datasets and apply map reduce [url removed, login to view] project should be done in (Hadoop with Java) or (Hadoop with python)

    $33 (Avg Bid)
    $33 Avg Bid
    6 bids

    PLEASE DO NOT BID SPECULITIVELY WITHOUT FULLY READING AND UNDERSTANDING THE REQUIREMENTS. PLEASE BID WITH REALISTIC PRICE, I WILL NOT USE ANYONE WHO ASKS FOR MONEY HIGHER THAN BID PRICE I require a gaming website building, it should work on desktop, mobile and tablet but should primarily be designed for mobile/tablet. Exact details of the content and game functionality to be confirmed once a NDA is signed. The initial functionality that I require is : The main feature of the site : A 2-dimensional map of the world that the user is able to navigate and zoom into. The map must look aesthetically professional and must be an accurate reproduction of the world. This map then needs to be overlaid with segments. Each one of these segments must have an area of 1km square and be identified by a unique number. The shape of each segment needs to be determined by you given the world is round. The Longitude and Latitude of the corners of the segments will need to be logged exactly. A user should then be able to purchase a segment by clicking on it to add to a shopping cart. A user may add more than one at the same time. Once purchased the map should permanently change and feature an overlay of text of the user’s name and home country within the segment. The segement should also become opaque in colour so that it clear that it is purchased. The payment process should go via Paypal. Further down the page should be a visible list detailing: The Segment ID, The Longitude and Latitude of each point of the Segement. The users last name and city. This list should be searchable and the results should be visibly in a tabular format and in addition the map should auto zoom and to highlight the positions. A second list ( access by admin only ) should include : The Segment ID, The Longitude and Latitude of the 6 points of the Segment. The users title, first and last names, full address & postcode/zip, e-mail, date of birth. The site should be of clean and simple design.

    $612 (Avg Bid)
    $612 Avg Bid
    14 bids

    Top Map Reduce Community Articles