Closed

Hadoop Project -- 2

On the hadoop cluster located at [login to view URL], in HDFS, is a directory called /share/spoilers. This directory contains 25000 text files containing "spoiler logs" for a randomized version of The Legend of Zelda: A Link to the Past. Yes, I am a huge nerd. As before, in the "Light World" section, you might see: "Graveyard Ledge:14952": "ProgressiveSword:14952", This means that the location called "Graveyard Ledge" has the item "ProgressiveSword". Each of these sections is labeled by its region. The region, therefore, of the previous item, is "Light World". Your task for this project is to create a Naive Bayes classifier for Hadoop using Spark Machine Learning to predict the region that houses the "PegasusBoots" item. Each file will provide one example for the classifier. You should, before attempting to train the classifier, extract the following features from each file: HookshotLocation: The region that houses the "Hookshot" item. PearlLocation: The region that houses the "MoonPearl" item. MirrorLocation: The region that houses the "MagicMirror" item. FireLocation: The region that houses the "FireRod" item. CaneLocation: The region that houses the "CaneOfSomaria" item. HammerLocation: The region that houses the "Hammer" item. FlipperLocation: The region that houses the "Flippers" item. LWGloves: The number of "ProgressiveGlove" items in the "Light World" region. EasternGloves: The number of "ProgressiveGlove" items in the "Eastern Palace" region. DesertGloves: The number of "ProgressiveGlove" items in the "Desert Palace" region. DMGloves: The number of "ProgressiveGlove" items in the "Death Mountain" region. HeraGloves: The number of "ProgressiveGlove" items in the "Tower of Hera" region. DWGloves: The number of "ProgressiveGlove" items in the "Dark World" region. DarkGloves: The number of "ProgressiveGlove" items in the "Dark Palace" region. SwampGloves: The number of "ProgressiveGlove" items in the "Swamp Palace" region. SkullGloves: The number of "ProgressiveGlove" items in the "Skull Woods" region. ThievesGloves: The number of "ProgressiveGlove" items in the "Thieves Town" region. BootsLocation (Class Value): The region that houses the "PegasusBoots" item. *Note: "Castle Tower", "Ice Palace", "Misery Mire", "Turtle Rock", and "Ganons Tower" cannot contain a glove.

The files are in JSON format, so you will either need to get a way to parse JSON, or simply read the relevant lines from each file. You will need to produce the attributes listed above from the spoiler files on the Hadoop cluster. In the end, I should be able to use your classifier to predict the boots locations for rows that are unlabeled. You will need to convert the categorical values in each of these to integers in order to make it work with spark's machine learning library. Provide any code you used, as well as the file containing the model you built using spark ML.

Skills: Software Architecture, Apache Hadoop, Hadoop

See more: hadoop project budget 2009, hadoop project java, simple hadoop project, freelance trainer on hadoop administration, hadoop project, freelance projects on hadoop, freelancing on hadoop, hadoop project freelancing, r on hadoop, freelancer hadoop project, freelancing projects on hadoop, hadoop project freelancer, hadoop project on freelance, jobs on hadoop, math project on prabability for 10 th cbse, hadoop project example, big data hadoop project ideas, .net framework 4.6.2 developer pack windows 10, implementing the k-means clustering algorithm on hadoop mapreduce, how to install hadoop 3.2.0 on windows 10

About the Employer:
( 8 reviews ) Hisar, India

Project ID: #30088596

2 freelancers are bidding on average ₹12250 for this job

riteshkumar147

Hi, I have already completed this assignment and the guy got 1900 points out of 2000. Regards, Ritesh

₹12000 INR in 1 day
(1 Review)
0.7
DOAGuru

Hello there, We have read your requirements. We will complete this in your time. We have 10+ years experience in Software Architecture Hadoop, Apache Hadoop and development services. We have excellent experienced team More

₹12500 INR in 10 days
(0 Reviews)
0.0