Find Jobs
Hire Freelancers

Setup Nutch and ElasticSearch on AWS Documentation

$30-250 USD

Closed
Posted over 8 years ago

$30-250 USD

Paid on delivery
the project overall is much larger - but initially I am looking for someone to setup nutch to crawl a set of about 10 websites, and the contents of what is retrieved needs to be stored in an elasticsearch index. lots of guides online how to do this - I just need someone to do the legwork for me. The end deliverable is a document with steps on doing this along with live setup.
Project ID: 9460184

About the project

12 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
12 freelancers are bidding on average $151 USD for this job
User Avatar
Hello, We will be happy to help you. We have 80+ software engineers in our company. You will be able to communicate directly with the expert working on your project. We have a team of Skilled Java-J2EE professionals with experience up to 8 years. ===== Our Expertise in Java / J2EE : * Desktop Applications : Swing, Eclipse Rich Client Platform, AWT, SWT, RMI * Frameworks: Spring, Spring Security, Spring Social, Struts, Hibernate ,JPA, Lucerne, Quartz, Ant, jUnit, DbUnit, Mybatis * Web Technology : JSP, JSTL, JSF, JQuery, Ajax, JavaScript, DWR, FCK Editor, Extjs * Application Servers : JBoss, WebLogic, WebSphere, Apache Tomcat, Glassfish * Databases : MySQL 4.x/5.x, Oracle 8i/9i/10g/11g, Postgre SQL * Web Services : SOAP, WSDL, RESTFUL Web Services, Apache Axis * IDE : Eclipse, Net Beans, Web Ratio (Model Based Application Development IDE) , Spring IDE * Payment Gateway : PayPal Integration [Experienced in integrating other payment gateways too] * SDLC : AGILE ===== We are available from Monday To Friday, 9 hours a day. Our timezone is GMT+5.30. Please initiate chat to check our understandings and queries. We look forward to have long term engagement on the basis of quality of our work evinced in this project. Thanks.
$105 USD in 3 days
4.9 (38 reviews)
7.3
7.3
User Avatar
Hello! I have right skills and great experience for begin working on your project just right now! You may show good reviews at my profile.
$150 USD in 3 days
4.8 (114 reviews)
6.2
6.2
User Avatar
I am an IITK graduate, 9 year experienced software professional and I have got top notch developers in my team, who have got experience across a span of technologies. The members in my team have worked with top notch tech organization such as Amazon, Cisco, Oracle etc. We have been involved in similar projects in the past and our track record has been excellent.
$155 USD in 3 days
4.9 (13 reviews)
4.4
4.4
User Avatar
Hi, We help customers do business better by leveraging our industry-wide experience and deep technology expertise. These technology includes setup and management of AWS , different Linux web hosting servers. We are Having expertise in amazon web services. We can setup aws ec2, aws s3 and other amazon products with best configuration. We have expert knowledge of as below techniques:- Amazon Elastic computer cloud(EC2): Virtual servers in a cloud infrastructure We will suggest the instance configuration according to website traffic or resource usage so that unnecessary cost not be beared to client. Security group Management for instance (It works as a firewall in ec2 ) Key pair Management (Authentication Security for instance ,It requires for login) Elastic ip management (dedicated ip to instance) Virtual private Cloud (for private network Management) Volume management on instance AMI (OS image) selection as per application need Upgrade / downgrade of instance resources at run time (without downtime) Snapshot and AMI creation for backup and disaster recovery Load balancer configuration for huge traffic balancing or huge resource balancing , Auto scaling for auto instance creation as per traffic increase or additional resource required Instance health alert Uptime alert setup AWS Identity and Access Management (IAM) users with limited permissions. Amazon user management Region selection for instance as per target audience and for less bandwidth consumption Thanks
$155 USD in 1 day
4.7 (13 reviews)
4.3
4.3
User Avatar
Thank you for viewing my profile you can check have 5***/5*** also have 100% complete rate you can check happy customer. always trying to get customer satisfaction. I have gone through your project requirement specification and as per my previous experience with this we are capable to do this project. please give a chance to proved our skill. Welcome to one of the best services available for your online needs. We provide you industry standard Mobile Apps, Software, Desktop Apps, Web Stores, Websites and Web Apps. So, you get all at one place! We can provide you the following: - iOS applications - Android applications - Software for all purposes - Desktop applications - Websites - Web applications - Ecommerce websites/ Web stores We specialize in: - Objective C, Cocoa, iOS 4, 5, 6 - Java, Google Android - WordPress, Joomla - WP Ecommerce, Magento - PHP5, PHP, MySQL - C#, C++, C - ActionScript 3.0, AIR, XML Please check reviews of our happy customers to boost your confident about us! Thanks. replay me on pm we need more discussion about your project .
$140 USD in 7 days
5.0 (12 reviews)
1.8
1.8
User Avatar
<<<< i can help you low budget PLEASE CHAT ME >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> ___________________________________________________________________________________________________________________
$30 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I noticed that you are looking for expert who will setup Nutch to crawl websites, I am familiar with Nutch web crawler, I have 4 years of work experience in Java, J2ee, Spring, Hibernate, Linux, Maven etc. I have worked on large scale projects on similar technologies. I would like to work on this project with you, please allow me to discuss with you about same. Awaiting positive response from your side. Kind Regards, Vishal
$277 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Please find below the experience summary wrt elasticsearch. 1) Hands on experience in working with elasticsearch 2.x 2) Hands on experience with setting up the cluster wrt explicit requirement that includes type and size of data to be indexed, what type of nodes should be configured and how? This also includes setting up the 12 node clusters on AWS as well along with Logstash and kibana 3) Extensive knowledge on setting up the various configuration for elasticsearch like master node, client node, data node, multicast , unicast, shards , replica, heap memory allocation , heap dump etc. 4) Hands on experience in using various plugin for elasticsearch such as Mapper Attachement , Head, big desk , categorization plugin (carrot2 with lingo3g). 5) Good hands on in preparing the mapping wrt type of data to be indexed on elasticsearch. 6) Expertise in writing query to search the indexed data which includes various type of queries such as query string, terms, match, multi match etc that depends on type and amount of data to be searched. 7) Hands on experience in dealing with about ~600GB OF DATA to be indexed per day and same is available for search as well. 8) Hands on experience in finding the root cause in case if cluster downtime is there or any upgrade is to be performed. 9) Hands on with taking the index backup and restore using snapshot. 10) Hands on experience in configuring the synonym and grammar extension feature for search record . For example search for test will give the result of testing, tests, tested as well. 11) Good exposure in making the graphs and visualization using kibana and ES. 12) Hands on experience in indexing data from various plugin and source such as Logstash, Flume, CSV, Json etc Let me know if we need to discuss anything further for the same.
$133 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have experience working on both nutch, elasticsearch, hadoop and related big data system. Also if you are looking for someone to have long term committment for work, I think I would be ideally placed for it
$111 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of CANADA
Canada
0.0
0
Member since Jan 25, 2016

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.