Hadoop / Nutch / AWS Resources Required
Project ID:
472910
Project Type:
Fixed
Budget:
$250-$750 USD
Project Description:
I am looking for an offshore resource who is comfortable configuring hadoop and nutch on amazon web services. You must have experience of configurations supporting 100m+ pages and 1TB+ of data on aws using ebs and the latest versions of code.
This will be a long-term, several hours per week support job to provide round the clock cover with existing uk based team.
To qualify for role you must be prepared to demonstrate you can startup and run a 4 node cluster, execute a crawl and sort, store results and shutdown. This can be done on your account or mine but we will check the results.
Please bid your monthly rate assuming 4 hours per week.
Skills required:
Data Processing,
Engineering,
J2EE,
Java,
System Admin
Public Clarification Board
1 messages
-
Hi!
May I apply if I have not nutch experience? I am using solr, a subpart of nutch and i am using hadoop. There is the latest sample: http://hyperion.mypets.ws/
6m records, VPS, solr, lucene, tomcat, very restricted ram (192m) but still working fast enough.
Regards
over 2 years ago