Awarded

AWS Infrastructure setup and configuration for big data analysis

Hello, I require someone who is able to setup and build an platform infrastructure in AWS that will be used to do (near) realtime analytics on several different feeds and datasets (twitter, fb, etc.)

At this stage, due to time constraints, I would like to delegate the initial setup so i can design and build/manage the application logic

This platform will use the following frameworks/components:

1. elastic mapreduce

2. elasticsearch

3. flume

4. logstash

5. kibana

6. mapbox

7. additional application servers will ideally be built using [url removed, login to view]

8. git repositories for scripts, etc.

9. S3

10. additional aws services (IAM, Data Pipeline, DynamoDB) where appropriate (easier to manage configure)

11. whatever else is needed (open to discussion)

I would like to utilise OpsWorks and elastic beanstalk where possible rather than ec2 instances, and optionally (depending on complexity/cost) chef recipes if possible in preference over written documentation (there are plenty of open source examples that can be modified etc.).

There is a wealth of documentation and articles regarding how to set all these components so this initial job is predominantly a "follow the instructions and modify accordingly", and should be similar to architecture presented by :

[url removed, login to view]

The outcome of this phase of work should be a "nice, clean" infrastructure that is "ready to go" for customisations etc, and as stated, this shouldn't have any hidden complexities.

the infrastructure should be setup using micro-tier environments during development but will need to be scaled for production (this should be tagged as a 'dev' environment

I am an experienced solution and software architect, and would like to work with someone to collaborate and work with (ie your opinions and experience matter), and engage on an ongoing basis to help complete the application/project, so if you have an interest in "big data", machine learning, and visualisation, then this first phase is just the beginning.

Skills: Amazon Web Services, Big Data, Hadoop, Linux, Map Reduce

See more: web services design development, web dev job, web design development pdf, web application development cost, time complexity examples, time complexities, node machine learning, node web development, node job, node frameworks, machine learning web design, learning web design pdf, need chef, flume software, examples complexity, cost linux software, complexity examples, chef job, beginning web development, aws scripts, architect web, architect design web, architect design software, amazon web services node, amazon web services job

About the Employer:
( 0 reviews ) Sydney, Australia

Project ID: #4877393

3 freelancers are bidding on average $18/hour for this job

acutegroups

Here we like to specify our slogan "A Right Place For Pace". we have ability and tech to close your bid within that target time. we request you to have a glance at our Private Message. we would be glad to know that you More

$22 AUD / hour
(8 Reviews)
5.0
garhwalsatyapal

ready to work with you

$16 AUD / hour
(5 Reviews)
1.9
linuxguru01

Over 10 years of experience working with linux and AWS environments. I can get this job done. Check pm.

$16 AUD / hour
(0 Reviews)
0.0
xlGEcINlpeTR

Hi we are freelance software developers. If you contact us, we can give a quote and we can discuss further details of the project. w w w . sol v e r . i o

$22 AUD / hour
(0 Reviews)
0.0