We want to bulk load our elasticsearch cluster

Task: We want to bulk load our elasticsearch cluster:

> SNS topic

> Kinesis Firehose

> Maybe event bridge

1.) We will need to transform the message before loaded into elasticsearch

2.) We have over 30 million records we want fast bulk load FIFO.

3.) We want to publish a bulk amound to the SNS topic, but we dont not want multiple copies of the same records sent.

4.) We want to predict how long to complete all 30 million records

5.) We also want to keep using the process for regular updating of elastic search.

Skills: Elasticsearch, Big Data Sales, Aws Lambda

See more: load balenced cluster lvs, virtuemart bulk load, wordpress bulk load post, wordpress bulk load, oscommerce bulk load inventory, sql server bulk load, sql bulk load excel spreadsheet, sql wxcel bulk load, sql server bulk load excel, microsoft sql bulk load excel, bulk load asp, bulk load excel, asp excel bulk load example, sql bulk load html, sql bulk load excel, bulk load excel source, bulk load excel file sql server, xml bulk load excel

About the Employer:
( 0 reviews ) Barishal, Bangladesh

Project ID: #30219300

1 freelancer is bidding on average $750 for this job


Dear Client. I've read your job post carefully and I can complete it perfectly. I have rich experience about Elastic Stack. My goal is to provide high-quality service and product to clients. Please chat with me and the More

$750 USD in 7 days
(0 Reviews)