Posted On: Nov 17, 2023
Amazon OpenSearch Ingestion now allows you to migrate your data from Elasticsearch version 7.x clusters to the latest versions of Amazon OpenSearch Service managed clusters and both public and VPC serverless collections, eliminating the need for 3rd party tools like Logstash to migrate your data. This launch also enables you to migrate your data from 2.x version Amazon OpenSearch Service managed clusters to serverless collections. Additionally, you can now use Amazon OpenSearch Ingestion to replicate and migrate indexes between Amazon OpenSearch serverless collections.
You can now migrate all indexes, or just specific indexes, from one or more source clusters to one or more sink clusters. Amazon OpenSearch Ingestion will continually detect new indexes in the source cluster that need to be processed and can even be scheduled to reprocess indexes at a configurable interval to pick up on new documents. Also as part of this launch, Amazon OpenSearch Ingestion now supports Data Prepper 2.5.0, which introduces new processors like translate and dissect and adds support for update, upsert and delete actions for bulk operations when writing to Amazon OpenSearch indexes. You can check out the complete list of features in this blog post.
This feature is available in all the AWS commercial regions where Amazon OpenSearch Ingestion is currently available.
To learn more, see the Amazon OpenSearch Ingestion webpage and the Amazon OpenSearch Service Developer Guide.