Amazon OpenSearch Ingestion adds support for ingesting data from Amazon Kinesis Data Streams
Amazon OpenSearch Ingestion now allows you to ingest records from Amazon Kinesis Data Streams, enabling you to seamlessly index streaming data in Amazon OpenSearch Service managed clusters or serverless collections without the need for any third-party data connectors. With this integration, you can now use Amazon OpenSearch Ingestion to perform near- real-time aggregations, sampling and anomaly detection on data ingested from Amazon Kinesis Data Streams, helping you to build efficient data pipelines to power your event-driven applications and real-time analytics use cases.
Amazon OpenSearch Ingestion pipelines can consume data records from one or more Amazon Kinesis Data Streams and transform the data before writing it to Amazon OpenSearch Service or Amazon S3. While reading data from Amazon Kinesis Data Streams via Amazon OpenSearch Ingestion, you have the option to use either enhanced fan-out or shared reads, giving you the flexibility to balance speed and cost. You can also check out this blog post to learn more about this feature.
This feature is available in all the 15 AWS commercial regions where Amazon OpenSearch Ingestion is currently available: US East (Ohio), US East (N. Virginia), US West (Oregon), US West (N. California), Europe (Ireland), Europe (London), Europe (Frankfurt), Asia Pacific (Tokyo), Asia Pacific (Sydney), Asia Pacific (Singapore), Asia Pacific (Mumbai), Asia Pacific (Seoul), Canada (Central), South America (Sao Paulo), and Europe (Stockholm).
To learn more, see the Amazon OpenSearch Ingestion webpage and the Amazon OpenSearch Service Developer Guide.