Amazon OpenSearch Service zero-ETL integration with Amazon S3 now available

Posted on: May 22, 2024

Today, AWS announces the general availability of Amazon OpenSearch Service zero-ETL integration with Amazon S3, a new efficient way for customers to query operational logs in Amazon S3 data lakes eliminating the need to switch between tools to analyze data. Customers can quickly get started by installing out-of-the-box dashboards for AWS log types such as VPC Flow, WAF, and Elastic Load Balancer.

Customers who use OpenSearch Service also use Amazon S3 as a cost-effective way to store infrequently-accessed operational log data. To perform analysis on Amazon S3 data and correlate data across multiple sources, customers previously had to copy that data into OpenSearch Service to take advantage of its rich analytics and visualization features that help them understand data, identify anomalies, and detect potential threats. However, continuously replicating data between services can be time consuming, expensive, and hard to maintain. With OpenSearch Service zero-ETL integration with Amazon S3, customers can access operational log data stored in Amazon S3 using OpenSearch Service, making it easier to perform complex queries and visualizations on their data without any data movement.

Amazon OpenSearch Service zero-ETL integration with Amazon S3 is generally available using OpenSearch Service 2.13 in Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (Stockholm), US East (Ohio), US East (N. Virginia), and US West (Oregon).

To learn more, see the Amazon OpenSearch Service Integration page and the Amazon OpenSearch Service Developer Guide .