Centralized Logging with OpenSearch

Build a centralized log analytics platform with Amazon OpenSearch Service on AWS in 20 minutes

Overview

Centralized Logging with OpenSearch helps organizations collect, ingest, and visualize log data from various sources using Amazon OpenSearch Service. This solution provides a web-based console, which you can use to create log ingestion pipelines with a few clicks. Log ingestion pipelines include log collection agent deployment, log enrichment without writing codes, buffer layer creation, and OpenSearch index configuration. After logs are stored in OpenSearch Service, the solution automatically generates ready-to-use dashboards for analyzing AWS service logs and application logs in different formats (for example, Nginx, JSON, and Spring Boot). In combination with other AWS services, this solution provides you with a turnkey environment to begin logging and monitoring your AWS applications.

What's new  | November 2023


  • Added Light Engine to provide an Amazon Athena-based serverless and cost-effective log analytics engine
  • Added Amazon OpenSearch Ingestion to provide more log processing capabilities

To find out about other new features, refer to the Revisions page.

Benefits

Ease of use

Use a web console from your AWS account to ingest both application and AWS service logs, then analyze the logs with visualization dashboards.

Improved operational efficiency

Serverless technologies with built-in high availability and a pay-for-use billing model reduces the need for infrastructure management, allowing you to focus more on building log analytics for your business.

Open source and customization

The solution is open sourced and free for commercial use. You pay only for the AWS usage. You can take the source code as a reference to make your own implementation that fits your needs.

Technical details

The diagram below presents the architecture you can automatically deploy using the solution's implementation guide and accompanying Amazon CloudFormation template.

Solution Web Console
Blog
Amazon CloudWatch Cross-Account Observability

A new capability to search, analyze, and correlate cross-account telemetry data stored in CloudWatch such as metrics, logs, and traces.

Read the blog 
About this deployment
Version
2.1.1
Released
12/2023
Author
AWS
Est. deployment time
15 mins
Estimated cost
Download implementation guide  Source code 
Deployment options
Ready to get started?
Deploy this solution by launching it in your AWS Console

New VPC (AWS Regions)

Existing VPC (AWS Regions)

New VPC (AWS China Regions)

Existing VPC (AWS China Regions)
Did this AWS Solution help you?
Provide feedback