What does this AWS Solutions Implementation do?

The Centralized Logging solution enables organizations to collect, analyze, and display logs on AWS across multiple accounts and AWS Regions. The solution uses Amazon Elasticsearch Service (Amazon ES), a managed service that simplifies the deployment, operation, and scaling of Elasticsearch clusters in the AWS Cloud, as well as Kibana, an analytics and visualization platform that is integrated with Amazon ES. In combination with other AWS managed services, this solution offers customers a customizable, multi-account environment to begin logging and analyzing their AWS environment and applications.

Version 3.2 of the solution uses the most up-to-date Node.js runtime. Version 2.2 uses the Node.js 8.10 runtime, which reaches end-of-life on December 31, 2019. To upgrade to version 3.2, you can update the stack. For more information, see the deployment guide.

AWS Solutions Implementation overview

The diagram below presents the centralized logging architecture you can automatically deploy using the solution's implementation guide and accompanying AWS CloudFormation templates.

Centralized Logging | Architecture Diagram
 Click to enlarge

Centralized Logging architecture

The primary template deploys an Amazon ES domain, which is the hardware, software, and data exposed by Amazon ES endpoints. A custom AWS Lambda function is deployed to load log data from Amazon CloudWatch to an Amazon ES domain, configured with a set of default Kibana dashboards as a starting point for data visualization.

An Amazon Cognito user pool provides Kibana dashboard user authentication. A secondary template enables customers to index logs from secondary accounts and regions on the Amazon ES domain in the primary account or region. 

A demo template deploys sample logs that customers can use for testing purposes.

Centralized Logging

Version 3.2
Last updated: 12/2019
Author: AWS

Estimated deployment time: 30 min

Use the button below to subscribe to solution updates.

Note: To subscribe to RSS updates, you must have an RSS plug-in enabled for the browser you are using.  

Features

Centralized logging reference implementation

Deploy a centralized logging solution using AWS CloudFormation. The CloudFormation template will automatically launch and configure the components necessary to upload log files from multiple accounts and AWS Regions to Amazon ES for analysis and visualization in a customizable, user-friendly dashboard.

Access to your dashboards using Amazon Cognito

Control access to your dashboards using Amazon Cognito to simplify authentication to Amazon ES.

Logging capabilities beyond default AWS service logs

Extend your logging capabilities beyond default AWS service logs. This flexible solution includes examples for capturing host-level log files and VPC flow logs, and is designed to scale with your growing business.

Data visualization using built-in Amazon ES support

Simplify data visualization using built-in Amazon ES support for Kibana, including a default set of preconfigured dashboards that give you a first glimpse into the customization capabilities of Kibana.
Build icon
Deploy a Solution yourself

Browse our library of AWS Solutions Implementations to get answers to common architectural problems.

Learn more 
Find an APN Partner
Find an APN Partner

Find AWS certified consulting and technology partners to help you get started.

Learn more 
Explore icon
Explore Solutions Consulting Offers

Browse our portfolio of Consulting Offers to get AWS-vetted help with solution deployment.

Learn more