DevOps Monitoring Dashboard on AWS

What does this AWS Solution do?

This solution automates the process of ingesting, analyzing, and visualizing continuous integration/continuous delivery (CI/CD) metrics. These metrics are displayed in Amazon QuickSight dashboards to help DevOps leaders measure the impact of their DevOps initiatives and make data-driven decisions to drive continuous improvement in their development teams.

Benefits

Secure one-click deployment

Provide a secure one-click deployment using an AWS CloudFormation template developed with the AWS Well-Architected Framework methodologies.

Automated near real-time analytics

Automate ingestion and analysis of streaming data containing performance and operational metrics in your CI/CD pipeline in near real-time. Calculate key DevOps metrics to track andmeasure the activities of your development teams.

Automated visualization with Amazon QuickSight

Automate the launch of pre-built Amazon QuickSight dashboards to visualize the solution's analyses. Identify insights into your CI/CD activities to better understand your DevOps initiatives and make data-driven decisions to drive continuous improvement in your software delivery process.

Customize business intelligence tools for data visualization

You can customize this solution to use third-party business intelligence (BI) tools so you can build customized visualizations from the Amazon Athena database.

Multi-account multi-Region data ingestion

Stream data from multiple AWS accounts and AWS Regions into a central S3 bucket where data is analyzed and monitored using a single dashboard.

AWS Solution overview

The diagram below presents the architecture you can automatically deploy using the solution's implementation guide and accompanying AWS CloudFormation template.

DevOps Monitoring Dashboard on AWS architecture

This solution runs the following workflow:

1. A developer initiates an activity in an AWS CI/CD pipeline, such as pushing a code change to AWS CodeCommit or deploying an application using AWS CodeDeploy. These activities create events. If a multi-account multi-region feature is activated, the events can be generated from multiple AWS accounts and multiple AWS Regions. For development using GitHub repository, git push events are generated.

2. An Amazon EventBridge events rule detects the events based on predefined event patterns and then sends the event data to an Amazon Kinesis Data Firehose delivery stream. One event rule is created per event source. For activities in AWS CodeBuild, a CloudWatch metric stream is set up to capture CloudWatch metrics and deliver them to a Kinesis Data Firehose delivery stream. For GitHub push events, an Amazon API endpoint is created to post these events and deliver them to a Kinesis Data Firehose delivery stream.

3. An Amazon EventBridge events rule is also created to capture events from an Amazon CloudWatch alarm that monitors the status of an Amazon CloudWatch synthetics canary or Amazon CodePipeline, if you have set up the alarm for the canary or pipeline respectively in your account. This alarm is needed to gather data for calculating Mean Time to Recovery (MTTR) metrics.

4. Amazon Kinesis Data Firehose uses an AWS Lambda function for data transformation. The Lambda function extracts relevant data to each metric and sends it to an Amazon S3 bucket in the monitoring account for downstream processing.

5. The data in Amazon S3 is linked to an Amazon Athena database, which runs queries against this data and returns query results to Amazon QuickSight.

6. Amazon QuickSight obtains the query results and builds dashboard visualizations for your management team.

DevOps Monitoring Dashboard on AWS

Version 1.8.0
Released: 10/2022
Author: AWS

Estimated deployment time: 10 min

Estimated cost  Source code  CloudFormation template 
Use the button below to subscribe to updates for this Solutions Implementation.
Note: To subscribe to RSS updates, you must have an RSS plug-in enabled for the browser you are using.
Did this Solutions Implementation help you?
Provide feedback 
Mphasis Stelligent

“Mphasis is a leading applied technology services company which enables enterprises to accelerate their digital transformation journey. By using DevOps Monitoring Dashboard alongside other AWS solutions, we were able to decrease time between ideation and deployment by 30%. We’re able to automate the setup process of collecting and visualizing our DevOps operational metrics which has allowed us to easily make smarter decisions and pinpoint where improvements can be made across our deployment teams.”

Frank Schwarzenau, Business Head
Mphasis Stelligent
AWS Management & Governance Blog
How to automate capture and analysis of CI/CD metrics using AWS DevOps Monitoring Dashboard solution
In this blog post, we show you how you can save time and effort using AWS DevOps Monitoring Dashboard solution to automate the setup process to collect and visualize DevOps metrics. This solution is a reference implementation that makes it easier for organizations of all sizes to collect, analyze, and visualize key operational metrics in their software delivery process.
Read the full blog post 
Build icon
Deploy an AWS Solution yourself

Browse our library of AWS Solutions to get answers to common architectural problems.

Learn more 
Find an APN partner
Find an AWS Partner Solution

Find AWS Partners to help you get started.

Explore icon
Explore Guidance

Find prescriptive architectural diagrams, sample code, and technical content for common use cases.

Learn more