AWS DevOps Monitoring Dashboard

What does this AWS Solutions Implementation do?

This solution automates the process of ingesting, analyzing, and visualizing continuous integration/continuous delivery (CI/CD) metrics. These metrics are displayed in Amazon QuickSight dashboards to help DevOps leaders measure the impact of their DevOps initiatives and make data-driven decisions to drive continuous improvement in their development teams.

Benefits

Secure one-click deployment

Provide a secure one-click deployment using an AWS CloudFormation template developed with the AWS Well-Architected Framework methodologies.

Automated near real-time analytics

Automate ingestion and analysis of streaming data containing performance and operational metrics in your CI/CD pipeline in near real-time. Calculate key DevOps metrics to track andmeasure the activities of your development teams.

Automated visualization with Amazon QuickSight

Automate the launch of pre-built Amazon QuickSight dashboards to visualize the solution's analyses. Identify insights into your CI/CD activities to better understand your DevOps initiatives and make data-driven decisions to drive continuous improvement in your software delivery process.

Customize business intelligence tools for data visualization

You can customize this solution to use third party business intelligence (BI) tools so you can build customized visualizations from the Amazon Athena database.

AWS Solutions Implementation overview

The diagram below presents the architecture you can automatically deploy using the solution's implementation guide and accompanying AWS CloudFormation template.

AWS DevOps Monitoring Dashboard | Architecture Diagram

Click to enlarge

AWS DevOps Monitoring Dashboard Solutions Implementation architecture

This solution runs the following workflow:

1. A developer initiates an activity in an AWS CI/CD pipeline, such as pushing a code change to AWS CodeCommit or deploying an application using AWS CodeDeploy. These activities create events.

2. An Amazon EventBridge events rule detects the events based on predefined event patterns and then sends the event data to an Amazon Kinesis Data Firehose delivery stream. One event rule is created per event source. For activities in AWS CodeBuild, a CloudWatch metric stream is set up to capture CloudWatch metrics and deliver them to a Kinesis Data Firehose delivery stream.

3. An Amazon EventBridge events rule is also created to capture events from an Amazon CloudWatch alarm that monitors the status of an Amazon CloudWatch synthetics canary, if you have set up the canary and alarm in your account. This alarm is needed to gather data for calculating Mean Time to Recover (MTTR) metrics.

4. Amazon Kinesis Data Firehose uses an AWS Lambda function for data transformation. The Lambda function extracts relevant data to each metric and sends it to an Amazon S3 bucket for downstream processing.

5. The data in Amazon S3 is linked to an Amazon Athena database, which runs queries against this data and returns query results to Amazon QuickSight.

6. Amazon QuickSight obtains the query results and builds dashboard visualizations for your management team.