What does this AWS Solution do?

Tracking website metrics in real-time can provide insight into who visits your website, where they come from, and what content they view. You can track time series data on visitor counts, page views, time spent on site, channels driving traffic, actions visitors take, and other custom metrics. This insight can help you react quickly to changing conditions.

To help customers more easily track website activity, Amazon Web Services offers the Real-Time Web Analytics with Kinesis Data Analytics solution, a reference implementation that automatically provisions the services necessary to track and visualize website clickstream data in real-time. This solution is designed to provide a framework for analyzing and visualizing metrics, allowing you to focus on adding new metrics rather than managing the underlying infrastructure.

AWS Solution overview

AWS offers a solution that uses beacon web servers to log requests from a user’s web browser, Amazon Kinesis Data Firehose to capture website clickstream data, Amazon Kinesis Data Analytics to compute metrics in real-time, and Amazon Simple Storage Service (Amazon S3) and Amazon DynamoDB to durably store metric data. The solution also features a dashboard that visualizes your account activity in real-time. The diagram below presents the architecture you can deploy in minutes using the solution's implementation guide and accompanying AWS CloudFormation template.

real-time-web-analytics-with-kinesis-architecture
 Click to enlarge

Real-Time Web Analytics with Kinesis Data Analytics architecture

Web beacon servers log requests from a user’s web browser and send the data to a Kinesis Data Firehose delivery stream. The delivery stream archives the events in an Amazon S3 bucket and sends the data to a Kinesis Data Analytics application for processing.

Once the data is processed, it is sent to Kinesis Data Streams. An AWS Lambda function reads data from the stream and sends the data in real-time to an Amazon DynamoDB table to be stored.

The solution also creates an Amazon Cognito user pool, an Amazon S3 bucket, an Amazon CloudFront distribution, and real-time dashboard to securely read and display the account activity stored in the DynamoDB table.

Real-Time Web Analytics with Kinesis Data Analytics

Version 1.0.1
Last updated: 12/2018
Author: AWS

Estimated deployment time: 10 min

Source code  CloudFormation template 

Features

Real-time visualizations

Real-Time Web Analytics with Kinesis Data Analytics enables you to track website activity in real-time. Visualize web usage metrics including events per hour, visitor count, user agents, abnormal events, aggregate event count, referrers, and recent events. You can also customize this solution to include additional metrics.

Beacon server performance metrics

This solution provides an optional dashboard you can use to monitor the performance of your beacon web servers with Amazon CloudWatch. The dashboard displays custom operational metrics for the servers, including the number of healthy servers, the average processed network packets, aggregate requests, 5XX errors, and Amazon DynamoDB throughput capacity and throttling.

Real-time dashboard

Automatically deploy a real-time dashboard that displays web usage metrics. You can customize the dashboard to include any metrics.
Product-Page_Standard-Icons_01_Product-Features_SqInk
Explore all AWS Solutions

Browse our portfolio of AWS-built solutions to common architectural problems.

Learn more 
Next-Steps-Icon_Find-a-Partner-B
Find a Partner

Find AWS certified consulting and technology partners to help you get started.

Learn more 
Product-Page_Standard-Icons_03_Start-Building_SqInk
Start building in the console

Sign-up and start exploring our services.

Get started