What does this AWS Solutions Implementation do?

The Game Analytics Pipeline solution helps game developers launch a scalable serverless data pipeline to ingest, store, and analyze telemetry data generated from games and services. The solution supports streaming ingestion of data, allowing users to gain insights from their games and other applications within minutes. The solution provides a REST API and Amazon Kinesis services for ingesting and processing game telemetry. It automatically validates, transforms, and delivers data to Amazon Simple Storage Service (Amazon S3) in a format optimized for cost-effective storage and analytics. The solution provides data lake integration by organizing and structuring data in Amazon S3 and configuring AWS Glue to catalog metadata for datasets, which makes it easy to integrate and share data with other applications and users.

The solution is designed to provide a framework for ingesting game events into your data lake for analytics and storage, allowing you to focus on expanding the solution functionality rather than managing the underlying infrastructure operations.

AWS Solutions Implementation overview

The diagram below presents the architecture you can automatically deploy using the solution's implementation guide and accompanying AWS CloudFormation template.

Game Analytics Pipeline | Architecture Diagram
 Click to enlarge

Game Analytics Pipeline solution architecture

The AWS CloudFormation template deploys AWS resources to enable the ingestion, analysis, monitoring, and reporting of game analytics data—setting up the infrastructure to support a serverless data pipeline. Amazon API Gateway provides REST API endpoints for registering game applications with the solution and for ingesting game telemetry data, which sends the events to Amazon Kinesis Data Streams. Amazon DynamoDB stores game application configurations and API keys.

Kinesis Data Streams captures streaming game data from your data producers including game clients, game servers, and other applications and enables real-time data processing by Amazon Kinesis Data Firehose and Amazon Kinesis Data Analytics. Kinesis Data Firehose consumes the streaming data from Kinesis Data Streams and invokes AWS Lambda with batches of events for serverless data processing and transformation before ingestion into Amazon Simple Storage Service (Amazon S3) for storage.

AWS Glue provides extract, transform, and load (ETL) processing workflows and metadata storage in the AWS Glue Data Catalog, which provides the basis for a data lake for integration with flexible analytics tools. Sample Amazon Athena queries analyzes game events and integration with Amazon QuickSight is available for reporting and visualization. Amazon CloudWatch monitors, logs, and generates alarms for the utilization of AWS resources and creates an operational dashboard. Amazon Simple Notification Service (Amazon SNS) provides delivery of notifications to solution administrators and other data consumers when CloudWatch alarms are breached.

Game Analytics Pipeline

Version 1.1.0
Last updated: 09/2020
Author: AWS

Estimated deployment time: 5 min

Use the button below to subscribe to solution updates.

Note: To subscribe to RSS updates, you must have an RSS plug-in enabled for the browser you are using.  

Did this Solutions Implementation help you?
Provide feedback 

Features

Launch a scalable, serverless data pipeline in AWS to analyze streaming game data

Game developers can create a scalable serverless data pipeline in AWS to ingest, store, and analyze telemetry data generated from games and services.

Easily integrate and share data with other applications and users

Organize and structure data in Amazon S3 to provide data lake integration and configure AWS Glue to catalog metadata for datasets.

Quickly gain insights from games and applications

Gain insights from games and other applications within minutes from the streaming ingestion of data.

Customize the solution to your game projects

Customize the solution to fit your particular needs, for example, by editing the solution API and adapting the processing workflows and real-time streaming analytics application.
Build icon
Deploy a Solution yourself

Browse our library of AWS Solutions Implementations to get answers to common architectural problems.

Learn more 
Find an APN partner
Find an APN Partner

Find AWS certified consulting and technology partners to help you get started.

Learn more 
Explore icon
Explore Solutions Consulting Offers

Browse our portfolio of Consulting Offers to get AWS-vetted help with solution deployment.

Learn more