Amazon Kinesis Data Analytics for Apache Flink and Studio
Amazon Kinesis Data Analytics for SQL
Local development with Apache Flink
This workshop will show you the basics of getting up and started developing Apache Flink applications locally with the long term goal of deploying to Kinesis Data Analytics for Apache Flink.
Event detection with Kinesis Data Analytics for Apache Flink and Studio
In this workshop you will create a stream processing application to identify customers entering your casino who are betting big, and sends you an e-mail when big spenders sit down at a gambling table. You will also identify tables that need a refill on chips, and identify potential cheaters in your casino through their betting and winning patterns.
To do this, we will leverage Managed Streaming for Apache Kafka to capture events, Kinesis Data Analytics Studio to detect events of interest, and Amazon Lambda with Simple Notification Service to send an e-mail for any events.
Amazon Managed Streaming for Apache Kafka (MSK) now supports integration with AWS Identity and Access Management (IAM) for authentication and authorization. You can now use IAM polices to securely access Amazon MSK Apache Kafka resources. This tech talk will dive deep on advantages, ease of use, and more details on using IAM with Amazon MSK. Amazon Kinesis Data Analytics allows customers to build stream processing applications in multiple languages, including SQL. In this session, we'll also walk through how to do streaming joins in SQL against data read from Amazon MSK.
This video shows you how Amazon Kinesis Data Analytics Studio simplifies querying data streams using SQL, Python, or Scala. A managed Apache Zeppelin notebook-based development environment and stream processing powered by Apache Flink lets you quickly analyze streaming data from a variety of sources including Amazon Kinesis Data Streams and Amazon Managed Streaming for Kafka (Amazon MSK).
A presentation at the Flink Forward San Francisco 2020 event that describes how Amazon Kinesis Data Analytics monitors your Apache Flink applications for availability. This includes how to automatically categorize errors and intervening to restore application availability.
In this session, we show you how to build an entire stream processing pipeline to collect, ingest, process, and emit streaming data using Amazon Kinesis Data Analytics, Amazon Kinesis Data Firehose, and Amazon Kinesis Data Streams.
Tools and SDKs
API reference: Describes all the API operations for Amazon Kinesis Data Analytics in detail. It also provides sample requests, responses, and errors for the supported web services protocols: HTML | PDF
FEATURED BLOG POST
How Isentia improves customer experience by modernizing their real-time media monitoring and intelligence platform with Amazon Kinesis Data Analytics for Apache Flink
by Karl Platz, Maria Sokolova, and Masudur Rahaman Sayem
FEATURED BLOG POST
We have a rich set of blog articles that provide use case and best practices guidance to help you get the most out of Amazon Kinesis. Access our full list of blog articles through the resources below.
Get started with Amazon Kinesis Data Analytics
Instantly get access to the AWS Free Tier.
Build your streaming application from the Amazon Kinesis Data Analytics console.