Documentation

Developer Guide for Apache Flink Applications: HTML | PDF

Developer Guide for Studio, the easiest way to build Apache Flink applications in SQL, Python, Scala in a notebook interface: HTML | PDF

Developer Guide for Apache Beam Applications (Java): HTML | PDF

Amazon Kinesis Data Analytics for SQL

Developer Guide: HTML | PDF

SQL Reference: Describes the SQL language supported by Amazon Kinesis Data Analytics for SQL: HTML | PDF

Workshops


This workshop will show you the basics of getting up and started developing Apache Flink applications locally with the long term goal of deploying to Kinesis Data Analytics for Apache Flink.

In this workshop you will create a stream processing application to identify customers entering your casino who are betting big, and sends you an e-mail when big spenders sit down at a gambling table. You will also identify tables that need a refill on chips, and identify potential cheaters in your casino through their betting and winning patterns.


To do this, we will leverage Managed Streaming for Apache Kafka to capture events, Kinesis Data Analytics Studio to detect events of interest, and Amazon Lambda with Simple Notification Service to send an e-mail for any events.

Getting Started


Workshops for Apache Flink and Apache Beam on Kinesis Data Analytics and Kinesis Data Analytics Studio, all using the NYC Taxi Cab trips dataset.                                                                                                        

Videos

Using IAM with Amazon MSK and Easy Stream Processing with Amazon Kinesis Data Analytics (37:02)

Amazon Managed Streaming for Apache Kafka (MSK) now supports integration with AWS Identity and Access Management (IAM) for authentication and authorization. You can now use IAM polices to securely access Amazon MSK Apache Kafka resources. This tech talk will dive deep on advantages, ease of use, and more details on using IAM with Amazon MSK. Amazon Kinesis Data Analytics allows customers to build stream processing applications in multiple languages, including SQL. In this session, we'll also walk through how to do streaming joins in SQL against data read from Amazon MSK.

Query Your Data Streams in Real Time With Kinesis Data Analytics Studio (13:22)

This video shows you how Amazon Kinesis Data Analytics Studio simplifies querying data streams using SQL, Python, or Scala. A managed Apache Zeppelin notebook-based development environment and stream processing powered by Apache Flink lets you quickly analyze streaming data from a variety of sources including Amazon Kinesis Data Streams and Amazon Managed Streaming for Kafka (Amazon MSK).

Lesson learned on Apache Flink application availability (34:46)

A presentation at the Flink Forward San Francisco 2020 event that describes how Amazon Kinesis Data Analytics monitors your Apache Flink applications for availability. This includes how to automatically categorize errors and intervening to restore application availability.

Needle in the haystack - Monitoring health of a huge Kafka fleet with Flink (15:12)

In this session, we show you how to build an entire stream processing pipeline to collect, ingest, process, and emit streaming data using Amazon Kinesis Data Analytics, Amazon Kinesis Data Firehose, and Amazon Kinesis Data Streams.

Tools and SDKs

API reference: Describes all the API operations for Amazon Kinesis Data Analytics in detail. It also provides sample requests, responses, and errors for the supported web services protocols: HTML | PDF

AWS SDKs

AWS CLI and AWS CLI reference for Amazon Kinesis Data Analytics

Blog posts

We have a rich set of blog articles that provide use case and best practices guidance to help you get the most out of Amazon Kinesis. Access our full list of blog articles through the resources below.

No blog posts have been found at this time. Please see the AWS Blog for other resources.

Read more Amazon Kinesis articles on the AWS News Blog.

Learn about best practices, feature capabilities, and customer use cases on the AWS Big Data Blog.

Read more blog articles about Amazon Kinesis on the AWS Databases Blog.

Get started with Amazon Kinesis Data Analytics

Sign up for an AWS account
Sign up for an AWS account

Instantly get access to the AWS Free Tier.

Read the documentation
Review the getting-started guide

Learn how to use Amazon Kinesis Data Analytics in the step-by-step guide for Apache Flink and Amazon Kinesis Data Analytics Studio.

Start building in the console
Start building streaming applications

Build your streaming application from the Amazon Kinesis Data Analytics console.