Documentation

Developer Guide for Apache Flink Applications: HTML | PDF

Developer Guide for Studio, the easiest way to build Apache Flink applications in SQL, Python, Scala in a notebook interface: HTML | PDF

Developer Guide for Apache Beam Applications (Java): HTML | PDF

Amazon Kinesis Data Analytics for SQL

Developer Guide: HTML | PDF

SQL Reference: Describes the SQL language supported by Amazon Kinesis Data Analytics for SQL: HTML | PDF

Workshops


This workshop will show you the basics of getting up and started developing Apache Flink applications locally with the long term goal of deploying to Kinesis Data Analytics for Apache Flink.

In this workshop you will create a stream processing application to identify customers entering your casino who are betting big, and sends you an e-mail when big spenders sit down at a gambling table. You will also identify tables that need a refill on chips, and identify potential cheaters in your casino through their betting and winning patterns.


To do this, we will leverage Managed Streaming for Apache Kafka to capture events, Kinesis Data Analytics Studio to detect events of interest, and Amazon Lambda with Simple Notification Service to send an e-mail for any events.

Getting Started


Workshops for Apache Flink and Apache Beam on Kinesis Data Analytics and Kinesis Data Analytics Studio, all using the NYC Taxi Cab trips dataset.                                                                                                        

Videos

AWS re:Invent 2022: Poshmark accelerates growth via real-time analytics & personalization (49:28)

Learn how Poshmark enhanced user experience by designing real-time personalization using real-time event capture with Amazon MSK and real-time data enrichment with Amazon Kinesis Data Analytics for Apache Flink.

AWS re:Invent 2022: How Samsung modernized architecture for real-time analytics (33:23)

Learn how Samsung SmartThings moved from self-managed Apache Spark to a fully managed stream-processing platform with Amazon Kinesis Data Analytics for Apache Flink and how they securely streamed data at scale with fully managed Kinesis Data Streams and Amazon MSK.

Needle in the haystack - Monitoring health of a huge Kafka fleet with Flink (15:12)

Learn how to build an entire stream processing pipeline to collect, ingest, process, and emit streaming data using Amazon Kinesis Data Analytics, Amazon Kinesis Data Firehose, and Amazon Kinesis Data Streams.

Using IAM with Amazon MSK and Easy Stream Processing with Amazon Kinesis Data Analytics (37:02)

Dive deep on advantages, ease of use, and more details on using AWS Identity and Access Management (IAM) with Amazon Managed Streaming for Apache Kafka (MSK). Amazon Kinesis Data Analytics allows customers to build stream processing applications in multiple languages, including SQL.

Query Your Data Streams in Real Time With Kinesis Data Analytics Studio (13:22)

Learn how Amazon Kinesis Data Analytics Studio simplifies querying data streams using SQL, Python, or Scala. A managed Apache Zeppelin notebook-based development environment and stream processing powered by Apache Flink lets you quickly analyze streaming data from a variety of sources including Amazon Kinesis Data Streams and Amazon Managed Streaming for Kafka (Amazon MSK).

Lesson learned on Apache Flink application availability (34:46)

Learn how Amazon Kinesis Data Analytics monitors your Apache Flink applications for availability, including how to automatically categorize errors and intervening to restore application availability.

Tools and SDKs

API reference: Describes all the API operations for Amazon Kinesis Data Analytics in detail. It also provides sample requests, responses, and errors for the supported web services protocols: HTML | PDF

AWS SDKs

AWS CLI and AWS CLI reference for Amazon Kinesis Data Analytics

Blog posts

We have a rich set of blog articles that provide use case and best practices guidance to help you get the most out of Amazon Kinesis. Access our full list of blog articles through the resources below.

No blog posts have been found at this time. Please see the AWS Blog for other resources.

Read more Amazon Kinesis articles on the AWS News Blog.

Learn about best practices, feature capabilities, and customer use cases on the AWS Big Data Blog.

Read more blog articles about Amazon Kinesis on the AWS Databases Blog.

Get started with Amazon Kinesis Data Analytics

Sign up for an AWS account
Sign up for an AWS account

Instantly get access to the AWS Free Tier.

Read the documentation
Review the getting-started guide

Learn how to use Amazon Kinesis Data Analytics in the step-by-step guide for Apache Flink and Amazon Kinesis Data Analytics Studio.

Start building in the console
Start building streaming applications

Build your streaming application from the Amazon Kinesis Data Analytics console.