Author: Darragh O’Flanagan

Achieving “speed of thought” or instant analytics on large data sets is a key challenge for business intelligence platforms. Traditionally, data engineers would design and deliver an optimized, aggregated subset of the data to a data warehouse to drive the visualization. This can often take weeks of development and testing or incur significant infrastructure costs. Learn how Indexima uses machine learning and hyper indexes to automate this process and accelerate analytics by up to 1000x across a full data set on Amazon S3.

Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed, highly available, and secure Apache Kafka service that makes it easy to build and run applications that use Kafka to process steaming data. Learn how to use the new open source Kafka Connect Connector (StreamReactor) from Lenses.io to query, transform, optimize, and archive data from Amazon MSK to Amazon S3. We’ll also demonstrate how to use Amazon Athena to query the partitioned parquet data directly from S3.