Posted On: Apr 21, 2023
Today, we are announcing the general availability of Apache Kafka receiver and exporter in AWS Distro for OpenTelemetry (ADOT). ADOT is a secure, production-ready, AWS-supported distribution of the OpenTelemetry project. With this release, customers can use the ADOT collector to collect metrics and traces from Kafka and send metrics and traces to Kafka. The release includes support for Amazon Managed Streaming for Apache Kafka (MSK).
Customers can now support new use cases such as large-scale ingestion of historical data via Kafka used as a buffer (to handle backpressure) into Amazon S3, where customers can perform analytics using AWS Glue and AWS Lambda. Furthermore, customers can use the Apache Kafka support in the ADOT collector in Security Information and Event Management (SIEM) monitoring. For example, customers can buffer raw signals (metrics and traces) in Kafka for use cases such as intrusion detection and compliance enforcement.
You can configure and deploy the latest version of the ADOT collector for container services and Amazon EC2 by using AWS CloudFormation templates, the AWS Command Line Interface, kubectl commands, or the ADOT EKS add-on.
Visit our developer portal to learn more about ADOT and download the latest release.