Posted On: May 31, 2023
Today, AWS announces the Amazon EventBridge open-source connector for Apache Kafka Connect. This connector allows you to integrate EventBridge into Kafka Connect environments to deliver events from Kafka topics to EventBridge Event Buses. It also includes useful features, such as schema registry support for Avro, Protobuf, and JSON, consuming from multiple Kafka topics, and IAM role-based authentication.
Amazon EventBridge is a serverless event bus service that enables you to create scalable event-driven applications by routing events between your own applications, third-party SaaS applications, and other AWS services. The new EventBridge connector makes it easy for Kafka Connect users to filter and react to business-critical events from Kafka, and enables seamless delivery to more than 35 supported targets and partner integrations in EventBridge without writing integration code. Additional use cases include delivering events from Kafka to multiple business units via bus-to-bus routing, streaming events from on-premises environments for data replication or during cloud migrations, and to easily invoke cross-account or cross-region targets. The new EventBridge connector can be deployed on Apache Kafka Connect installations, including Amazon MSK Connect.
To get started with the connector, download the latest release from the Github repository, add it to the Kafka Connect plugin directory path, and create the connector using the Kafka Connect Rest API. If you are using Amazon MSK, refer to the developer guide to create a custom connector. To get started with Amazon EventBridge, visit our documentation.