Posted On: Mar 22, 2024

Amazon Managed Streaming for Apache Kafka Connect (Amazon MSK Connect) now supports the ability to delete MSK Connect worker configurations, tag resources, and manage worker configurations and custom plugins using AWS CloudFormation. Amazon MSK Connect is a fully managed service for Apache Kafka Connect. With a few clicks, MSK Connect allows you to easily deploy connectors that move data between Apache Kafka and external systems. Together, these new capabilities make it easier for you to manage your MSK Connect resources and automate deployments through CI/CD pipelines. 

When you deploy a connector on MSK Connect, you have to either use the default worker configuration or provide custom worker configuration. As you create and delete connectors, these configurations can grow in number and become difficult to manage. The new delete worker configuration API allows you to delete unused worker configurations to make resource management easier. With resource tagging, you can assign tags in the form of key-value pairs to MSK Connect connectors, custom plugins, or worker configurations. Tagging can help you with resource grouping, cost allocation and reporting, and access control with tag-based policies. Lastly, support for additional AWS CloudFormation resource types allows you to perform Create, Read, Update, Delete and List operations on custom plugins and worker configurations besides connectors.

These capabilities are available in all the AWS regions where Amazon MSK Connect is available. To see all the regions where Amazon MSK Connect is available, see the AWS Region table. To learn more, visit Amazon MSK Connect Developer Guide.