Posted On: Sep 28, 2023
Today, AWS IoT Core a fully managed cloud service that lets you connect billions of devices and process trillions of messages, supports headers in Rules Engine’s Kafka Action. You can use Kafka headers to send additional metadata from IoT devices to a self-managed Apache Kafka cluster or Amazon Managed Streaming for Apache Kafka (Amazon MSK), without modifying the original IoT message payload.
Kafka Action is a feature in AWS IoT Core’s Rules Engine that enables you to route your IoT messages to Kafka clusters. With the new feature, you can pass additional metadata, such as a timestamp, source IP address of the publisher of an IoT message, and MQTT user properties to Kafka clusters using only headers, simplifying your developer experience by eliminating the need to embed such metadata into the actual payload. To get started, connect your IoT devices to AWS IoT Core, define an IoT Rule and a Kafka Action to route the IoT message to your Kafka cluster.
AWS IoT Core’s support for headers in Kafka Action is available in the following AWS Regions: US East (N. Virginia), US East (Ohio), US West (N. California), US West (Oregon), Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Paris), Europe (Stockholm), Middle East (Bahrain), Middle East (UAE), South America (Sao Paulo), AWS GovCloud (US-East), and AWS GovCloud (US-West).
For more information, refer to the developer guide.