Posted On: Nov 14, 2023

Amazon EventBridge Pipes now supports logging to Amazon CloudWatch Logs, Amazon Simple Storage Service (Amazon S3), and Amazon Kinesis Data Firehose. You can now more easily determine whether integration issues occured at the source, target, or the intermediary transformation and enrichment stages, customize the verbosity of your logs by selecting one of three log levels (error, info, and trace), and optionally choose to include event payloads, service requests, and service responses in your logs. Support for logs in Pipes provides improved observability for event-driven architectures, and enables you to troubleshoot issues faster.

Amazon EventBridge Pipes provides a simpler, consistent, and cost-effective way to create point-to-point integrations between event producers and consumers to build event-driven architectures. You can use Pipes to connect your applications with data from sources including Amazon SQS, Amazon Kinesis Data Streams, Amazon DynamoDB, Amazon Managed Streaming Kafka, self-managed Kafka, and Amazon MQ. EventBridge Pipes supports the same 20+ targets as the EventBridge Event Bus, such as Amazon SQS, Amazon Kinesis Data Streams and Firehose, AWS Step Functions, Amazon SNS, Amazon ECS, and event buses themselves. Today’s release of logging functionality enhances the CloudWatch metrics already available in Pipes, further removing the need to write, manage, and scale undifferentiated integration and observability code so you spend your time building your applications rather than connecting them.

Learn more by reading our blog post on how logging for Amazon EventBridge Pipes can help you more easily build event-driven Architectures, or, click "Pipes” in the Amazon EventBridge console to get started.