Amazon CloudWatch Application Signals now supports Amazon Bedrock
Amazon CloudWatch Application Signals now supports Amazon Bedrock, enabling users to troubleshoot errors and slow performance in generative AI applications. Amazon Bedrock is a fully managed service that offers foundation models (FMs) built by leading AI companies, such as Anthropic, Meta, and Amazon along with other tools for building generative AI applications. For users with generative AI applications relying on Bedrock FMs, this enhancement provides a deeper understanding of how failures such as model validation exceptions or how latency in different models impact end user experience.
Application Signals, provides out-of-the-box dashboards to correlate telemetry across metrics, traces, logs, real-user monitoring, and synthetic monitoring for your application and its dependencies, such as Amazon Simple Queue Service (SQS), Amazon S3, or Amazon Bedrock, speeding up troubleshooting application disruption. For example, an application developer operating an LLM (Large Language Model) application that invokes Bedrock FMs can track if their customer support API is experiencing any issues. They can then drill into the precisely correlated trace contributing to the error, along with correlated logs, to establish the root cause, such as invalid model inputs or long response times from LLM models, leading to poor end user experience. Tracking model performance within your application allows you to evaluate different models and choose the best one for your use case, optimizing for cost and customer experience.
To learn more, see documentation to enable Amazon CloudWatch Application Signals on your applications interacting with Amazon Bedrock models. To try Application Signals on a sample application visit AWS One Observability Workshop.