Why can't I see the instance metrics for my Amazon SageMaker endpoint though I can see the invocation metrics?

Last updated: 2022-06-03

I can see invocation metrics for my Amazon SageMaker endpoint in Amazon CloudWatch. However, instance metrics such as CPUUtilization, MemoryUtilization, and DiskUtilization are missing.

Resolution

This happens when the execution role for Amazon SageMaker doesn't have the PutMetricData permission for CloudWatch. To resolve the issue, add "cloudwatch:PutMetricData" to the AWS Identity and Access Management (IAM) policy that's attached to the execution role.

To send instance metrics to CloudWatch, instances must assume the execution role. That's why the PutMetricData permission is required for instance metrics.

Monitor Amazon SageMaker with Amazon CloudWatch

SageMaker roles

Did this article help?

Submit feedback

Do you need billing or technical support?

Contact AWS Support