AWS Glue Usage Profiles is now generally available

Posted on: Jun 18, 2024

Today, AWS announces general availability of AWS Glue Usage Profiles, a new cost control capability that allows admins to set preventatives controls and limits over resources consumed by their Glue jobs and Notebook sessions. With AWS Glue Usage Profiles, admins can create different cost profiles for different classes of users. Each profile is a unique set of parameters that can be assigned to different types of users. For example, a cost profile for data engineer working on production pipeline could have unrestricted number of workers whereas the cost profile for a test user could have a restricted number of workers.

You can get started by creating a new usage profile with AWS Glue Studio console or by using the Glue Usage Profiles APIs. Next, you assign that profile to an IAM user or role. After following these steps, all new Glue jobs or sessions created with that particular IAM user or role, will have the limits specified in the assigned usage profile.

The feature is available in all regions where AWS Glue is available. Access the AWS Regional Services List for the most up-to-date availability information.

To learn more, visit our documentation or blog post.