Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

Skip to main content

Amazon SageMaker Data Processing

Amazon SageMaker Data Processing FAQs

Page topics

General
3
Migration and access
3
Pricing
1

General

Open all

SageMaker Data Processing analyzes, prepares, integrates and orchestrates your data with processing capabilities from Amazon Athena, Amazon EMR, AWS Glue, and Amazon Managed Workflows for Apache Airflow (Amazon MWAA). You can use open source data-processing frameworks such as Apache Spark, analyze data at scale with Trino, and seamlessly build real-time analytics with Apache Flink and Apache Spark.

SageMaker Data Processing brings together Amazon EMR, Athena, AWS Glue, and Amazon MWAA.

SageMaker Data Processing helps you explore data, build data-transformation jobs, orchestrate, and deploy data pipelines at scale. It improves performance, driving faster insights than traditional open source systems with cost-effective and open source API-compatible versions of Apache Spark, Apache Airflow, Apache Flink, Trino, and more. SageMaker Data Processing provides access to your data sources in Amazon SageMaker Lakehouse through zero-ETL integrations, federated querying capabilities, and connectors.

Migration and access

Open all

No, you do not need to migrate to SageMaker. You can continue to use Amazon EMR, Athena, AWS Glue, and Amazon MWAA as you do today. However, we recommend that you get started with SageMaker to use unified tooling, built-in data governance, and simplified SageMaker Lakehouse architectures.

There is no impact to current code, queries, jobs, and other resources that you’ve created and used with Amazon EMR, Athena, or AWS Glue. You can continue to use these services for new workloads, if you prefer. Resources created in these services, such as Amazon EMR on Amazon Elastic Compute Cloud (Amazon EC2) clusters, are visible in SageMaker to simplify the development of analytics and AI applications. Existing development experiences built into Amazon EMR, AWS Glue, and Athena will continue to exist in addition to a new development experience within SageMaker.

The latest version of AWS Glue, AWS Glue 5.0, is available in SageMaker. AWS Glue 5.0 accelerates data-processing workloads and delivers the latest performance-optimized Apache Spark 3.5.2 runtime so you can develop, run, and scale for faster insights. To learn more, visit AWS Glue.

Pricing

Open all

Each AWS service that you use through SageMaker is subject to its own individual pricing. For more details, please consult the AWS pricing page for Athena, Amazon EMR, AWS Glue, and Amazon MWAA.