Amazon Aurora PostgreSQL zero-ETL integration with Amazon Redshift now generally available

Posted on: Oct 15, 2024

Now generally available, Amazon Aurora PostgreSQL zero-ETL integration with Amazon Redshift enables near real-time analytics and machine learning (ML) using Amazon Redshift to analyze petabytes of transactional data from Aurora. Within seconds of transactional data being written into Amazon Aurora PostgreSQL-Compatible Edition, zero-ETL seamlessly makes the data available in Amazon Redshift, removing the need to build and manage complex data pipelines that perform extract, transform, and load (ETL) operations. Aurora PostgreSQL zero-ETL integration with Amazon Redshift is available for Aurora provisioned clusters and Amazon Aurora Serverless v2 clusters. Zero-ETL integration can be used to send data to Amazon Redshift Serverless workgroups and Amazon Redshift provisioned clusters using RA3 instance types.

Zero-ETL integration provides expanded logical replication support for Data Definition Language (DDL) events and data types, including The Oversized-Attribute Storage Technique (TOAST) support. You can replicate data from multiple logical Aurora PostgreSQL databases using a single zero-ETL integration. Data filtering capabilities allow you to specify resources to replicate at the database, schema, or table level. Enhance your data analysis with the rich analytical capabilities of Amazon Redshift, including high-performance SQL, built-in ML and Spark integrations, materialized views, data sharing, data masking, and direct access to multiple data stores and data lakes. Automatically deploy and manage zero-ETL integrations using AWS CloudFormation.

Aurora PostgreSQL zero-ETL integration with Amazon Redshift is available for Aurora PostgreSQL version 16.4 and higher. You can create and manage integrations using the AWS Management Console, the AWS Command Line Interface (CLI), or the Amazon Relational Database Service (Amazon RDS) API in the US East (N. Virginia), US East (Ohio), US West (Oregon), Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm) Regions.

To learn more, visit Aurora zero-ETL integration with Amazon Redshift and the getting started guides for Aurora and Amazon Redshift.