AWS Big Data Blog

Category: Announcements

Multi-statement transactions for Apache Iceberg tables in Amazon Redshift

Multi-statement transactions for Apache Iceberg tables in Amazon Redshift

Amazon Redshift now supports multi-statement transactions for Apache Iceberg tables, so you can run several DML statements against one Iceberg table inside a single BEGIN…COMMIT and publish them as one atomic Iceberg snapshot. This post explains why one commit per statement makes multi-step pipelines fragile, what you can run in a transaction, and how it performs.

Amazon Athena introduces system tables for query execution observability

Amazon Athena introduces system tables for query execution observability

Amazon Athena now offers system tables: SQL-queryable, per-query execution metadata stored as Apache Iceberg in your own account. This post walks through what system tables are, how to turn them on, and how to use them for usage analysis, cost attribution, performance trends, audit, and capacity optimization without custom pipelines.

Implement least-privilege access with designations in Amazon SageMaker Unified Studio

Implement least-privilege access with designations in Amazon SageMaker Unified Studio

Amazon SageMaker Unified Studio now offers designations: named permission sets that give administrators granular, least-privilege control over what each project member can do. Learn how designations work and how to create and assign your first one from the console and the AWS CLI.

Introducing time series collections for the next generation of Amazon OpenSearch Serverless

Introducing time series collections for the next generation of Amazon OpenSearch Serverless

The next generation of Amazon OpenSearch Service serverless now supports time series collections. Define the boundaries for cost, performance, security, access, and data retention using simple controls for data tiering, time field selection, and data retention, then turn raw events into insights with the next-generation OpenSearch UI.

Build RAG-ready indexes from Amazon S3 with Amazon OpenSearch intelligent ingestion

Build RAG-ready indexes from Amazon S3 with Amazon OpenSearch intelligent ingestion

Amazon OpenSearch intelligent ingestion is a fully managed, serverless capability that turns documents and structured data in Amazon S3 into RAG-ready, searchable indexes with no pipelines to manage. Learn how it works and when to use Ingestion Jobs or Ingestion Streams.

Enable cross-Region fine-grained data access with AWS Lake Formation and Trusted Identity Propagation

Enable cross-Region fine-grained data access with AWS Lake Formation and Trusted Identity Propagation

Trusted Identity Propagation with AWS IAM Identity Center now works across Regions. Learn how to share AWS Lake Formation-governed Amazon S3 and Amazon Redshift data in one Region and query it from another as the actual corporate user, with fine-grained access control and per-user auditability in AWS CloudTrail.

Resolving concurrent write conflicts for Apache Iceberg tables in Amazon Redshift

Resolving concurrent write conflicts for Apache Iceberg tables in Amazon Redshift

Amazon Redshift now automatically resolves many concurrent writes to Apache Iceberg tables that don’t actually overlap, committing changes that previously failed and had to retry. Learn why these writes conflict, how the engine rebases non-overlapping ones across operation, partition, and file checks, and the throughput gains it delivers.