AWS News Blog

Category: Storage

AWS Glue Data Catalog now supports automatic compaction of Apache Iceberg tables

Update November, 16 2023 — I added a link to the documentation with the exact IAM permissions required to use this capability. — Today, we’re making available a new capability of AWS Glue Data Catalog to allow automatic compaction of transactional tables in the Apache Iceberg format. This allows you to keep your transactional data […]

AWS Weekly Roundup

AWS Weekly Roundup – CloudFront security dashboard, EBS snapshots improvements, and more – November 13, 2023

This week, it was really difficult to choose what to recap here because, as we’re getting closer to AWS re:Invent, service teams are delivering new capabilities at an incredible pace. Last week’s launches Here are some of the launches that caught my attention last week: Amazon Aurora – Aurora MySQL zero-ETL integration with Amazon Redshift […]

New – Create application-consistent snapshots using Amazon Data Lifecycle Manager and custom scripts

Amazon Data Lifecycle Manager now supports the use of pre-snapshot and post-snapshot scripts embedded in AWS Systems Manager documents. You can use these scripts to ensure that Amazon Elastic Block Store (Amazon EBS) snapshots created by Data Lifecycle Manager are application-consistent. Scripts can pause and resume I/O operations, flush buffered data to EBS volumes, and […]

Amazon MSK to Amazon S3 architecture diagram

Amazon MSK Introduces Managed Data Delivery from Apache Kafka to Your Data Lake

I’m excited to announce today a new capability of Amazon Managed Streaming for Apache Kafka (Amazon MSK) (Amazon MSK) that allows you to continuously load data from an Apache Kafka cluster to Amazon Simple Storage Service (Amazon S3). We use Amazon Kinesis Data Firehose—an extract, transform, and load (ETL) service—to read data from a Kafka […]

New – NVMe Reservations for Amazon Elastic Block Store io2 Volumes

Amazon Elastic Block Store (Amazon EBS) io2 and io2 Block Express volumes now support storage fencing using NVMe reservations. As I learned while writing this post, storage fencing is used to regulate access to storage for a compute or database cluster, ensuring that just one host in the cluster has permission to write to the […]

AWS Weekly Roundup

AWS Weekly Roundup: Farewell EC2-Classic, EBS at 15 Years, and More (Sept. 4, 2023)

Last week, there was some great reading about Amazon Elastic Compute Cloud (Amazon EC2) and Amazon Elastic Block Store (Amazon EBS) written by AWS tech leaders. Dr. Werner Vogels wrote Farewell EC2-Classic, it’s been swell, celebrating the 17 years of loyal duty of the original version that started what we now know as cloud computing. […]