AWS Storage Blog

Category: Advanced (300)

How Proscia built unlimited observability with Amazon S3 and the Altinity Kubernetes Operator

How Proscia built unlimited observability with Amazon S3 and the Altinity Kubernetes Operator

Observability can claim a growing share of IT budgets. Learn how Proscia, a pathology AI company, built a self-hosted observability platform on Amazon S3, Amazon EKS, and ClickHouse managed by the Altinity Kubernetes Operator, achieving unlimited telemetry retention at object-storage cost under HIPAA, GDPR, and data-residency requirements.

Updating encryption on existing Amazon S3 objects with S3 Batch Operations

Updating encryption on existing Amazon S3 objects with S3 Batch Operations

Large organizations accumulate billions of Amazon S3 objects under different encryption configurations. Learn how to use S3 Batch Operations with the new UpdateObjectEncryption API to standardize encryption across an entire bucket at scale. The approach moves objects from SSE-S3 to SSE-KMS in place, with no data movement and without breaking S3 Lifecycle policies.

Preserve FlexClone space efficiency when migrating to Amazon FSx for NetApp ONTAP

What happens when you need to migrate between separate ONTAP file systems but have multiple long-lived clones? Whether you are moving from on-premises NetApp to Amazon FSx for NetApp ONTAP, between FSx file systems, or across AWS accounts, preserving these clone relationships becomes critical. Standard file-based migration tools like rsync, robocopy, or AWS DataSync have […]

Adopt AWS Backup policies at enterprise scale using AWS Organizations

Consider a platform team responsible for data protection across a large, regulated enterprise. Over years of growth, the organization now runs hundreds of Amazon Web Services (AWS) accounts across many teams and AWS Regions, and each team has configured its own backup approach. The platform team now faces a familiar challenge: how to enforce consistent, […]

Running Apache Kafka with Amazon S3 Files

S3 Files is a shared file system that connects any AWS compute directly with your data in Amazon S3. It provides fast, direct access to all of your S3 data as files with full file system semantics and low-latency performance, without your data ever leaving S3. That means file-based applications, agents, and teams can now access and work with S3 data as a file system using the tools they already depend on.

Secure team file sharing on Amazon WorkSpaces with Amazon EFS

As more organizations move to remote and distributed work, builders and development teams face growing challenges in sharing files securely. Without a central file system, these teams deal with version control problems, unclear access permissions, and security risks from scattered storage locations. Central IT becomes a bottleneck when handling every permission change, yet granting full […]

Amazon S3 Tables

How Tubular Labs reclaimed 50% of engineering capacity by rebuilding their 70TB pipeline on Apache Iceberg and Amazon S3 Tables

Customer Story | Amazon S3 Tables – Learn how Tubular Labs (part of Chartbeat Inc.) reclaimed 50% of engineering capacity by replacing fragile, file-based data pipelines with a Common Pipeline Runtime (CPR) built on Apache Iceberg and Amazon S3 Tables. By Tubular Labs Engineering (part of Chartbeat Inc.), in collaboration with the AWS Solution Architecture team […]

Migrate VMware Storage to Amazon FSx for NetApp ONTAP using AWS Transform

Enterprise storage underpins every critical workload in a VMware environment. It’s not just capacity, it’s the operational backbone that delivers automatic failover, instant snapshots, writable clones, inline deduplication, and multi-protocol access that production applications depend on every day. When the time comes to migrate these workloads to the cloud, teams expect those same capabilities on […]

Amazon S3 Express One Zone thumbnail

Run Spark 31% faster and optimize compute costs with Amazon S3 Express One Zone on Amazon EMR

As your Spark datasets grow, storage latency often becomes the constraint, impeding application performance. Query runtimes stretch, and the bottleneck shifts from compute to how fast each node can read from Amazon Simple Storage Service (Amazon S3). We benchmarked this directly on Amazon EMR with TPC-DS at 3 TB scale. On an 8-node Graviton4 cluster […]

Detect stalled Amazon S3 live replication to prevent unexpected storage costs

Organizations that replicate data across storage locations for disaster recovery, compliance, or analytics need a way to detect when replication stalls, because without early warning, unreplicated objects accumulate silently and drive unexpected storage costs. Most teams rely on automated retention policies to clean up the source copy after a defined period, but when replication breaks […]