AWS Storage Blog

Hi, I’m Buckets. The official AWS Storage mascot, self-appointed guardian of all things durable, scalable, and correctly permissioned. I’ve attended every re:Invent since 2006, and I have never once missed a storage breakout session. Not even the one scheduled at 8am on a Friday. Some call it dedication. I call it having strong consistency. re:Invent […]

In today’s cloud-first environment, protecting file storage systems against malware threats is a critical component of any robust security strategy. Amazon FSx for Windows File Server (FSx for Windows) delivers enterprise-grade Windows file storage in AWS, combining the reliability of fully managed services with native Windows file sharing capabilities. Built on Microsoft Windows file system […]

Organizations rely on file storage accessed from traditional, file-based, applications while simultaneously wanting to build modern, cloud-native applications and services that access the same underlying data. Consequently, many cloud-native apps are built to work with Amazon S3. Amazon Web Services (AWS) recently introduced a new capability, S3 Access Points for Amazon FSx which solves challenges […]

Organizations are rapidly adopting Apache Iceberg for their data lakes because it supports petabyte-scale growth and performance with the flexibility to evolve schemas and partitions without costly rewrites. Its architecture enables modern data lake management via features like time travel and incremental processing. However, managing Iceberg datasets efficiently can become a challenge over time as […]

Allcargo Global (Allcargo) is a powerhouse in integrated logistics that drives seamless supply chain solutions through its key subsidiaries—ECU Worldwide, the world’s largest LCL consolidator with presence in over 180 countries. They offer end-to-end logistics powered by digital platforms such as ECU360, ensuring speed, visibility, and efficiency across borders. With a strong focus on innovation […]

Every day, AWS customers process millions of compressed files in Amazon S3, from small ZIP archives to multi-gigabyte datasets. While decompressing a single file is straightforward, processing thousands of files efficiently requires complex orchestration, error handling, and infrastructure management. Consider this scenario: Your organization receives over 10,000 compressed files daily from partners, ranging from 5 […]

Modern containerized applications running on Kubernetes enable organizations to deploy read-heavy workloads—such as machine learning inference, data analytics, and High Performance Computing (HPC)—at unprecedented scale. However, when multiple pods on the same node need to access identical datasets, a performance challenge emerges. Each pod typically fetches files from external storage independently over the network. This […]

State-of-the-art AI agents rely on external tools to perform actions on their behalf. A tool is a function with a clear description, defined inputs, and outputs that extend the capabilities of a large language model (LLM). As toolkits expand, selecting the right tool for each task requires effective mechanisms, among which semantic search enables agents […]

Maintaining resiliency and operational clarity while keeping costs low is one of the key things our customers have to balance for their high-performance applications. As customers experience natural growth in capacity and performance needs, at some point they may hit the limits of the existing solutions and have to rethink their architecture. They can do […]

Operational excellence isn’t just about efficiency—it’s about delivering consistent availability when customers need it most. Achieving this requires sophisticated, real-time monitoring that tracks key system metrics and storage insights, such as throughput patterns, IOPS utilization, I/O characteristics, and storage distribution. This visibility enables teams to resolve issues proactively, right-size resources, optimize workload placement, and plan […]