Category: Amazon Simple Storage Service (S3)

Customer Story | Amazon S3 Tables – Learn how Tubular Labs (part of Chartbeat Inc.) reclaimed 50% of engineering capacity by replacing fragile, file-based data pipelines with a Common Pipeline Runtime (CPR) built on Apache Iceberg and Amazon S3 Tables. By Tubular Labs Engineering (part of Chartbeat Inc.), in collaboration with the AWS Solution Architecture team […]

As your Spark datasets grow, storage latency often becomes the constraint, impeding application performance. Query runtimes stretch, and the bottleneck shifts from compute to how fast each node can read from Amazon Simple Storage Service (Amazon S3). We benchmarked this directly on Amazon EMR with TPC-DS at 3 TB scale. On an 8-node Graviton4 cluster […]

Organizations that replicate data across storage locations for disaster recovery, compliance, or analytics need a way to detect when replication stalls, because without early warning, unreplicated objects accumulate silently and drive unexpected storage costs. Most teams rely on automated retention policies to clean up the source copy after a defined period, but when replication breaks […]

Nearmap captures high-resolution aerial imagery across populated areas of the United States, Canada, Australia, and New Zealand several times a year, at resolutions as fine as 1.5 inches. More than 10,000 customers globally use these images to assess insurance portfolios, size solar arrays, and track construction sites. Since 2007, Nearmap has completed more than 35,000 […]

With the introduction of AWS European Sovereign Cloud, organizations across Europe are adopting this dedicated partition to meet stringent data sovereignty requirements. However, organizations face significant operational challenges because they must maintain their existing AWS commercial partition deployments for global customers while simultaneously establishing AWS European Sovereign Cloud infrastructure. This dual-partition reality can cause data […]

​​​​Organizations are moving beyond single-model AI toward multi-agent architectures. In these systems, agents offload intermediate results to files rather than carrying everything in the prompt, because a large prompt inflates cost and degrades quality. A model’s context window is finite, so files become working memory that persists after a session ends. In multi-agent systems, a […]

WeatherBug is the third largest weather intelligence company in the US, delivering real-time forecasts, radar, lightning alerts, and interactive maps to over 10 million users. As their data footprint has grown across hundreds of Amazon Simple Storage Service (Amazon S3) buckets in a multi-account AWS environment, their storage costs rose steadily with no clear visibility […]

AWS Backup for Amazon S3 now lets you access your backup data through Amazon S3 Access Points. You create an access point for a recovery point, and AWS Backup provisions an S3 endpoint with an alias that works anywhere you would use a bucket name. You can then read backup data using standard S3 APIs, […]

Organizations that store sensitive data need to answer a simple question: where did this data come from, and what happened to it? In healthcare, this isn’t optional. Regulations like HIPAA, GDPR, and SOX require organizations to produce this information on demand. When an auditor asks, for example, “Show me every transformation that touched patient record […]

Customers managing large volumes of objects in Amazon Simple Storage Service (Amazon S3) often need to attach rich business context like compliance classifications, processing lineage, AI-generated labels, and more. Until now, this context lived in external databases or sidecar files that were stored as separate objects, which created complexity to manage and keep it up […]