AWS Storage Blog
Category: News
Accelerate file workload performance with second-generation Amazon FSx for NetApp ONTAP file systems
Supporting file-based workloads with growing performance demands over time is a continuous challenge for organizations. As datasets expand, static infrastructure struggles to keep pace, resulting in disruptive migrations to new infrastructure. Organizations need highly scalable file storage that delivers speed at-scale today, while adapting seamlessly to future requirements. Amazon FSx for NetApp ONTAP provides fully […]
Achieving consistent time to first byte latencies with Amazon S3 on Outposts
With the rise in data sovereignty and privacy regulations, organizations are seeking flexible solutions that balance compliance with data sovereignty regulations and the agility of the cloud. For example, to comply with data sovereignty regulations, users in the financial and healthcare industries need to deploy applications on premises and store data locally. To provide the […]
Implementing AWS DataSync with hundreds of millions of objects
Moving large volumes of data across your hybrid cloud environments can seem like a daunting task, especially when dealing with a litany of requirements that arise when working within the technical limits of network, storage, compute, and operating system layers, both on-premises and in the cloud. Users face additional challenges when balancing their Recovery Time […]
Amazon S3 Express One Zone delivers cost and performance gains for ChaosSearch customers
ChaosSearch is an Amazon S3-native database built on a serverless, stateless compute architecture within AWS that delivers live search, SQL, and Generative AI analytics. At ChaosSearch, the speed and performance of our architecture is important to us and our customers because time to results is the difference between success and failure, and we rely on […]
Akridata accelerates processing of unstructured data with Amazon S3 Express One Zone
Deep learning processes often need to read full datasets, which are usually hundreds of gigabytes in size, before they can perform intelligent data processing. High data retrieval speed and low latency from storage are crucial for enterprises running these performance-critical workloads. Akridata, an AWS independent software vendor (ISV) partner, helps make artificial intelligence (AI)-assisted unstructured-data […]
lakeFS and Amazon S3 Express One Zone: Highly performant data version control for ML/AI
Machine learning presents a number of new challenges to data teams, calling for technology solutions that can support training and fine-tuning performance-critical workloads with high performance. Data version control is one of the facets of high-performing ML pipelines, as it allows efficient experimentation and full ML pipeline reproducibility at scale. lakeFS by Treeverse, an AWS […]
ClickHouse Cloud & Amazon S3 Express One Zone: Making a blazing fast analytical database even faster
ClickHouse is a columnar database management system (DBMS) designed for blazing-fast real-time analytics. It was built to address the needs of interactive analytical applications requiring up-to-the-second analytics. To do that, it must support real-time data ingestion at the rate of hundreds of millions of events per second and run complex analytical queries, such as filtering, […]
Streamline data sharing and access control with Informatica Cloud Data Marketplace and Amazon S3 Access Grants
Organizations are modernizing their data lakes on Amazon Simple Storage Service (Amazon S3) to handle the ever-growing data volume and speed while meeting the demands of analytics, machine learning (ML), artificial intelligence (AI), and generative AI applications. To enable a data-driven culture and remain innovative, the data platform must allow for data-centric collaboration across business […]
How to develop a user-facing data application with IAM Identity Center and S3 Access Grants (Part 2)
This post is Part 2 of a two-part blog post series that will take you, an application developer, through the process of configuring and developing a data application that authenticates users with Microsoft Entra ID and then uses S3 Access Grants to access data on those users’ behalf. Part 1 of this series gave an […]
How to develop a user-facing data application with IAM Identity Center and S3 Access Grants (Part 1)
This is Part 1 of a two-part blog series: Configuring the application. Here is Part 2: Developing the application. When we at AWS talk to our customers about their data lakes, they usually describe a desired access pattern in which users and groups from a corporate directory are granted access to datasets in Amazon Simple […]