AWS Storage Blog

Category: Storage

Optimizing SAS Grid on AWS with Amazon FSx for Lustre

Many customers run complex analytics and high performance SAS-based applications on premises using the SAS Grid platform to perform large-scale analytics. Customers with a strategy to move to open-source or cloud-native solutions will often consider refactoring applications to Python or R to lower their total cost of ownership, however refactoring these applications as part of […]

CloudEndure-AWS-Storage-Blog

Achieving data consistency with AWS Elastic Disaster Recovery

When designing a disaster recovery (DR) plan, data consistency is an important factor to consider. This is especially important when protecting certain database applications, such as Microsoft SQL, Oracle, and SAP Hana. These database workloads must be restored to a consistent state to avoid database corruption. Failing to do so could result in loss of […]

Amazon EBS

AWS SAN in the Cloud: Millions of IOPs and tens of GB/s to any Amazon EC2 instance

Over the years, traditional on-premises applications have relied on ever more powerful (and expensive) storage arrays to scale application IO performance and provide a single server with millions of IOPs. Meanwhile, AWS was perfecting the art of linear, elastic horizontal scalability of storage performance in the cloud. Until now, it’s been difficult to meet the […]

S3 Intelligent-Tiering featured image

How CineSend manages their media content using S3 Intelligent-Tiering

Is your organization managing terabytes (or even petabytes) of data stored as objects across hundreds if not thousands of buckets on Amazon S3? What are the chances that the access patterns and application requirements for all of these objects are the same? For most companies out there – slim to none. We operate in a […]

Amazon S3 Storage Lens featured image

Access your Amazon S3 Storage Lens metrics in AWS Partner applications

Managing cloud storage at scale requires the right metrics and tools to maintain visibility into your storage footprint, and uncover opportunities to reduce storage costs or apply data protection best practices. With the launch of S3 Storage Lens in November 2020, customers gained access to the first cloud storage analytics solution offering organization-wide visibility into […]

AWS Transfer Family Featured Image

Enabling user self-service key management with AWS Transfer Family and AWS Lambda

Customers who use the AWS Transfer Family service are typically exchanging files with their business partners who provide them with SSH public keys. In a large-scale deployment of the AWS Transfer Family service, public key management eventually becomes a time-consuming task to refresh expired keys and rotate keys for security. When using custom identity providers (custom IdP), […]

Amazon S3 Object Lambda

Automate the configuration of Amazon S3 Object Lambda to process data as its retrieved

Customers often have multiple applications consuming information from a single dataset stored in Amazon S3, but each application requires different variations to meet their specific needs. For example, one application may require that data be in a redacted CSV format, while another application requires unredacted information. As another example, a stock image website may require […]

How Pinterest uses Amazon S3 Glacier Deep Archive to manage storage for its visual discovery engine

Pinterest is the visual discovery engine with a mission to bring everyone the inspiration to create a life they love. It’s one of the biggest datasets of ideas ever assembled online, with over 300 billion Pins with ideas around home, food, style, beauty, travel, and more. More than 440 million people around the world use […]

Amazon EBS

Optimizing SAP HANA’s persistence layer with Amazon EBS gp3 volumes

SAP HANA is an in-memory, relational database which enterprises rely on to run their mission critical Enterprise Resource Planning (ERP) systems and analytical applications. As SAP HANA is an in-memory database, you may wonder why the storage layer is relevant. A key point is that memory is volatile. When you write data to a HANA […]

Amazon S3 Lifecycle

Automate S3 Lifecycle rules at scale to transition data to S3 Intelligent-Tiering

The vast majority of data customers store on Amazon S3 has unknown or changing access patterns, such as data lakes, analytics, and new applications. With these use cases, a dataset can become infrequently and even rarely accessed at specific points in time. The problem is that customers don’t know how data access patterns will change […]