AWS Storage Blog
Category: Learning Levels
Monitor Amazon S3 activity using S3 server access logs and Pandas in Python
Monitoring and controlling access to data is often essential for security, cost optimization, and compliance. For these reasons, customers want to know what data of theirs is being accessed, when it is being accessed, and who is accessing it. With more data to monitor, large amounts of data can make it more challenging to granularly […]
Collecting, archiving, and retrieving surveillance footage with AWS
Video feeds and still images from judiciary locations are considered critical forms of evidence in the court of law. These locations can be police stations and government offices or even civil locations of importance like banks and hospitals. As governments, particularly in smart cities rely upon video surveillance, it is critical to design a cost […]
Point-in-time restore for Amazon S3 buckets
Enterprises store increasing quantities of object data for use cases like data lakes, document management systems, and media libraries. Performing point-in-time restores for large datasets can be challenging, as existing approaches with full-restore from backup are time consuming and expensive. Alternatively, restoring individual objects to previous versions is prone to errors and delays the restore […]
AWS Storage Gateway in 2021 – Year in Review
It has become customary for us to share with our customers the new AWS Storage Gateway enhancements every year. As we did in 2020 and 2019, through this blog I’m reviewing all the new Storage Gateway launches from 2021. I’ll cover how the new enhancements make it easier for customers to access AWS Storage from […]
Mount Amazon EFS file systems cross-account from Amazon EKS
Many customers use multiple AWS accounts managed by AWS Organizations to create security and cost boundaries around business units, projects, or applications. AWS Organizations helps you centrally manage and govern your environment as you grow and scale your AWS resources. In some cases, an application in one AWS account must access data in another. As […]
Achieving data consistency with AWS Elastic Disaster Recovery
When designing a disaster recovery (DR) plan, data consistency is an important factor to consider. This is especially important when protecting certain database applications, such as Microsoft SQL, Oracle, and SAP Hana. These database workloads must be restored to a consistent state to avoid database corruption. Failing to do so could result in loss of […]
AWS SAN in the Cloud: Millions of IOPs and tens of GB/s to any Amazon EC2 instance
Over the years, traditional on-premises applications have relied on ever more powerful (and expensive) storage arrays to scale application IO performance and provide a single server with millions of IOPs. Meanwhile, AWS was perfecting the art of linear, elastic horizontal scalability of storage performance in the cloud. Until now, it’s been difficult to meet the […]
How CineSend manages their media content using S3 Intelligent-Tiering
Is your organization managing terabytes (or even petabytes) of data stored as objects across hundreds if not thousands of buckets on Amazon S3? What are the chances that the access patterns and application requirements for all of these objects are the same? For most companies out there – slim to none. We operate in a […]
Access your Amazon S3 Storage Lens metrics in AWS Partner applications
Managing cloud storage at scale requires the right metrics and tools to maintain visibility into your storage footprint, and uncover opportunities to reduce storage costs or apply data protection best practices. With the launch of S3 Storage Lens in November 2020, customers gained access to the first cloud storage analytics solution offering organization-wide visibility into […]
Enabling user self-service key management with AWS Transfer Family and AWS Lambda
Customers who use the AWS Transfer Family service are typically exchanging files with their business partners who provide them with SSH public keys. In a large-scale deployment of the AWS Transfer Family service, public key management eventually becomes a time-consuming task to refresh expired keys and rotate keys for security. When using custom identity providers (custom IdP), […]