AWS Storage Blog
Category: Technical How-to
Building a central asset register with Amazon S3 Inventory
UPDATE 7/12/2022: Amazon SQS policy updated to support every AWS Region (step 3 in the architecture diagram) in the central.yml template. Many AWS customers store millions of objects in their Amazon S3 buckets, due to the scalability, durability, and performance that S3 provides. Customers compelled to build an information asset register for compliance reasons or […]
Persistent storage for container logging using Fluent Bit and Amazon EFS
UPDATE 9/8/2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Logging is a powerful debugging mechanism for developers and operations teams when they must troubleshoot issues. Containerized applications write logs to standard output, which is redirected to local ephemeral storage, by default. These logs are lost when the container is terminated […]
Building an IoT solution at the edge with AWS Snowcone
UPDATE: The second blog post in this two-post series was published on January 5, 2020. Internet of Things (IoT) applications, like other applications, require edge solutions to operate in austere conditions with limited network connectivity or limited infrastructure. IoT applications at the edge can span numerous uses, like automation, optimization, and intelligent manufacturing to name […]
Automating shadow copies configuration on Amazon FSx for Windows File Server
We often hear from customers that they love the self-service, fine-grained file restore capability of the shadow copies feature on Amazon FSx for Windows File Server Filer Server (Amazon FSx). Our customers also relay to us the convenience of being able to schedule shadow copies on file systems using PowerShell commands. However, enabling Windows shadow […]
OpenGamma improves security and reduces overhead using AWS Transfer Family
OpenGamma provides hosted analytics services to derivative-trading firms in the financial services industry. These firms often face the challenge of adapting to new regulatory standards. Since 2008, new regulation has aimed to improve global financial stability by increasing the requirements on firms to post margin in order to protect against default and systemic failure. As […]
Using VPC hosted endpoints in shared VPCs with AWS Transfer Family
AWS customers can now deploy AWS Transfer Family server endpoints in Amazon Virtual Private Clouds (Amazon VPCs) with shared resources. Amazon Virtual Private Cloud (VPC) sharing, which launched in early 2019, enables AWS customers to share specific resources with other AWS accounts within the same AWS Organization. VPC sharing benefits customers by enabling: Role-based separation […]
Processing file upload notifications from AWS Storage Gateway on Amazon S3
AWS customers often perform post-upload processing on groups of files transferred by AWS Storage Gateway from on premises to Amazon S3. Before now, they have been unable to reliably initiate this downstream processing based on individual file upload events. Today, we are launching a new AWS Storage Gateway feature, for File Gateway, which enables customers […]
Enhance privacy controls with access-based enumeration for File Gateway
Customers are responding to the growth of unstructured data by using hybrid cloud storage to reduce cost, operational burden, and to access elastic scaling on demand. As data continues to grow in volume and variety, customers must also ensure they are meeting their requirements for privacy and security controls to restrict access and visibility of […]
Enable password authentication for AWS Transfer Family using AWS Secrets Manager (updated)
This blog post was published as an update to another blog post, “Enable password authentication for AWS Transfer for SFTP using AWS Secrets Manager.” Update (1/25/2023): The format used for the AWS Secrets Manager entry has been changed to aws/transfer/server-id/username. This brings the format in-line with the requirements for pre-defined managed workflow like PGP decryption, […]
Managing Amazon S3 access with VPC endpoints and S3 Access Points
Many customers own multiple Amazon S3 buckets, some of which are accessed by applications running in VPCs. Amazon Virtual Private Cloud (Amazon VPC) enables you to launch AWS resources into a virtual network that you define. This virtual network closely resembles a traditional network that you’d operate in your own data center, with the benefits […]