AWS Storage Blog

Category: Expert (400)

Amazon S3 Batch Operations featured image

Copying objects greater than 5 GB with Amazon S3 Batch Operations

A large number of customers store their data in Amazon S3, and some of these customers scale to millions or billions of individual objects. Amazon S3 customers need an easy, reliable, and scalable way to perform bulk operations on these large datasets – with objects ranging in size from a few kilobytes to tens of […]

Read More
CloudEndure-AWS-Storage-Blog

Monitoring CloudEndure Disaster Recovery with AWS Lambda

Many organizations must monitor and track their disaster recovery (DR) initiatives to meet business and audit objectives. CloudEndure Disaster Recovery provides fast and reliable recovery of physical, virtual, and cloud-based servers into AWS. It uses email alerts and has a high-level dashboard for monitoring DR jobs. However, many organizations require more robust reporting mechanisms. This […]

Read More
CloudEndure-AWS-Storage-Blog

Validate your disaster recovery solution and simplify compliance reporting on AWS

Data protection is a key element of compliancy, and organizations must deploy controls to manage the protection of their data and handle operational disruptions. With ongoing configuration and resource changes within IT infrastructure, it can be challenging to continuously and efficiently validate, maintain, and report on compliance to ensure that internal policies and regulatory standards […]

Read More
AWS Backup 2021 blog image

Automate data recovery validation with AWS Backup

Your data may be your most valuable asset. Disaster events that affect your workloads can result in a loss of data. A disaster is an event that causes a serious negative impact on your business. Having backups of your data helps minimize the impact of these disaster events by giving you the ability to recover […]

Read More

Event-driven data transfer to container-shared storage on AWS

Businesses using data lake solutions built on Amazon S3 often want their data science teams to have access to that same data for machine learning or analytics projects deployed on tools like RStudio Server and Shiny. To do so, they can easily deploy these tools in the cloud using Amazon ECS or Amazon EKS serverless containers with AWS Fargate, and can access […]

Read More

Optimizing storage management with Amazon FSx for Lustre storage quotas

Data-intensive use cases across industries are getting larger each year. Use cases that require multi-user file systems, such as user shares for data science or computational engineering, can benefit from cloud solutions to help manage file storage consumption. In this blog post, I walk you through the Amazon FSx for Lustre storage quota feature, discussing […]

Read More
AWS Storage Gateway Featured Image

Implementing a backup solution with AWS Storage Gateway

Backups are the insurance policy for our data. We hope to never use them, but if the time comes when we need them, they had better be there for us. At a high level, there are two different variations: local and offsite. A local backup can be as simple as copying data to another physical […]

Read More

Clustered storage simplified: GFS2 on Amazon EBS Multi-Attach enabled volumes

One of the design patterns for high availability of mission critical applications is the use of shared storage. This architectural pattern enables you to access storage from multiple hosts simultaneously, making your applications resilient to node failures. Customers with demanding transaction processing systems, analytics workloads, or high performance computing clusters need highly available, high-performance storage […]

Read More

Persistent storage for container logging using Fluent Bit and Amazon EFS

UPDATE 9/8/2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Logging is a powerful debugging mechanism for developers and operations teams when they must troubleshoot issues. Containerized applications write logs to standard output, which is redirected to local ephemeral storage, by default. These logs are lost when the container is terminated […]

Read More

Automating shadow copies configuration on Amazon FSx for Windows File Server

We often hear from customers that they love the self-service, fine-grained file restore capability of the shadow copies feature on Amazon FSx for Windows File Server Filer Server (Amazon FSx). Our customers also relay to us the convenience of being able to schedule shadow copies on file systems using PowerShell commands. However, enabling Windows shadow […]

Read More