AWS Storage Blog

Category: Intermediate (200)

Aggregating logs with S3 Same-Region Replication

Introduction Aggregating logs to a secure dedicated location streamlines critical operations like Security Information and Event Management (SIEM). As more customers adopt a multi-account strategy, central logging becomes a key component of driving operational excellence. Considering the benefits, enterprise customers often use complex third-party tools to build their centralized log aggregation solution. With the announcement […]

Read More

New enhancements for moving data between Amazon FSx for Lustre and Amazon S3

Introduction to Amazon FSx for Lustre Amazon FSx for Lustre is a high performance file system optimized for workloads such as machine learning, high performance computing, video processing, financial modeling, electronic design automation, and analytics. Amazon FSx works natively with Amazon S3, making it easy for you to process cloud data sets with high performance […]

Read More

Scheduling automated backups using Amazon EFS and AWS Backup

Introduction Using a shared file system is an important component for many computing infrastructures. For Linux systems, this is typically done using a network file system (NFS) and mounting it from the Linux hosts. Users can store data in their home directories and can share data with other users across the file system. Amazon Elastic […]

Read More

Use cases for 7-day Amazon EFS Infrequent Access

Recently, Amazon EFS announced general availability of a new policy for Lifecycle Management, which moves files into the EFS Infrequent Access storage class (EFS IA) after 7 days of not being accessed. If you’ve been following along on the Storage blog, you may already know that tens of thousands of customers are storing petabytes of […]

Read More

AWS Storage Gateway in 2019

Tens of thousands of customers around the world are using AWS Storage Gateway to connect their on-premises applications with AWS. Over the last 12 months, Storage Gateway launched over 20 new features. These features range from 4x performance improvements to new deployment options, including both hardware appliances and VMware high availability configurations, as well as […]

Read More

Supporting big data and analytics engagements with AWS Transfer for SFTP

Leap Beyond is a multinational boutique consultancy that specialises in big data. Our goal is to help medium to large enterprises use their data to realise high-impact changes in their businesses and their bottom line. In my role as one of the managing partners, I have special responsibility and interest in how our engineers work […]

Read More

Monitor data transfer costs related to Amazon S3 Replication

In this post, we will review how to monitor the cost and usage details of Amazon S3 Replication for use-cases such as compliance, disaster recovery, or data sovereignty. In Amazon Simple Storage Service (Amazon S3), you can automatically and asynchronously replicate data to a different bucket in another AWS Region by using Cross-Region Replication (CRR) or across buckets […]

Read More

Achieve highly available and durable database backup workflows with Amazon EFS

Deciding what storage to use as part of your database backup and restore workflows requires considering multiple factors: from format compliance, to scalability, to availability and durability of data, to costs. Amazon Elastic File System (Amazon EFS) provides a simple, scalable, fully managed elastic NFS file system for use with AWS Cloud services and on-premises resources. […]

Read More

Migrate HDFS files to an Amazon S3 data lake with AWS Snowball Edge

The need to store newly connected data grows as the sources of data increase. Enterprise customers use Hadoop Distributed File System (HDFS) as their data lake storage repository for on-premises Hadoop applications. Customers are migrating their data lakes to AWS for a more secure, scalable, agile, and cost-effective solution. For HDFS migrations where high-speed transfer […]

Read More

Maintain your compliance requirements by using AWS PrivateLink with Amazon EFS

Amazon Elastic File System (Amazon EFS) serves tens of thousands of companies across the world, in every industry and vertical. Many of our customers have very specific network and network management policies, based on compliance or regulatory requirements. Today, I will show you how you can meet or enhance your compliance posture by using AWS […]

Read More