AWS Storage Blog

Category: AWS Lambda

AWS DataSync Featured Image 2020

Event-driven data transfer to container-shared storage on AWS

Businesses using data lake solutions built on Amazon S3 often want their data science teams to have access to that same data for machine learning or analytics projects deployed on tools like RStudio Server and Shiny. To do so, they can easily deploy these tools in the cloud using Amazon ECS or Amazon EKS serverless containers with AWS Fargate, and can access […]

AWS Backup 2021 blog image

Automating backups and optimizing backup costs for Amazon EFS using AWS Backup

Automating backups allows you to meet rigorous regulatory compliance regulations and business continuity goals. It also enables you to avoid time-consuming configuration of your backups on a regular basis. AWS Backup enables you to centralize and automate data protection across AWS services by scheduling backups using backup plans. With backup plans, you can configure different […]

Amazon S3

Automatically sync files from Amazon S3 to Amazon WorkDocs

UPDATE: A companion blog post for this solution detailing automatically syncing files from Amazon WorkDocs to Amazon S3 was published on 9/13/2021. Today, many customers use Amazon S3 as their primary storage service for a range of use cases, including data lakes, websites, mobile applications, backup and restore, archive, big data analytics, and more. Versatile, scalable, […]

AWS Storage Gateway Featured Image

CME Group accelerates cloud migration with AWS Storage Gateway

At CME Group, the world’s leading and most diverse derivatives marketplace, we offer futures and options across every investible asset class, from corn to Bitcoin. This breadth means our global, electronic markets are powered by data – and lots of it. Making sure that our customers have access to the market data that they need […]

Amazon EFS serverless featured image

Amazon EFS introduces 3X read-throughput increase at no additional charge

Companies are increasingly using Amazon EFS with containers and serverless compute to modernize their applications. Many of these applications are read-heavy, meaning they read data more often than they write. To improve the overall performance of read-heavy applications, we recently launched a 3x increase to the read throughput of all Amazon EFS file systems, available […]

AWS DataSync Featured Image 2020

FORMULA 1 transfers race car data into AWS using AWS DataSync

At FORMULA 1, time is always of the essence, whether that be on-track at our Event Technical Centre or back at our Media & Technology Centre in Kent, UK. As the Cloud Team Lead at FORMULA 1, I am responsible for defining, designing, and implementing workloads across the cloud estate, including security, platform, project, networking, […]

AWS Transfer Family Featured Image

Securing AWS Transfer Family with AWS Web Application Firewall and Amazon API Gateway

AWS Transfer Family is a fully managed, serverless file transfer service for Amazon S3 and Amazon EFS. The service provides you with the flexibility to authenticate your file transfer client users using credentials stored in an identity provider (IdP) of your choice. You can achieve this by integrating an Amazon API Gateway endpoint backed by an AWS Lambda function that […]

AWS DataSync Featured Image 2020

Post-process your transferred data with file-level logging in AWS DataSync

AWS DataSync is an online data transfer service that simplifies, automates, and accelerates moving data between on-premises storage systems and AWS Storage services, as well as between AWS Storage services. Customers use DataSync for a number of use cases, including migrating active datasets to AWS, archiving data to free up on-premises storage capacity, replicating data […]

Implementing sensor workflows using AWS Snowcone and AWS IoT Greengrass

In our first blog of this series, we covered using an IoT device to store the sensor data on an Amazon EC2 instance running on AWS Snowcone. That use case covered collecting data from sensors in locations such as a factory floor or a mine with austere network connectivity. There are other instances where you […]

AWS re:Invent recap: Modernize your applications with Amazon EFS

Development teams are modernizing their applications by adopting containers, serverless, and microservices-based architectures. As containers are transient in nature, long-running applications can benefit from keeping state in durable file storage. At the same time, serverless computing enables you to be more agile while spending less time dealing with the security, scalability, and availability of your […]