AWS Compute Blog

Category: Amazon EC2

Automating the Creation of Consistent Amazon EBS Snapshots with Amazon EC2 Systems Manager (Part 1)

Nicolas Malaval, AWS Professional Consultant If an EC2 instance is up and running, there may be applications working, like databases, with data in memory or pending I/O operations that cannot be retrieved from an Amazon EBS snapshot. If your application is unable to recover from such a state, you might lose vital data for your […]

Read More

Building a Backup System for Scaled Instances using AWS Lambda and Amazon EC2 Run Command

Diego Natali, AWS Cloud Support Engineer When an Auto Scaling group needs to scale in, replace an unhealthy instance, or re-balance Availability Zones, the instance is terminated, data on the instance is lost and any on-going tasks are interrupted. This is normal behavior but sometimes there are use cases when you might need to run […]

Read More

Distributed Deep Learning Made Easy

This is a guest post from my colleagues Naveen Swamy and Joseph Spisak. ——————————— Machine learning is a field of computer science that enables computers to learn without being explicitly programmed. It focuses on algorithms that can learn from and make predictions on data. Most recently, one branch of machine learning, called deep learning, has […]

Read More

Real World AWS Scalability

This is a guest post from Linda Hedges, Principal SA, High Performance Computing. —– One question we often hear is, “How well will my application scale on AWS?” For high performance computing (HPC) workloads that cross multiple nodes, the cluster network is at the heart of scalability concerns. AWS uses advanced Ethernet networking technology, which, […]

Read More

Optimizing Joining Windows Server Instances to a Domain with PowerShell in AWS CloudFormation

Scott Zimmerman AWS Solutions Architect Deploying applications with Active Directory, including Microsoft SharePoint Server and custom .NET applications, can take several minutes and possibly even hours. My colleague Julien Lépine wrote an excellent post, Optimize AWS CloudFormation Templates, about parallelizing Amazon EC2 instance creation in AWS CloudFormation. His post shows a general technique for using […]

Read More

Powering your Amazon ECS Clusters with Spot Fleet

My colleague Drew Dennis sent a nice guest post that shows how to use Amazon ECS with Spot fleet. — There are advantages to using on-demand EC2 instances. However, for many workloads, such as stateless or task-based scenarios that simply run as long as they need to run and are easily replaced with subsequent identical […]

Read More

Dynamic Scaling with EC2 Spot Fleet

Tipu Qureshi, AWS Senior Cloud Support Engineer The RequestSpotFleet API allows you to launch and manage an entire fleet of EC2 Spot Instances with one request. A fleet is a collection of Spot Instances that are all working together as part of a distributed application and providing cost savings. With the ModifySpotFleetRequest API, it’s possible […]

Read More

Cost-effective Batch Processing with Amazon EC2 Spot

Tipu Qureshi, AWS Senior Cloud Support Engineer With Spot Instances, you can save up to 90% of costs by bidding on spare Amazon Elastic Compute Cloud (Amazon EC2) instances. This reference architecture is meant to help enable you to realize cost savings for batch processing applications while maintaining high availability. We recommend tailoring and testing […]

Read More

An EC2 Spot Architecture for Web Applications

Tipu Qureshi, AWS Senior Cloud Support Engineer This blog post describes a reference architecture that utilizes Spot Instances and is meant to help enable you to realize additional cost savings for your stateless web tier while maintaining high availability. We recommend tailoring and testing it for your application before implementing it to a production environment. […]

Read More