AWS Compute Blog

Building a Backup System for Scaled Instances using AWS Lambda and Amazon EC2 Run Command

Diego Natali, AWS Cloud Support Engineer When an Auto Scaling group needs to scale in, replace an unhealthy instance, or re-balance Availability Zones, the instance is terminated, data on the instance is lost and any on-going tasks are interrupted. This is normal behavior but sometimes there are use cases when you might need to run […]

Amazon ECS sessions at re:Invent

Come learn about containers—from the basics to production topics such as scaling and security—from customers and Amazon ECS subject matter experts at this year’s re:Invent conference. We’re excited to learn from you and hear what you think about our recently launched features. Containers are highlighted at Thursday’s Containers Mini Con at The Mirage: CON301 – […]

AWS Lambda sessions at re:Invent 2016

Vyom Nagrani, Manager of Product Management, AWS Lambda AWS Lambda was announced on 13th Nov, 2014, which makes us 2 years old today! We have come a long way in these last 2 years, with many small and big customers using AWS Lambda in production, many new features, and a broader partner network. Come talk […]

Distributed Deep Learning Made Easy

This is a guest post from my colleagues Naveen Swamy and Joseph Spisak. ——————————— Machine learning is a field of computer science that enables computers to learn without being explicitly programmed. It focuses on algorithms that can learn from and make predictions on data. Most recently, one branch of machine learning, called deep learning, has […]

Real World AWS Scalability

This is a guest post from Linda Hedges, Principal SA, High Performance Computing. —– One question we often hear is, “How well will my application scale on AWS?” For high performance computing (HPC) workloads that cross multiple nodes, the cluster network is at the heart of scalability concerns. AWS uses advanced Ethernet networking technology, which, […]

Running Swift Web Applications with Amazon ECS

This is a guest post from Asif Khan about how to run Swift applications on Amazon ECS. —– Swift is a general-purpose programming language built using a modern approach to safety, performance, and software design patterns. A goal for Swift is to be the best language for uses ranging from systems programming, to mobile and […]

Ad Hoc Big Data Processing Made Simple with Serverless MapReduce

September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Sunil Mallya Solutions Architect Big data processing solutions have been using AWS Lambda more lately; customers have been creating solutions such as building metadata indexes for Amazon S3 using Lambda and Amazon DynamoDB and stream processing of data in S3. […]

Service Discovery for Amazon ECS Using DNS

My colleagues Peter Dalbhanjan and Javier Ros sent a nice guest post that describes DNS-based service discovery for Amazon ECS. —— Containers are generating a lot of interest due to benefits such as portability and speed of deployment. Containers are also a good fit for microservices as they offer a thin, modular, self-contained environment that […]