AWS Compute Blog

Amazon Kinesis Firehose Data Transformation with AWS Lambda

February 12, 2024: Amazon Kinesis Data Firehose has been renamed to Amazon Data Firehose. Read the AWS What’s New post to learn more. September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. This post is written by Shiva Narayanaswamy, Solution Architect. Amazon Kinesis Firehose is a fully managed service […]

Authorizing Access Through a Proxy Resource to Amazon API Gateway and AWS Lambda Using Amazon Cognito User Pools

Ed Lima, Solutions Architect Want to create your own user directory that can scale to hundreds of millions of users? Amazon Cognito user pools are fully managed so that you don’t have to worry about the heavy lifting associated with building, securing, and scaling authentication to your apps. The AWS Mobile blog post Integrating Amazon […]

Managing Secrets for Amazon ECS Applications Using Parameter Store and IAM Roles for Tasks

Thanks to my colleague Stas Vonholsky  for a great blog on managing secrets with Amazon ECS applications. —– As containerized applications and microservice-oriented architectures become more popular, managing secrets, such as a password to access an application database, becomes more challenging and critical. Some examples of the challenges include: Support for various access patterns across container […]

Amazon ECS at The Climate Corporation: Using Amazon ECR and Multiple Accounts for Isolated Regression Testing

This is a guest post from Nathan Mehl, Site Reliability Engineering Manager at The Climate Corporation. — The Climate Corporation aims to help all the world’s farmers sustainably increase their productivity through the use of digital tools. The integrated Climate FieldView™ digital agriculture platform provides farmers with a comprehensive, connected suite of digital tools. Bringing […]

How to Automate Container Instance Draining in Amazon ECS

Update 24 Aug 2023: The approach described in this post relies on a recursive AWS Lambda function. Lambda announced a recursion control to detect and stop Lambda functions in July 2023. Accounts having recursive Lambda functions were automatically opted-out during the launch, we recommend contacting AWS Support to disable the Lambda feature to use this […]

Seamlessly Scale Predictions with AWS Lambda and MXNet

Sunil Mallya, Solutions Architect Building AI solutions at scale can be challenging, in this blog we’ll look at how to leverage AWS Lambda and MXNet to build a scalable prediction pipeline. Companies that leverage machine and deep learning invest in much more than just training models. They have sophisticated pipelines that include the following stages: […]

Continuous Deployment to Amazon ECS using AWS CodePipeline, AWS CodeBuild, Amazon ECR, and AWS CloudFormation

Thanks to my colleague John Pignata for a great blog on how to create a continuous deployment pipeline to Amazon ECS. — Delivering new iterations of software at a high velocity is a competitive advantage in today’s business environment. The speed at which organizations can deliver innovations to customers and adapt to changing markets is […]

Introducing Amazon ECS Task Placement Policies

Today, Amazon ECS announced capabilities that provide granular control over how tasks are placed onto clusters. Previously, if you needed to place a task on a container instance with specific resource requirements (e.g., a specific instance type), you would have had to write custom schedulers to filter, find, and group resources. The following diagram outlines […]