AWS DevOps & Developer Productivity Blog

Tag: AWS Lambda

Multi-branch pipeline management and infrastructure deployment using AWS CDK Pipelines

February 9, 2024: Before reading this post, please note that AWS CodePipeline recently added support for Branch-based development and Monorepos simplifying the architecture discussed in this post. This post describes how to use the AWS CDK Pipelines module to follow a Gitflow development model using AWS Cloud Development Kit (AWS CDK). Software development teams often […]

Organize your AWS Serverless code to prevent merge conflicts

How do you prevent the most common merge conflicts when your team is working on a Serverless application? How do you make sure that your team stays productive and avoids large merge issues while trying to update the same crucial files simultaneously? –The answer to both questions is code organization! You can use cfn-include and […]

Configuration driven dynamic multi-account CI/CD solution on AWS

Many organizations require durable automated code delivery for their applications. They leverage multi-account continuous integration/continuous deployment (CI/CD) pipelines to deploy code and run automated tests in multiple environments before deploying to Production. In cases where the testing strategy is release specific, you must update the pipeline before every release. Traditional pipeline stages are predefined and […]

Create a Multi-Region Python Package Publishing Pipeline with AWS CDK and CodePipeline

Customers can author and store internal software packages in AWS by leveraging native AWS developer tools services (AWS CodePipeline, AWS CodeBuild, AWS CodeCommit, and AWS CodeArtifact).  As of the publish date of this blog post, there is no native way to replicate your CodeArtifact Packages across regions. This blog addresses how a custom solution built […]

Build Health Aware CI/CD Pipelines

Everything fails all the time — Werner Vogels, AWS CTO At the moment of imminent failure, you want to avoid an unlucky deployment. I’ll start here with a short story that demonstrates the purpose of this post. The DevOps team has just started a database upgrade with a planned outage of 30 minutes. The team […]

How MarketAxess® uses AWS Developer Tools to create scalable and secure CI/CD pipelines

Very often,  enterprise organizations strive to adopt modern DevOps practices, to focus on governance and security without sacrificing development velocity. In this guest post, Prashant Joshi, Senior Cloud Engineer at MarketAxess, explains how they use the AWS Cloud Development Kit (AWS CDK), AWS CodePipeline, and AWS CodeBuild to simplify the developer experience by dynamically provisioning […]

Improve the performance of Lambda applications with Amazon CodeGuru Profiler

Amazon CodeGuru Profiler recently began providing recommendations for applications written in Python. Additionally, the new automated onboarding process for Lambda functions makes it even easier to use CodeGuru Profiler with serverless applications built on Lambda. This post highlights these new features by explaining how to set up and utilize Codeguru Profiler on an AWS Lambda function written in Python.

Lambda-docker-images-DevOps-Architecture

Using AWS CodePipeline for deploying container images to AWS Lambda Functions

AWS Lambda launched support for packaging and deploying functions as container images at re:Invent 2020. In the post working with Lambda layers and extensions in container images, we demonstrated packaging Lambda Functions with layers while using container images. This post will teach you to use AWS CodePipeline to deploy docker images for microservices architecture involving […]

CICD on Serverless Applications using AWS CodeArtifact

Developing and deploying applications rapidly to users requires a working pipeline that accepts the user code (usually via a Git repository). AWS CodeArtifact was announced in 2020. It’s a secure and scalable artifact management product that easily integrates with other AWS products and services. CodeArtifact allows you to publish, store, and view packages, list package […]

Micro ETL pipeline: How to fetch, process, and refresh small data using AWS Lambda and AWS SAM

Whether you are building a data lake, a data analytics pipeline, or a simple data feed, you may have small volumes of data that need to be processed and refreshed regularly. This post shows how you can build and deploy a micro extract, transform, and load (ETL) pipeline to handle this requirement. In addition, you […]