AWS Architecture Blog

Category: AWS Lambda

Figure 1. Current Architecture with improved resiliency and standardized observability

Journey to Adopt Cloud-Native Architecture Series: #3 – Improved Resilience and Standardized Observability

September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. In the last blog, Maximizing System Throughput, we talked about design patterns you can adopt to address immediate scaling challenges to provide a better customer experience. In this blog, we talk about architecture patterns to improve system resiliency, why observability […]

Backup and restore DR strategy

Disaster Recovery (DR) Architecture on AWS, Part II: Backup and Restore with Rapid Recovery

In a previous blog post, I introduced you to four strategies for disaster recovery (DR) on AWS. These strategies enable you to prepare for and recover from a disaster. By using the best practices provided in the AWS Well-Architected Reliability Pillar whitepaper to design your DR strategy, your workloads can remain available despite disaster events […]

CloudFront events that can trigger Lambda@Edge functions

Dynamic Request Routing in Multi-tenant Systems with Amazon CloudFront

In this blog post, we will share how OutSystems designed a globally distributed serverless request routing service for their multi-tenant architecture. This will provide you ways to benefit from a managed solution that’s scalable and requires a low operational effort. Namely, we explain how to select the origin serving an HTTP/S request using Lambda@Edge, including […]

Architecture: Recursive Scaling using Amazon SQS and Amazon ECS Fargate cluster

Design Pattern for Highly Parallel Compute: Recursive Scaling with Amazon SQS

Scaling based on Amazon Simple Queue Service (SQS) is a commonly used design pattern. At AWS Professional Services, we have recently used a variant of this pattern to achieve highly parallel computation for larger customers. In fact, any use case with a tree-like set of entities can use this pattern. It’s useful in a workflow […]

Pupeteer image

Field Notes: Scaling Browser Automation with Puppeteer on AWS Lambda with Container Image Support

This post is contributed by Bill Kerr, SHI and Raj Seshadri, Global SA Lead, AWS. Imagine you are launching a brand new website selling goods and services. You are expecting a huge amount of traffic due to the seasonality of the product. You would like to test 100K simultaneous connections to the website and make […]

Lambda behind static IP diagram

Expose AWS Lambda Function Behind Static IP When a DNS Cannot be Managed

Up until recently, the best practice to expose an AWS Lambda function has been to use Amazon API Gateway. This solution protects your functions from direct client traffic. This is explained in the API Gateway tutorial, where Amazon API Gateway acts as a proxy in front of the Lambda function. This practice is useful when […]

Figure 3: Overall Architecture

Scaling up a Serverless Web Crawler and Search Engine

Introduction Building a search engine can be a daunting undertaking. You must continually scrape the web and index its content so it can be retrieved quickly in response to a user’s query. The goal is to implement this in a way that avoids infrastructure complexity while remaining elastic. However, the architecture that achieves this is […]

Serverless architecture for burst-parallel search

Scaling Neuroscience Research on AWS

HHMI’s Janelia Research Campus in Ashburn, Virginia has an integrated team of lab scientists and tool-builders who pursue a small number of scientific questions with potential for transformative impact. To drive science forward, we share our methods, results, and tools with the scientific community. Introduction Our neuroscience research application involves image searches that are computationally […]

Olympus Tower - Grov Technologies

Building a Controlled Environment Agriculture Platform

This post was co-written by Michael Wirig, Software Engineering Manager at Grōv Technologies. A substantial percentage of the world’s habitable land is used for livestock farming for dairy and meat production. The dairy industry has leveraged technology to gain insights that have led to drastic improvements and are continuing to accelerate. A gallon of milk […]

architecture for the solution

Real-Time In-Stream Inference with AWS Kinesis, SageMaker, & Apache Flink

As businesses race to digitally transform, the challenge is to cope with the amount of data, and the value of that data diminishes over time. The challenge is to analyze, learn, and infer from real-time data to predict future states, as well as to detect anomalies and get accurate results. In this blog post, we’ll […]