AWS Architecture Blog

Category: Compute

Figure 3: Overall Architecture

Scaling up a Serverless Web Crawler and Search Engine

Introduction Building a search engine can be a daunting undertaking. You must continually scrape the web and index its content so it can be retrieved quickly in response to a user’s query. The goal is to implement this in a way that avoids infrastructure complexity while remaining elastic. However, the architecture that achieves this is […]

Read More
Serverless architecture for burst-parallel search

Scaling Neuroscience Research on AWS

HHMI’s Janelia Research Campus in Ashburn, Virginia has an integrated team of lab scientists and tool-builders who pursue a small number of scientific questions with potential for transformative impact. To drive science forward, we share our methods, results, and tools with the scientific community. Introduction Our neuroscience research application involves image searches that are computationally […]

Read More
Zurich Spain Architecture

Zurich Spain: Managing Millions of Documents with AWS

This post was cowritten with Oscar Gali, Head of Technology and Architecture for GI in Zurich, Spain About Zurich Spain Zurich Spain is part of Zurich Insurance Group (Zurich), known for its financial soundness and solvency. With more than 135 years of history and over 2,000 employees, it is a leading company in the Spanish […]

Read More
Event Driven Architecture

Building Multi-partner integration on AWS using Event-Driven Architecture

September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Summary Finserv MARKETS enables customers to buy financial services products such as credit cards, loans, insurance, and investments from various partners. Finserv MARKETS integrates with a large number of partners in real time to provide services to customers. Each partner […]

Read More
2020

Top 15 Architecture Blog Posts of 2020

The goal of the AWS Architecture Blog is to highlight best practices and provide architectural guidance. We publish thought leadership pieces that encourage readers to discover other technical documentation, such as solutions and managed solutions, other AWS blogs, videos, reference architectures, whitepapers, and guides, Training & Certification, case studies, and the AWS Architecture Monthly Magazine. […]

Read More
Olympus Tower - Grov Technologies

Building a Controlled Environment Agriculture Platform

This post was co-written by Michael Wirig, Software Engineering Manager at Grōv Technologies. A substantial percentage of the world’s habitable land is used for livestock farming for dairy and meat production. The dairy industry has leveraged technology to gain insights that have led to drastic improvements and are continuing to accelerate. A gallon of milk […]

Read More
EKS architecture diagram

Field Notes: Managing an Amazon EKS Cluster Using AWS CDK and SHI’s Cloud Resource Property Manager

This post is contributed by Bill Kerr and Raj Seshadri For most customers, infrastructure is hardly done with CI/CD in mind. However, Infrastructure as Code (IaC) should be a best practice for DevOps professionals when they provision cloud-native assets. Microservice apps that run inside an Amazon EKS cluster often use CI/CD, so why not the […]

Read More
architecture for the solution

Real-Time In-Stream Inference with AWS Kinesis, SageMaker, & Apache Flink

As businesses race to digitally transform, the challenge is to cope with the amount of data, and the value of that data diminishes over time. The challenge is to analyze, learn, and infer from real-time data to predict future states, as well as to detect anomalies and get accurate results. In this blog post, we’ll […]

Read More
Figure 1 - Architecture, AWS Amplify Console

Serving Content Using a Fully Managed Reverse Proxy Architecture in AWS

With the trends to autonomous teams and microservice style architectures, web frontend tiers are challenged to become more flexible and integrate different components with independent architectures and technology stacks. Two scenarios are prominent: Micro-Frontends, where there is a single page application and components within this page are owned by different teams Web portals, where there […]

Read More

Field Notes: Setting Up Disaster Recovery in a Different Seismic Zone Using AWS Outposts

Recovering your mission-critical workloads from outages is essential for business continuity and providing services to customers with little or no interruption. That’s why many customers replicate their mission-critical workloads in multiple places using a Disaster Recovery (DR) strategy suited for their needs. With AWS, a customer can achieve this by deploying multi Availability Zone High-Availability […]

Read More