AWS Architecture Blog

Jack Stevenson

Author: Jack Stevenson

Jack Stevenson is a Senior Solutions Engineer with the AWS Prototyping team, where he works with a broad range of services and technologies to build prototypes for a diverse set of customers. In his spare time, Jack enjoys powerlifting, track days, and tinkering with personal programming projects.

Figure 3: Overall Architecture

Scaling up a Serverless Web Crawler and Search Engine

Introduction Building a search engine can be a daunting undertaking. You must continually scrape the web and index its content so it can be retrieved quickly in response to a user’s query. The goal is to implement this in a way that avoids infrastructure complexity while remaining elastic. However, the architecture that achieves this is […]