AWS Architecture Blog

Tag: Parallel processing

Figure 1. On-premises and AWS queue integration for third-party services using AWS Lambda

Queue Integration with Third-party Services on AWS

Commercial off-the-shelf software and third-party services can present an integration challenge in event-driven workflows when they do not natively support AWS APIs. This is even more impactful when a workflow is subject to unpredicted usage spikes, and you want to increase decoupling and fault tolerance. Given the third-party nature of services, polling an Amazon Simple […]

Architecture: Recursive Scaling using Amazon SQS and Amazon ECS Fargate cluster

Design Pattern for Highly Parallel Compute: Recursive Scaling with Amazon SQS

Scaling based on Amazon Simple Queue Service (SQS) is a commonly used design pattern. At AWS Professional Services, we have recently used a variant of this pattern to achieve highly parallel computation for larger customers. In fact, any use case with a tree-like set of entities can use this pattern. It’s useful in a workflow […]