AWS Compute Blog

Category: Best Practices

Spark Deployment on Kubernetes Cluster

Running cost optimized Spark workloads on Kubernetes using EC2 Spot Instances

This post is written by Kinnar Sen, Senior Solutions Architect, EC2 Spot  Apache Spark is an open-source, distributed processing system used for big data workloads. It provides API operations to perform multiple tasks such as streaming, extract transform load (ETL), query, machine learning (ML), and graph processing. Spark supports four different types of cluster managers (Spark standalone, Apache […]

Read More
Event loops in Lambda-based applications

Operating Lambda: Anti-patterns in event-driven architectures – Part 3

This post discusses anti-pattern in event-driven architectures using Lambda. I show some of the issues when using monolithic Lambda functions or using custom code to orchestrate workflows. I explain how to avoid recursive architectures that cause loops and why you should avoid functions calling functions.

Read More
Process to install and configure the CloudWatch agent

How to monitor Windows and Linux servers and get internal performance metrics

This post was written by Dean Suzuki, Solution Architect Manager. Customers who run Windows or Linux instances on AWS frequently ask, “How do I know if my disks are almost full?” or “How do I know if my application is using all the available memory and is paging to disk?” This blog helps answer these […]

Read More
Idempotent microservice

Operating Lambda: Design principles in event-driven architectures – Part 2

This post discusses the design principles that can help you develop well-architected serverless applications. I explain why using services instead of code can help improve your application’s agility and scalability. I also show how statelessness and function design also contribute to good application architecture.

Read More
Grouping AWS serverless services into layers

Operating Lambda: Understanding event-driven architecture – Part 1

In the Operating Lambda series, I cover important topics for developers, architects, and systems administrators who are managing AWS Lambda-based applications. This three-part series discusses event-driven architectures and how these relate to serverless applications. Part 1 covers the benefits of the event-driven paradigm and how it can improve throughput, scale and extensibility, while also reducing […]

Read More

Introducing Spot Blueprints, a template generator for frameworks like Kubernetes and Apache Spark

This post is authored by Deepthi Chelupati, Senior Product Manager for Amazon EC2 Spot Instances, and Chad Schmutzer, Principal Developer Advocate for Amazon EC2 Customers have been using EC2 Spot Instances to save money and scale workloads to new levels for over a decade. Launched in late 2009, Spot Instances are spare Amazon EC2 compute […]

Read More
Backend architecture

Application integration patterns for microservices: Running distributed RFQs

In this blog, I present the scatter-gather pattern, which is a composite pattern based on pub-sub and point-to-point messaging channels. It also employs correlation ID and return address. I show how this is implemented in the Wild Rydes example application. You can use this integration pattern for communication in your microservices.

Read More

Integrating AWS Outposts with existing security zones

This post is contributed by Santiago Freitas, AWS Head of Technology EEM and Matt Lehwess, Principal Developer Advocate. AWS Outposts is a fully managed service that extends AWS infrastructure, services, APIs, and tools to your on-premises facility. This blog post explains how the resources created on an Outpost can be integrated with security zones of […]

Read More

Announcing Outposts and local gateway sharing for multi-account access

This post was contributed by James Devine, Sr. Outposts SA AWS Outposts enables customers to run AWS services in their on-premises environments. With the release of Outposts and local gateway (LGW) sharing, customers can now configure multi-account access and sharing within an AWS Organization. Prior to this release, an Outpost was only viable within a single […]

Read More