Amazon Web Services
In this AWS re:Invent 2023 session, three AWS operational leaders share valuable insights on building resilient systems at scale. They discuss five key topics: dependencies and modes, blast radius, queues, errors, and retries. The speakers emphasize the importance of thinking beyond traditional availability metrics and focus on shortening time to mitigation when unexpected issues occur. They provide real-world examples from AWS services like Route 53 and EC2, demonstrating how seemingly small changes can have significant impacts at scale. The session offers practical advice on implementing resilience strategies, including proper error classification, thoughtful retry mechanisms, and effective queue management. This talk is essential for anyone looking to improve their system's ability to recover quickly from failures in large-scale environments.