In this insightful AWS re:Invent 2023 session, Anahit, a lead cloud software engineer and AWS data hero, delves into the intricacies of creating scalable, production-ready data streaming architectures using Amazon Kinesis Data Streams and AWS Lambda. She explores common pitfalls and challenges in distributed systems, sharing valuable tips and best practices for handling failures and optimizing performance. Anahit emphasizes the importance of understanding how AWS services work and interact, particularly focusing on Kinesis' sharding concept, Lambda's event source mapping, and proper error handling techniques. The presentation covers crucial aspects such as partial failures in batch operations, retry strategies, and the significance of monitoring and configuring appropriate timeout settings. Throughout the talk, Anahit encourages embracing failures as learning opportunities and highlights the need for pragmatic decision-making when choosing services for specific use cases. This session provides a comprehensive look at serverless near real-time data streaming, offering practical insights for developers and architects working with AWS services.