AWS Architecture Blog

Category: Amazon Kinesis

Figure 2. Containerized application for ingestion and Amazon Kinesis for format conversion

Designing a High-volume Streaming Data Ingestion Platform Natively on AWS

The total global data storage is projected to exceed 200 zettabytes by 2025. This exponential growth of data demands increased vigilance against cybercrimes. Emerging cybersecurity trends include increasing service attacks, ransomware, and critical infrastructure threats. Businesses are changing how they approach cybersecurity and are looking for new ways to tackle these threats. In the past, […]

Read More

Field Notes: How to Enable Cross-Account Access for Amazon Kinesis Data Streams using Kinesis Client Library 2.x

Businesses today are dealing with vast amounts of real-time data they need to process and analyze to generate insights. Real-time delivery of data and insights enable businesses to quickly make decisions in response to sensor data from devices, clickstream events, user engagement, and infrastructure events, among many others. Amazon Kinesis Data Streams offers a managed […]

Read More
Final architecture

Toyota Connected and AWS Design and Deliver Collision Assistance Application

This post was cowritten by Srikanth Kodali, Sr. IoT Data Architect at AWS, and Will Dombrowski, Sr. Data Engineer at Toyota Connected Toyota Connected North America (TC) is a technology/big data company that partners with Toyota Motor Corporation and Toyota Motor North America to develop products that aim to improve the driving experience for Toyota […]

Read More
How to Scale OpenTravel Messaging Architecture with Amazon Kinesis Data Streams

Field Notes: How to Scale OpenTravel Messaging Architecture with Amazon Kinesis Data Streams

The travel industry relies on OpenTravel messaging systems to collect and distribute travel data—like hotel inventory and pricing—to many independent ecommerce travel sites. These travel sites need immediate access to the most current hotel inventory and pricing data. This allows shoppers access to the available rooms at the right prices. Each time a room is […]

Read More
Figure 1. Data pipeline architecture using AWS Services

Building a Data Pipeline for Tracking Sporting Events Using AWS Services

In an evolving world that is increasingly connected, data-centric, and fast-paced, the sports industry is no exception. Amazon Web Services (AWS) has been helping customers in the sports industry gain real-time insights through analytics. You can re-invent and reimagine the fan experience by tracking sports actions and activities. In this blog post, we will highlight […]

Read More
Serverless compute with Fargate

Rate Limiting Strategies for Serverless Applications

Serverless technologies reduce the work needed to set up and maintain computing resources, provide built-in scalability, and optimize agility, performance, cost, and security. The pay-as-you-go model is particularly liberating for developers. You can fail fast, experiment more, and do it fairly cheaply. However, serverless brings its own challenges. In this blog, we’ll examine how to […]

Read More
Top 5 posts of Q1 2021

Top 5: Architecture Content for May

With Architecture Center content being published nearly every day, sometimes more than two or three times a day, we know it can be hard to fit it all into your busy schedule. So, this month, we’ve rounded up our most popular and highly rated content to provide you with a quick rundown. 5. Architecture Center: […]

Read More
Figure 4. Discovering Hot Topics using Machine Learning solution architecture

Discovering Hot Topics using Machine Learning

Successful businesses not only have great products and services; they also have a deep understanding of their customers. Companies that can use behavioral analytics in marketing automation platforms are better equipped to deliver real-time marketing efforts. According to a research case study from Deloitte, companies with a customer-centric business model are 60% more profitable. Knowing […]

Read More
MDM Architecture Diagram

Digitally transform your factory with Machine Downtime Monitor on AWS

In manufacturing enterprises, digital transformation and Industry 4.0 are likely at the top of your mind. New technologies in the Industrial Internet of Things (IIoT) space are critical for monitoring your factory production environments for optimal performance and efficiency. Global events such as Covid-19 have increased interest in monitoring factory performance digitally, when access to […]

Read More
Figure 3. Replay Architecture

Amazon MSK Backup for Archival, Replay, or Analytics

Amazon MSK is a fully managed service that helps you build and run applications that use Apache Kafka to process streaming data. Apache Kafka is an open-source platform for building real-time streaming data pipelines and applications. With Amazon MSK, you can use native Apache Kafka APIs to populate data lakes. You can also stream changes to […]

Read More