Amazon Web Services
This video demonstrates how to send change data capture (CDC) information from relational databases to Amazon Kinesis Data Streams using AWS Database Migration Service (AWS DMS). It showcases the process of configuring CDC replication to implement near real-time upstream data changes to a data lake or data warehouse. The demonstration uses an Amazon Aurora MySQL-compatible database as the source, AWS DMS to send CDC information to Kinesis Data Streams, and AWS Glue to process and mask sensitive data before storing it in Amazon S3. The video covers creating and configuring the necessary AWS resources, including the database, Kinesis stream, IAM roles, and DMS tasks. It also shows how to monitor the replication process and handle updates in real-time. Additionally, the video illustrates how to use AWS Glue to transform and mask personally identifiable information (PII) in the data stream before storing it securely.