Amazon Web Services

In this video, AWS Senior Solution Architect Dean demonstrates how to set up data quality checks in ETL pipelines using AWS Glue Data Quality. He shows how to create rules for customer and sales data, including row count validation, primary key checks, and custom SQL rules. The demo covers adding data quality transforms, authoring rules, and configuring actions based on evaluation results. Dean explains how to filter and separate good and bad records, view data quality results, and generate reusable code for different data sources. This capability helps prevent bad data from entering repositories and improves overall data quality for business teams.

product-information
skills-and-how-to
data
analytics
data-integration
Show 4 more

Up Next

VideoThumbnail
58:49

AWS Clean Rooms ML and Differential Privacy: Revolutionizing Secure Data Collaboration

Nov 22, 2024
VideoThumbnail
14:40

Amazon Aurora MySQL Zero-ETL Integration with Amazon Redshift: Public Preview Demo and Setup Guide

Nov 22, 2024
VideoThumbnail
31:20

Enhancing Security Operations with Amazon OpenSearch Service: Introducing Security Analytics for Efficient Threat Detection and Investigation

Nov 22, 2024
VideoThumbnail
18:11

Building Intelligent Chatbots: Integrating Amazon Lex with Bedrock Knowledge Bases for Enhanced Customer Experiences

Nov 22, 2024
VideoThumbnail
43:12

Amazon ECR Unveiled: Architecture, Features, and Scalability for Container Image Management

Nov 22, 2024