AWS Big Data Blog
Author: Praveen Allam
Praveen Allam is a Solutions Architect at AWS. He helps customers in designing scalable, high-performance, and cost effective enterprise grade applications using the AWS Cloud. He builds solutions to help organizations make data-driven decisions.
Handle UPSERT data operations using open-source Delta Lake and AWS Glue
September 2024: This post was reviewed and updated for accuracy. Many customers need an ACID transaction (atomic, consistent, isolated, durable) data lake that can log change data capture (CDC) from operational data sources. There is also demand for merging real-time data into batch data. Delta Lake framework provides these two capabilities. In this post, we […]