AWS Big Data Blog
Author: Navaneedha Krishnan Jagathesan
Navaneedha Krishnan Jagathesan is a Senior Technical Account Manager at AWS, and focuses on driving operational excellence for customers.
Lowering AWS KMS decrypt API costs in EMR Spark jobs
Processing encrypted data in Amazon S3 with Amazon EMR and Apache Spark can drive up AWS KMS decrypt API costs as the number of objects grows. This post shows three techniques to reduce those costs without compromising encryption: optimizing file formats (including Apache Iceberg), aggregating data, and using AWS Glue Data Catalog partition indexes.