AWS Clean Rooms supports writing PySpark job results to intermediate tables
AWS Clean Rooms now supports intermediate tables for PySpark jobs, offering increased flexibility for organizations running complex, multi-step analytical workflows with their partners. With this launch, customers can write the results of a PySpark job to an intermediate table for reuse in subsequent analyses. For example, a measurement vendor can perform feature engineering with PySpark, then use those results as input into an ML model training job to identify new high-value customers to inform audience targeting and bid optimization for their campaigns.
AWS Clean Rooms helps companies and their partners easily analyze and collaborate on their collective datasets without revealing or copying one another’s underlying data. For more information about the AWS Regions where AWS Clean Rooms is available, see the AWS Regions table. To learn more about collaborating with AWS Clean Rooms, visit AWS Clean Rooms.