AWS Big Data Blog
Author: Avichay Marciano
Serverless analytics pipelines using the Apache Spark engine in Amazon Athena
This post shows how developers, data engineers, and analysts can connect to a secure Spark Connect endpoint in Athena with Apache Spark. You can use your preferred tools, such as Jupyter notebooks, VS Code, or dbt with Apache Airflow, without managing cluster lifecycle or scaling.