Category: Amazon EMR on EKS
In this blog post, Alex, Pramod, and I will show how to install and use the infrastructure we built to perform quant research at scale. We made the stack and examples available in the public repository so you can use it in your own investment research. This solution uses Apache Spark, Amazon EMR on EKS, Docker, Karpenter, EMR Studio Notebooks, and AWS Data Exchange for Amazon S3.
In this blog post, Boris, Pramod, and Alex use Amazon Elastic MapReduce (Amazon EMR) to analyze historical market data provided by Refinitiv, part of LSEG, on AWS Data Exchange. We also show how AWS Data Exchange for Amazon S3 (Preview) and Amazon EMR enable us to eliminate undifferentiated heavy lifting and analyze terabytes of data cost-effectively by deploying Amazon EMR on Spot Instances.