Nasdaq logo

Nasdaq Migrates Its Growing Data Warehouse to a More Modern Data Lake Architecture

2020

While most people know Nasdaq for its equities exchange, Nasdaq is also a technology and services provider to more than 120 different exchanges, regulators, and post-trade entities in more than 50 countries worldwide. Every evening, Nasdaq receives up to 60 billion records that must be loaded for billing, reporting, and other processes before the markets open the next morning. As that record volume increased over time, Nasdaq opted to migrate to a data lake solution in order to scale the ingest process and query data in a more parallel manner. Nasdaq moved its entire ingest process to Amazon Web Services (AWS), writing the data to Amazon Simple Storage Service (Amazon S3).

From there, Nasdaq chose Amazon Redshift Spectrum to enable its queries to run faster than in its existing data warehouse. According to Robert Hunt, vice president of software engineering for global surrounding systems at Nasdaq, “We have one billing process that went from taking about 40 minutes to now running at 4 minutes—a 90 percent improvement in that one process. But across all of the processes, we’re seeing 60–70 percent improvement across the board.” 

View the video below to learn more about how Nasdaq leveraged the AWS Data Lab for expert advice and recommendations to achieve its migration goals.

Watch Nasdaq’s session from re:Invent 2019 and learn more about AWS for Financial Services.

MORE ON NASDAQ

VIDEO
re:Invent 2021: Nasdaq Will Migrate Its First US Options Market Onto AWS
AWS re:Invent 2021
Nasdaq Will Migrate Its First US Options Market Onto AWS
President & CEO Adena Friedman shares how Nasdaq and AWS have formed a partnership to build the next generation of cloud-enabled infrastructure for the world’s capital markets.
Watch now 
CASE STUDY
Nasdaq sign
2020
Nasdaq Uses AWS to Pioneer Stock Exchange Data Storage in the Cloud
Nasdaq uses a data lake based on Amazon S3 and Amazon Redshift to ingest 70 billion records per day, load market data 5 hours faster, and run Amazon Redshift queries 32 percent faster.
Read more 
NASDAQ PRESS RELEASE

2021
Nasdaq and AWS Partner to Transform Capital Markets
At AWS re:Invent, Nasdaq and AWS announced a multi-year partnership to build the next generation of cloud-enabled infrastructure for the world’s capital markets.
Read more 
WALL STREET JOURNAL ARTICLE

2021
Nasdaq to Move Markets to Amazon’s Cloud
Nasdaq Inc. plans to begin moving its North American markets to AWS cloud-computing platform. The move, which will take a phased approach starting with Nasdaq MRX, a U.S. options market, involves turning over massive amounts of the exchange operator’s data to a third-party cloud service.
Read more 

Behind the Innovation. AWS is How.

Get Started

Organizations of all sizes across all industries are transforming their businesses and delivering on their missions every day using AWS. Contact our experts and start your own AWS journey today.