Customer Stories / Financial Services / North America

2020
NASDAQ logo

Nasdaq Migrates Its Growing Data Warehouse to a More Modern Data Lake Architecture

Nasdaq moved its entire ingest process to Amazon Web Services (AWS), writing the data to Amazon Simple Storage Service (Amazon S3).

While most people know Nasdaq for its equities exchange, Nasdaq is also a technology and services provider to more than 120 different exchanges, regulators, and post-trade entities in more than 50 countries worldwide. Every evening, Nasdaq receives up to 60 billion records that must be loaded for billing, reporting, and other processes before the markets open the next morning. As that record volume increased over time, Nasdaq opted to migrate to a data lake solution in order to scale the ingest process and query data in a more parallel manner. Nasdaq moved its entire ingest process to Amazon Web Services (AWS), writing the data to Amazon Simple Storage Service (Amazon S3).

From there, Nasdaq chose Amazon Redshift Spectrum to enable its queries to run faster than in its existing data warehouse.  

According to Robert Hunt, vice president of software engineering for global surrounding systems at Nasdaq, “We have one billing process that went from taking about 40 minutes to now running at 4 minutes—a 90 percent improvement in that one process. But across all of the processes, we’re seeing 60–70 percent improvement across the board.” 

View the video below to learn more about how Nasdaq leveraged the AWS Data Lab for expert advice and recommendations to achieve its migration goals.

Watch Nasdaq’s session from re:Invent 2019 and learn more about AWS for Financial Services.

kr_quotemark

We have one billing process that went from taking about 40 minutes to now running at 4 minutes—a 90 percent improvement in that one process. But across all of the processes, we’re seeing 60–70 percent improvement across the board.”  

Robert Hunt
Vice President of Software Engineering, NASDAQ

AWS Services Used

Amazon S3

Object storage built to retrieve any amount of data from anywhere

Learn more »

Amazon Redshift

Power data driven decisions with the best price-performance cloud data warehouse

Learn more »

More Nasdaq Stories

Showing results: 5-8
Total results: 8

no items found 

  • United States

    Nasdaq

    Nasdaq: Moving mission-critical, low-latency workloads to AWS

    Nasdaq is migrating its first US options market, Nasdaq MRX, to the cloud using edge compute capabilities available in jointly engineered AWS Outposts that are tailored to its ultra–low latency needs.
    2022

  • United States

    Nasdaq

    How Nasdaq get clarity on data in seconds with Amazon QuickSight Q

    Amazon QuickSight Q is a machine learning–powered natural language capability that empowers business users to ask questions about all of their data using everyday business language and get answers in seconds.
    2022

  • United States

    Nasdaq

    Nasdaq: Compute innovation to enable any application in the cloud

    Nasdaq discusses how AWS has developed custom silicon optimized for the cloud and how you can take advantage of AWS compute innovations including processors, machine learning chips, and high-performance storage products.
    2022

  • North America

    Nasdaq

    Nasdaq Migrates Its Growing Data Warehouse to a More Modern Data Lake Architecture

    While most people know Nasdaq for its equities exchange, Nasdaq is also a technology and services provider to more than 120 different exchanges, regulators, and post-trade entities in more than 50 countries worldwide. Every evening, Nasdaq receives up to 60 billion records that must be loaded for billing, reporting, and other processes before the markets open the next morning. As that record volume increased over time, Nasdaq opted to migrate to a data lake solution in order to scale the ingest process and query data in a more parallel manner. Nasdaq moved its entire ingest process to Amazon Web Services (AWS), writing the data to Amazon Simple Storage Service (Amazon S3).
    2020
1 …
2
… 2

Get Started

Organizations of all sizes across all industries are transforming their businesses and delivering on their missions every day using AWS. Contact our experts and start your own AWS journey today.

Contact Sales