AWS and NVIDIA have collaborated for over 10 years to continually deliver powerful, cost-effective, and flexible GPU-based solutions for customers. These innovations span from the cloud, with NVIDIA GPU-powered Amazon EC2 instances, to the edge, with services such as AWS IoT Greengrass deployed with NVIDIA Jetson Nano modules.

Customers around the world are using AWS and NVIDIA solutions for machine learning (ML), virtual workstations, high performance computing (HPC), and IoT services. Amazon EC2 instances powered by NVIDIA GPUs deliver the scalable performance needed for fast ML training, cost-effective ML inference, flexible remote virtual workstations, and powerful HPC computations. At the edge, customers can use AWS IoT Greengrass to extend a wide range of AWS cloud services to NVIDIA-based edge devices so the devices can act locally on the data they generate.

AWS and NVIDIA
Introducing Amazon EC2 P4d instances (2:00)

Workloads

Machine Learning

Machine Learning

GPU instances for fast ML training and cost-effective inferences

For data scientists, researchers, and developers who need to speed up ML training, Amazon EC2 P4d instances deliver the highest performance for ML training in the cloud. P4d instances are powered by the latest NVIDIA A100 Tensor Core GPUs and deliver industry-leading high throughput and low latency networking. In addition, for more customized ML training, previous generation Amazon EC2 P3 instances offer several instance sizes and can deliver up to one petaflop of mixed-precision performance per instance with up to 8 NVIDIA V100 Tensor Core GPUs. Complementing P4d and P3 instances, for ML inference, Amazon EC2 G4 instances featuring NVIDIA T4 Tensor Core GPUs deliver the most cost-effective GPU instances in the cloud for ML inference.

Learn more about Amazon EC2 P4 instances »

Learn more about Amazon EC2 P3 instances »

Learn more about Amazon EC2 G4 instances »

Amazon EC2 P3 Instances (2:18)
Virtual Workstations

Virtual Workstations

Adapt your workforce and access creative talent across the globe

Virtual workstations on AWS enable studios to take on bigger projects, work from anywhere, and pay only for what they need. Running on Amazon EC2 G4 instances powered by NVIDIA T4 Tensor Core GPUs, virtual workstations employ the power of NVIDIA Quadro technology, the visual computing platform trusted by creative and technical professionals.


Learn more about virtual workstations on AWS »

Studio in the Cloud for Digital Content Creation (4:52)
High Performance Compute

High Performance Compute

Solve large computational problems and gain new insights

Amazon EC2 P4d instances powered by NVIDIA A100 Tensor Core GPUs are an ideal platform to run engineering simulations, computational finance, seismic analysis, molecular modeling, genomics, rendering, and other GPU compute workloads. High performance computing (HPC) allows scientists and engineers to solve these complex, compute-intensive problems. HPC applications often require high network performance, fast storage, large amounts of memory, high compute capabilities, or all of the above. AWS enables customers to increase the speed of research and reduce time-to-results by running HPC in the cloud and scaling to larger numbers of parallel tasks than would be practical in most on-premises environments.

Learn more about Amazon EC2 P4 instances »

Fueling HPC on AWS with GPUs (33:46)
Internet of Things

Internet of Things

Seamlessly extend AWS to edge devices so they can act locally

AWS IoT Greengrass seamlessly extends AWS to edge devices such as NVIDIA Jetson devices so they can act locally on the data they generate, while still using the cloud for management, analytics, and durable storage. With AWS IoT Greengrass, NVIDIA Jetson devices can run AWS Lambda functions, Docker containers, or both; execute predictions based on ML models; keep device data in sync; and communicate with other devices securely – even when not connected to the Internet.

Learn about how to integrate NVIDIA DeepStream on Jetson Modules with AWS IoT Core and AWS IoT Greengrass.

Read the blog post »

Deploy AI with AWS ML IOT Services on Jetson Nano (1:03:58)

Industries

Healthcare & Life Sciences

Healthcare and Life Sciences

AWS is the trusted technology partner for the global healthcare and life sciences industry. As the most mature and reliable cloud platform AWS provides the security and privacy to operate in a highly regulated industry. AWS and NVIDIA deliver solutions such as machine learning services that enable healthcare providers to deliver better patient outcomes.

Example customers: Subtle Medical and Mathworks

Financial Services

Financial Services

AWS provides financial services institutions across banking, payments, capital markets, and insurance with secure, resilient global cloud infrastructure and services they need to differentiate themselves today and adapt to the needs of tomorrow. AWS and NVIDIA provide solutions that help financial services companies customize the user experience and provide a secure environment for their transactions.

Example customers: Nerdwallet and Pathwise

Media & Entertainment

Media and Entertainment

Media and entertainment customers face industry-wide transformation, with companies reinventing how they create content, optimize media supply chains, and compete for audience attention across streaming, broadcast, and direct-to-consumer platforms. AWS and NVIDIA provide solutions to assist customers across all aspects of content development.

Example customers: Untold Studios, Hyperconnect, Hive VFX, Snap, and Sway

Telecom

Telecom

AWS is powering the future of telecommunications. Leading communications service providers run more workloads on AWS than any other cloud provider. AWS and NVIDIA provide solutions across a broad range of areas ranging from delivering maintenance solutions to providing GPU processing power at the Edge with AWS Outposts and AWS Wavelength.

Example customers: NTT Docomo

Automotive

Automotive

Connected, autonomous, shared, and electric vehicle trends are converging to revolutionize the automotive industry. AWS and NVIDIA provide a broad set of capabilities, including AI/ML, IoT, HPC, and data analytics with a relentless pace of innovation.

Case Studies

AWS and NVIDIA Services

Amazon EC2 P4d instances

Amazon EC2 P4d instances

Amazon EC2 P4d instances deliver the highest performance for ML training and HPC applications in the cloud. P4d instances are powered by the latest NVIDIA A100 Tensor Core GPUs and deliver industry-leading high throughput and low latency networking.
 
 
EC2 P3 Instances

Amazon EC2 P3 instances

Amazon EC2 P3 instances feature up to 8 NVIDIA V100 Tensor Core GPUs and up to 100 Gbps of networking throughput for ML and HPC applications. P3 instances have been proven to reduce ML training times from days to minutes, as well as increase the number of simulations completed for HPC by 3-4x.
 
EC2 P4 Instances

Amazon EC2 G4 instances

Amazon EC2 G4 instances feature NVIDIA T4 Tensor Core GPUs, providing access to one GPU or multiple GPUs, with different amounts of vCPU and memory. G4 instances provide the industry’s most cost-effective and versatile GPU instance for deploying ML models in production and graphics-intensive applications.
 

AWS IoT Greengrass

AWS IoT Greengrass seamlessly extends AWS to edge devices, such as NVIDIA Jetson systems, so they can act locally on the data they generate, while still using the cloud for management, analytics, and durable storage. AWS IoT Greengrass lets connected devices operate even with intermittent connectivity to the cloud.

Explore NVIDIA NGC Catalog in AWS Marketplace

Build, optimize, and deploy ML solutions faster with the latest GPU-optimized software from NVIDIA.

Get Started with NVIDIA on AWS