Develop, Optimize and Deploy GPU-Accelerated Apps - The NVIDIA® CUDA® Toolkit provides a development environment for creating high performance GPU-accelerated applications. With the CUDA Toolkit, you can develop, optimize, and deploy your applications on GPU-accelerated embedded systems, desktop workstations, enterprise data centers, cloud-based platforms and HPC supercomputers. To run CUDA 11.1 containers, ensure that your system has drivers 450.80.02 (or higher) installed.

Three flavors of CUDA container images are provided:

base: Includes the CUDA runtime (cudart)
runtime: Builds on the base and includes the CUDA math libraries, and NCCL. A runtime image that also includes cuDNN is available.
devel: Builds on the runtime and includes headers, development tools for building CUDA images. These images are particularly useful for multi-stage builds.

Please refer to the link here for CUDA samples to get started: https://docs.nvidia.com/cuda/cuda-samples/index.html#getting-cuda-samples