Overview
This is a repackaged open source software product wherein additional charges apply for a hardened, AWS-optimized image with verifiable provenance evidence and maintenance. NVIDIA CUDA 13.2 runs on an Ubuntu 24.04 LTS base tuned for Amazon EC2, with a documented set of security settings applied on top and a complete provenance evidence pack including a Software Bill of Materials (SBOM).
Value-Added Features
NVIDIA CUDA 13.2 Deployment:
-
Complete GPU Toolchain: The full CUDA Toolkit is installed at /usr/local/cuda-13.2 with nvcc and the GPU math and profiling libraries on PATH, so CUDA C++ and custom kernel extensions compile out of the box.
-
Containers and Fabric Included: Docker with the NVIDIA Container Toolkit, the EFA stack with libfabric and the NCCL OFI plugin, OpenMPI for multi-node collectives, and NVIDIA DCGM for telemetry.
-
Framework-Neutral by Design: No deep learning framework is bundled, so you pick the framework and version rather than uninstalling somebody else's defaults.
Comprehensive Evidence Pack:
Every AMI carries an 8-file provenance evidence pack under /opt/optimization-report/:
- Tuning_Parameters.txt: Every tuning change, shown against its base-image value, with the reasoning and how to reverse it.
- Security_Parameters.txt: All 31 security settings in the same format; the 10 already at the wanted value are marked unchanged rather than presented as improvements.
- package_changes.txt: Packages upgraded, installed and removed versus the base image.
- sbom.spdx.json: Software Bill of Materials in SPDX format, generated from the dpkg database.
- cve_scan.txt / cve_scan_full.txt.gz: Vulnerability scan grouped by whether an upstream fix exists, with the GPU stack pinning explained.
- key_files.sha256: SHA-256 checksums of all 7 files this image changed, so the delivered state can be verified in one command.
- README.txt: Index of artifact contents and operational guidance.
Security & Attack Surface:
-
Kernel Network Hardening: 19 network-related kernel parameters are fixed in /etc/sysctl.d/99-security.conf: ICMP redirects are neither accepted nor sent, source-routed packets are rejected, and the rest are pinned at safe values so they cannot drift.
-
Unused Kernel Modules Disabled: 12 rarely used filesystem and network protocol modules are blocked from loading. No NVIDIA, EFA or container module is affected, and squashfs stays available so snap-packaged agents keep working.
-
SSH Login Window Tightened: LoginGraceTime is reduced from 120 to 60 seconds. Root login policy, authentication retries and forwarding are left as the base image ships them.
-
No Outstanding Upstream Fixes: Every package outside the GPU pins was upgraded to the newest version its distribution offers, including updates Ubuntu was still phasing in. The scan reports zero findings that have a fix available and not installed.
GPU Stack Left Intact:
-
Driver and Toolkit Untouched: The NVIDIA driver, CUDA toolkit, EFA stack and container runtime are not modified. After a reboot nvidia-smi reports the same driver, every NVIDIA kernel module loads, and the kernel command line is byte for byte identical to the base image - verified on a GPU instance.
-
Version Pinning Respected: The kernel and GPU stack are held at fixed versions because the driver is built against one specific kernel. That pinning predates this release and is documented in the evidence pack, not silently overridden.
AWS Network & Kernel Tuning:
-
Network Stack: TCP BBR congestion control with fair queueing, increased connection backlogs, raised socket buffer ceilings, and MTU probing enabled. Ceilings are only ever raised, never lowered.
-
System Tuning: tuned daemon active with an aws-optimized profile whose bootloader section is deliberately empty, so the network interface keeps its original name after a reboot.
-
Reliability: The systemd journal is capped at 200 MB so logs cannot fill the root filesystem.
Operational Tools:
- Preinstalled Tools: AWS SSM Agent active, CloudWatch Agent installed (disabled by default).
Maintenance:
- Maintenance Specifications: Rebuilt and updated bi-weekly to monthly incorporating upstream Ubuntu 24.04 security updates, with artifact documentation refreshed per release.
About NVIDIA CUDA
A framework-neutral GPU compute base in which the driver, CUDA Toolkit, container runtime and fabric libraries are assembled and validated together, so accelerated workloads run immediately instead of requiring hours of reconciling versions. It suits AI and HPC stacks built on CUDA, PyTorch, TensorFlow, Docker and Kubernetes.
About Ubuntu 24.04 LTS
The most widely deployed Linux distribution in the cloud, built on the Debian foundation, with a five-year maintenance window for LTS releases and broad compatibility across AI and container tooling.
Highlights
- NVIDIA CUDA 13.2 on an AWS-Optimized Ubuntu 24.04 Base: 19 security-related kernel parameters, 12 blocked modules and a tightened SSH login window applied on top, with the driver, CUDA toolkit, EFA stack and kernel command line left untouched.
- Verifiable Evidence Pack and SBOM: An 8-file evidence pack ships inside the image, with an SPDX Software Bill of Materials, a CVE scan grouped by upstream fix availability, a package delta report, and SHA-256 checksums of every file the image changed.
- NVIDIA CUDA 13.2: Best-practice deployment. Full toolkit at /usr/local/cuda-13.2 with nvcc on PATH, GPU-enabled containers and multi-node fabric ready, framework-neutral so you choose your own stack.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
- ...
Dimension | Cost/hour |
|---|---|
g5.xlarge Recommended | $0.19 |
t2.micro | $0.03 |
t3.micro | $0.03 |
t2.nano | $0.03 |
t3.nano | $0.00 |
t3a.nano | $0.03 |
t1.micro | $0.03 |
t3a.micro | $0.03 |
m1.small | $0.04 |
t2.small | $0.04 |
Vendor refund policy
No refunds. Cancel anytime.
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Latest Updates
Additional details
Usage instructions
Connection Methods
Once launched, SSH into the instance. The default username is 'ubuntu'. You can switch to the root user environment by running: sudo su -
This product must be launched on a GPU-backed instance type (G4dn, G5, G6, P4, P5, or P6 family). On a CPU-only instance the NVIDIA driver has no device to bind to and nvidia-smi will report that no GPU was found.
Install Information
-
OS: Ubuntu 24.04 LTS (x86_64, Minimal Installation)
-
NVIDIA Driver: 595.71.05
-
CUDA Toolkit: 13.2 (full toolkit including nvcc), installed at /usr/local/cuda-13.2 with /usr/local/cuda symlinked to it
-
Containers: Docker 29 with containerd and NVIDIA Container Toolkit 1.19
-
Fabric and MPI: EFA 3.0.0 with libfabric-aws 2.4.0 and the NCCL OFI plugin 1.18 at /opt/amazon/efa, OpenMPI 4 at /opt/amazon/openmpi and OpenMPI 5 at /opt/amazon/openmpi5
-
GPU Management: NVIDIA DCGM (monitoring, enabled at boot) and NVIDIA Fabric Manager (for NVSwitch-equipped instance types)
-
Python: system Python 3.12 with boto3 and numpy
-
No deep learning framework is pre-installed: PyTorch, TensorFlow, and conda are intentionally absent so you can install your own stack
Usage Instructions
-
Launch on a GPU instance type. Recommended: g5.xlarge (A10G, 24 GB GPU memory) for general development and single-GPU inference, or a larger g6, p4, p5, or p6 instance for multi-GPU training. Root volume is 35 GB; increase it at launch if you plan to store large models or datasets.
-
SSH in as 'ubuntu' and confirm the GPU is visible: nvidia-smi The output shows driver 595.71.05 and the attached GPU. If it reports no devices, verify you launched a GPU instance type.
-
Compile CUDA code directly. nvcc is already on PATH: nvcc --version, then build with: nvcc -o myapp myapp.cu Headers and libraries resolve through /usr/local/cuda, so build systems that expect CUDA_HOME work unchanged.
-
Run GPU containers with no additional setup: sudo docker run --rm --gpus all nvidia/cuda:13.2.0-base-ubuntu24.04 nvidia-smi
-
Install your own framework into an isolated environment, for example: python3 -m venv ~/venv && source ~/venv/bin/activate && pip install torch Match the framework build to CUDA 13.2 when the project offers CUDA-specific wheels.
-
For multi-node jobs, use the bundled MPI stack by adding it to your environment: export PATH=/opt/amazon/openmpi/bin:$PATH EFA and the NCCL OFI plugin are already installed for high-bandwidth collective communication between EFA-capable instances placed in the same cluster placement group.
-
Monitor GPU health with DCGM, which starts automatically: sudo systemctl status nvidia-dcgm, then query devices with: dcgmi discovery -l
-
Manage services with systemctl start/stop/restart/status, for example: sudo systemctl restart nvidia-dcgm On NVSwitch-equipped instance types (for example p4d and p5), also verify: sudo systemctl status nvidia-fabricmanager
Firewall Configuration
-
SSH (Port 22): Required for administration, compiling and running your workloads, and installing your own framework stack.
-
Security Recommendation: For production environments, strictly limit access to these ports to trusted IP addresses only via cloud Security Groups or the local firewall.
Support
Vendor support
Should you encounter any issues while using the system, please do not hesitate to contact us via email at: support@easyclouds.io ,Thank you!
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.