Overview
This is a repackaged open source software product wherein additional charges apply for technical support with a 24-hour response time. NVIDIA CUDA 13.2, built on a minimal Ubuntu 24.04 LTS installation, is included in this AMI, repackaged by Easycloud. It provides a complete, framework-neutral GPU compute base with the NVIDIA driver, the full CUDA Toolkit, GPU-enabled containers, and multi-node fabric libraries already assembled and validated together, deliberately engineered to let you start compiling and running accelerated workloads immediately instead of spending hours reconciling driver, toolkit, and container runtime versions.
Core Features & Integrations
-
Ubuntu 24.04 LTS Minimal: A renowned Linux distribution celebrated for its exceptional stability, vast software repository, and strict adherence to open-source principles. Built on the solid foundation of Debian, it provides unparalleled ecosystem compatibility while delivering a clean, bloat-free, and secure enterprise-grade core.
-
NVIDIA CUDA 13.2 with Driver 595.71.05 (GPU Compute Base): The full CUDA Toolkit is installed at /usr/local/cuda-13.2 with nvcc and the complete set of GPU math and profiling libraries already on PATH, so CUDA C++ and custom kernel extensions compile out of the box. The image pairs it with Docker 29.6.2 and the NVIDIA Container Toolkit 1.19.1 for GPU-enabled containers, EFA 3.0.0 with libfabric and the NCCL OFI plugin plus OpenMPI 4 and 5 for multi-node collective communication, and NVIDIA DCGM and Fabric Manager for GPU telemetry and NVSwitch-class instances. No deep learning framework is bundled, keeping the image a clean base you extend with exactly the stack your project needs.
Key Benefits
-
Framework-Neutral GPU Foundation with a Complete Toolchain: Unlike prebuilt framework images that pin you to one version of one library, this AMI ships the layer underneath them - driver, toolkit, container runtime, and fabric stack - and stops there. You choose the framework, the version, and the packaging, whether that means a pip installed training stack, a custom compiled CUDA extension, or a fleet of GPU containers, without first uninstalling somebody else's opinionated defaults or fighting a driver and toolkit mismatch.
-
The Optimal AI Inference and Orchestration Foundation: By starting with a bloat-free Ubuntu 24.04 LTS installation, maximum GPU, CPU, and memory are dedicated entirely to your accelerated workloads. This makes it the perfect, conflict-free foundation for AI and HPC stacks built on CUDA, PyTorch, TensorFlow, Hugging Face models, Python, Docker, and Kubernetes. It seamlessly integrates with model serving and orchestration layers (Ollama, Open WebUI, LibreChat, Dify, Langflow, Flowise, MLflow), and serves as a rock-solid backbone for RAG pipelines, vector search, and large-scale data processing built on RAGFlow, Milvus, Chroma, PostgreSQL, Apache Spark, MinIO, Grafana, and Prometheus, ensuring your GPU infrastructure scales without limits.
-
Production Ready & Expert Support: Secured with the latest OS patches. It delivers a highly stable environment, fully supported by comprehensive documentation and fast technical assistance (guaranteed 24-hour response time) to ensure your infrastructure runs smoothly without costly downtime.
Highlights
- Ubuntu 24.04 LTS (Minimal Installation),updated to the latest version.
- Professional installation following best practices.
- Expert Support: Backed by comprehensive documentation and fast, professional technical assistance.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
- ...
Dimension | Cost/hour |
|---|---|
g5.xlarge Recommended | $0.19 |
t2.micro | $0.03 |
t3.micro | $0.03 |
t2.nano | $0.03 |
t3.nano | $0.00 |
t3a.nano | $0.03 |
t1.micro | $0.03 |
t3a.micro | $0.03 |
m1.small | $0.04 |
t2.small | $0.04 |
Vendor refund policy
No refunds. Cancel anytime.
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Latest Updates
Additional details
Usage instructions
Connection Methods
Once launched, SSH into the instance. The default username is 'ubuntu'. You can switch to the root user environment by running: sudo su -
This product must be launched on a GPU-backed instance type (G4dn, G5, G6, P4, P5, or P6 family). On a CPU-only instance the NVIDIA driver has no device to bind to and nvidia-smi will report that no GPU was found.
Install Information
-
OS: Ubuntu 24.04 LTS (x86_64, Minimal Installation)
-
NVIDIA Driver: 595.71.05
-
CUDA Toolkit: 13.2 (full toolkit including nvcc), installed at /usr/local/cuda-13.2 with /usr/local/cuda symlinked to it
-
Containers: Docker 29 with containerd and NVIDIA Container Toolkit 1.19
-
Fabric and MPI: EFA 3.0.0 with libfabric-aws 2.4.0 and the NCCL OFI plugin 1.18 at /opt/amazon/efa, OpenMPI 4 at /opt/amazon/openmpi and OpenMPI 5 at /opt/amazon/openmpi5
-
GPU Management: NVIDIA DCGM (monitoring, enabled at boot) and NVIDIA Fabric Manager (for NVSwitch-equipped instance types)
-
Python: system Python 3.12 with boto3 and numpy
-
No deep learning framework is pre-installed: PyTorch, TensorFlow, and conda are intentionally absent so you can install your own stack
Usage Instructions
-
Launch on a GPU instance type. Recommended: g5.xlarge (A10G, 24 GB GPU memory) for general development and single-GPU inference, or a larger g6, p4, p5, or p6 instance for multi-GPU training. Root volume is 35 GB; increase it at launch if you plan to store large models or datasets.
-
SSH in as 'ubuntu' and confirm the GPU is visible: nvidia-smi The output shows driver 595.71.05 and the attached GPU. If it reports no devices, verify you launched a GPU instance type.
-
Compile CUDA code directly. nvcc is already on PATH: nvcc --version, then build with: nvcc -o myapp myapp.cu Headers and libraries resolve through /usr/local/cuda, so build systems that expect CUDA_HOME work unchanged.
-
Run GPU containers with no additional setup: sudo docker run --rm --gpus all nvidia/cuda:13.2.0-base-ubuntu24.04 nvidia-smi
-
Install your own framework into an isolated environment, for example: python3 -m venv ~/venv && source ~/venv/bin/activate && pip install torch Match the framework build to CUDA 13.2 when the project offers CUDA-specific wheels.
-
For multi-node jobs, use the bundled MPI stack by adding it to your environment: export PATH=/opt/amazon/openmpi/bin:$PATH EFA and the NCCL OFI plugin are already installed for high-bandwidth collective communication between EFA-capable instances placed in the same cluster placement group.
-
Monitor GPU health with DCGM, which starts automatically: sudo systemctl status nvidia-dcgm, then query devices with: dcgmi discovery -l
-
Manage services with systemctl start/stop/restart/status, for example: sudo systemctl restart nvidia-dcgm On NVSwitch-equipped instance types (for example p4d and p5), also verify: sudo systemctl status nvidia-fabricmanager
Firewall Configuration
-
SSH (Port 22): Required for administration, compiling and running your workloads, and installing your own framework stack.
-
Security Recommendation: For production environments, strictly limit access to these ports to trusted IP addresses only via cloud Security Groups or the local firewall.
Support
Vendor support
Should you encounter any issues while using the system, please do not hesitate to contact us via email at: support@easyclouds.io ,Thank you!
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.