Overview
This is a repackaged open source software product wherein additional charges apply for a hardened, AWS-optimized image with verifiable provenance evidence and maintenance. Ollama 0.31 (CPU) runs on an Ubuntu 24.04 LTS base tuned for Amazon EC2, with a documented set of security settings applied on top and a complete provenance evidence pack including a Software Bill of Materials (SBOM).
Value-Added Features
Ollama 0.31 (CPU) Deployment:
-
No GPU Anywhere in the Stack: The qwen3:4b-instruct model and the Ollama runtime are baked into the image and tuned for CPU inference, so no GPU instance and no accelerator driver stack are required.
-
Fast First Answer: A boot-time prewarm step reads the model into memory in parallel with startup, so the API answers its first request about a minute and a half after first boot.
-
Safe Network Shape: An nginx reverse proxy publishes the OpenAI-compatible API on port 8000 while the native Ollama listener stays bound to the loopback interface.
Comprehensive Evidence Pack:
Every AMI carries an 8-file provenance evidence pack under /opt/optimization-report/:
- Tuning_Parameters.txt: Every tuning change, shown against its base-image value, with the reasoning and how to reverse it.
- Security_Parameters.txt: All 31 security settings in the same format; the 10 already at the wanted value are marked unchanged rather than presented as improvements.
- package_changes.txt: Packages upgraded, installed and removed versus the base image.
- sbom.spdx.json: Software Bill of Materials in SPDX format, generated from the dpkg database.
- cve_scan.txt / cve_scan_full.txt.gz: Vulnerability scan grouped by whether an upstream fix exists, so unfixable findings are not counted against the image.
- key_files.sha256: SHA-256 checksums of all 7 files this image changed, so the delivered state can be verified in one command.
- README.txt: Index of artifact contents and operational guidance.
Security & Attack Surface:
-
Kernel Network Hardening: 19 network-related kernel parameters are fixed in /etc/sysctl.d/99-security.conf: ICMP redirects are neither accepted nor sent, source-routed packets are rejected, and the rest are pinned at safe values so they cannot drift.
-
Unused Kernel Modules Disabled: 12 rarely used filesystem and network protocol modules are blocked from loading via /etc/modprobe.d/99-disable-unused.conf. squashfs stays available so snap-packaged agents keep working.
-
SSH Login Window Tightened: LoginGraceTime is reduced from 120 to 60 seconds. Root login policy, authentication retries and forwarding are left as the base image ships them.
-
Fully Patched at Release: Zero packages carried an available upstream fix at build time, including updates Ubuntu was still phasing in, and superseded kernel packages were removed rather than left behind.
AWS Network & Kernel Tuning:
-
Network Stack: TCP BBR congestion control with fair queueing, increased connection backlogs, raised socket buffer ceilings, and MTU probing enabled. Ceilings are only ever raised, never lowered.
-
System Tuning: tuned daemon active with an aws-optimized profile whose bootloader section is deliberately empty, so the kernel command line carries no net.ifnames entry and the network interface keeps its original name after a reboot - verified on this instance family.
-
Reliability: The systemd journal is capped at 200 MB so logs cannot fill the root filesystem, and superseded kernels are cleaned up automatically.
Operational Tools:
- Preinstalled Tools: AWS SSM Agent active, CloudWatch Agent installed (disabled by default).
Maintenance:
- Maintenance Specifications: Rebuilt and updated bi-weekly to monthly incorporating upstream Ollama and Ubuntu 24.04 security updates, with artifact documentation refreshed per release.
About Ollama
A widely adopted open-source runtime that packages large language models into a single self-contained server with a pull-and-run workflow and an OpenAI-compatible REST API. It pairs with chat front-ends and low-code automation platforms such as Open WebUI, LibreChat, Dify, Langflow and n8n, and backs RAG pipelines built on Milvus, Chroma, PostgreSQL and Redis.
About Ubuntu 24.04 LTS
The most widely deployed Linux distribution in the cloud, built on the Debian foundation, with a five-year maintenance window for LTS releases and broad ecosystem compatibility across the tooling these workloads depend on.
Highlights
- Ollama 0.31 CPU on an AWS-Optimized Ubuntu 24.04 Base: 19 security-related kernel parameters, 12 blocked modules and a tightened SSH login window applied on top, with the runtime, the baked-in model and its configuration untouched.
- Verifiable Evidence Pack and SBOM: An 8-file evidence pack ships inside the image, with an SPDX Software Bill of Materials, a CVE scan grouped by upstream fix availability, a package delta report, and SHA-256 checksums of every file the image changed.
- Ollama 0.31: Best-practice deployment. The qwen3:4b-instruct model is baked in and prewarmed at boot, the API is published through nginx on port 8000, and the image is rebuilt bi-weekly to monthly with upstream security patches.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
- ...
Dimension | Cost/hour |
|---|---|
c7i.xlarge Recommended | $0.19 |
t2.micro | $0.03 |
t3.micro | $0.03 |
t2.nano | $0.03 |
t3.nano | $0.00 |
t3a.nano | $0.03 |
t1.micro | $0.03 |
t3a.micro | $0.03 |
m1.small | $0.04 |
t2.small | $0.04 |
Vendor refund policy
No refunds. Cancel anytime.
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Latest Updates
Additional details
Usage instructions
Connection Methods
SSH is not required to use this product. The API key equals this instance's EC2 Instance ID, which is visible in the AWS console, so the inference API can be called as soon as the instance is ready. If you do want shell access, SSH into the instance; the default username is 'ubuntu'. You can switch to the root user environment by running: sudo su -
Install Information
- OS: Ubuntu 24.04 LTS (x86_64, Minimal Installation)
- Ollama: 0.31 (CPU-only build, main binary at /usr/local/bin/ollama)
- Pre-loaded Model: qwen3:4b-instruct, stored in /usr/share/ollama/.ollama on the root volume (20 GB gp3) - nothing is downloaded at runtime
- Runtime: CPU inference only, no GPU required. Tuned for Intel Sapphire Rapids or newer CPU families, for example c7i.xlarge.
- Reverse Proxy: nginx, site config at '/etc/nginx/sites-available/ollama-api' and API key matching at '/etc/nginx/ollama-apikey.conf'
- Ports: 8000 serves the outward-facing OpenAI-compatible API through nginx; the native Ollama port 11434 is bound to 127.0.0.1 only and is not reachable from outside the instance
- Config File: '/etc/ollama/api-key' (holds the current API key, refreshed at every boot)
- README: '/home/ubuntu/readme-ollama'
Usage Instructions
- Launch on a modern compute instance. Recommended: c7i.xlarge or larger (Intel Sapphire Rapids or a newer generation). No GPU instance is needed. Open port 8000 in the Security Group so clients can reach the API.
- Allow up to a few minutes on first boot before the API responds (measured: 97 seconds from instance start to the first working request). The instance prewarms the model into memory during startup. This prewarm runs on every boot, not only the first one - after each stop and start it takes roughly 10 to 20 seconds.
- Retrieve your API key: the key equals this instance's EC2 Instance ID, visible in the AWS console, so no SSH login is needed to obtain it. On the instance you can also read it with: cat /etc/ollama/api-key
- Send your first request to the OpenAI-compatible chat completions endpoint, substituting your instance IP and instance ID: curl http://<instance-ip>:8000/v1/chat/completions -H "Authorization: Bearer <instance-id>" -H 'Content-Type: application/json' -d '{"model":"qwen3:4b-instruct","messages":[{"role":"user","content":"Hello"}]}'
- Note that this is the CPU build: inference runs on the processor rather than a GPU, so responses are slower than on a GPU instance and a first token delay of about 10 seconds while the model loads is normal.
- Chat from the instance shell (optional, requires SSH): ollama run qwen3:4b-instruct
- Manage the service with: sudo systemctl start/stop/restart/status ollama, and the same commands for nginx. Two helper units also run at boot: ollama-apikey refreshes the API key, and ollama-prewarm loads the model into memory.
- View logs: Ollama has no separate log file and writes to the systemd journal - sudo journalctl -u ollama, or sudo journalctl -u nginx for the proxy
- Full documentation, including ready-to-copy request examples, is available on the instance at /home/ubuntu/readme-ollama
Firewall Configuration
- SSH (Port 22): Optional - needed only to read the full README on the instance or to run the local command-line chat; the inference API itself does not require SSH.
- Ollama API via nginx (Port 8000): Required - serves the outward-facing Chat and API traffic over the OpenAI-compatible protocol; restrict to trusted IPs.
- Security Recommendation: For production environments, strictly limit access to these ports to trusted IP addresses only via cloud Security Groups or the local firewall.
Support
Vendor support
Should you encounter any issues while using the system, please do not hesitate to contact us via email at: support@easyclouds.io ,Thank you!
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.