Sold by: Lynxroute
Deployed on AWS
Free Trial
This is a repackaged open source software product wherein additional charges apply for hardening, security configuration, and setup support.
vLLM is a high-throughput OpenAI-compatible inference server for open-source LLMs (Python + PyTorch CPU build), bundled with Open WebUI as a browser chat front end. This Lynxroute build is secured and ready out of the box: a random 32-byte API key generated at first boot, Bearer-token auth enforced on every /v1 request, vLLM and Open WebUI bound to loopback behind Nginx TLS, a default tiny model (facebook/opt-125m) preloaded so the API and chat work immediately, UFW firewall pre-configured, and a CIS Level 1 hardened Ubuntu 24.04 LTS base.
vLLM is Apache-2.0 licensed; Open WebUI uses a source-available license (see Long Description for details).
Overview
This is a repackaged open source software product wherein additional charges apply for hardening, security configuration, and setup support.
WHAT IS VLLM
vLLM is an open-source, high-throughput inference and serving engine for large language models, built in Python on top of PyTorch. It implements PagedAttention, continuous batching, and tensor parallelism to serve any HuggingFace-compatible transformer model (Llama, Mistral, Qwen, Phi, Gemma, OPT, GPT-J, MPT, Falcon, and 100+ more) through a fully OpenAI-compatible REST API. Any client built for OpenAI (openai-python, openai-node, LangChain, LlamaIndex, AnythingLLM, the OpenAI ChatGPT SDK) connects unchanged - just point the base URL at this instance and pass the local Bearer token. This AMI ships the CPU build of vLLM 0.26.0, bundled with Open WebUI 0.9.6 as a browser chat front end pre-wired to the local vLLM. Persists nothing externally - models cache to /var/lib/vllm/hf-cache, chats and accounts to /var/lib/open-webui. No vendor lock-in.
LICENSING NOTE
vLLM is Apache-2.0 licensed. Open WebUI is distributed under the source-available Open WebUI License (not an OSI-approved open-source license). The license permits self-hosted use without restriction; deployments with more than 50 end users in any 30-day window that also modify Open WebUI branding (name, logo) require a commercial Enterprise License from Open WebUI Inc. This AMI ships Open WebUI with the original branding preserved - the 50-user clause does not apply unless the operator rebrands.
WHAT THIS AMI ADDS
Security hardening:
- Random 32-byte API key generated at first boot, written to /root/vllm-credentials.txt - never baked into the AMI; the same key is injected into Open WebUI so the chat UI authenticates to vLLM transparently
- vLLM API server bound to 127.0.0.1:8000 only - reachable only through Nginx with TLS, with --api-key Bearer auth enforced on every /v1/* request
- Open WebUI bound to 127.0.0.1:8080 only - reachable only through Nginx with TLS
- First registered user in Open WebUI becomes the workspace administrator; no admin baked in
- Nginx reverse proxy with TLS, HTTP-to-HTTPS redirect, WebSocket upgrade for streaming chat, security headers (X-Content-Type-Options, X-Frame-Options, Referrer-Policy)
- Loading splash page served while the model warms up on first request
- Anonymous telemetry disabled (VLLM_NO_USAGE_STATS, DO_NOT_TRACK, ANONYMIZED_TELEMETRY)
- UFW firewall pre-configured - only TCP 22, 80, 443 are exposed; 8000 and 8080 explicitly denied
- fail2ban, AppArmor
- CVE scan - every image is scanned for vulnerabilities before release
Out of the box, with no external services:
- Default tiny model facebook/opt-125m (~250 MB) loaded at first boot - chat and API work immediately, no HuggingFace token required
- Swap to any HuggingFace-compatible model by editing /etc/vllm/server.env and restarting the service - no rebuild needed
- No third-party LLM API keys baked in or required - everything runs on-instance
OS hardening (CIS Level 1):
- CIS Ubuntu 24.04 LTS Level 1 benchmark applied via ansible-lockdown
- auditd, SSH hardening, kernel hardening, IMDSv2 enforced
Compliance artifacts:
- SBOM - CycloneDX 1.6 at /etc/lynxroute/sbom.json
- CIS Conformance Report at /etc/lynxroute/cis-report.html
- CIS Tailored Profile at /usr/share/doc/lynxroute/CIS_TAILORED_PROFILE.md
Highlights
- vLLM security baked in: random 32-byte API key generated at first boot, vLLM and Open WebUI bound to 127.0.0.1 behind Nginx TLS, Bearer-token auth enforced on every /v1 request, UFW firewall pre-configured, and models and chat data persisted under /var/lib on the instance only.
Details
Sold by
Categories
Delivery method
Delivery option
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 24.04
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Free trial
Try this product free for 5 days according to the free trial terms set by the vendor. Usage-based pricing is in effect for usage beyond the free trial terms. Your free trial gets automatically converted to a paid subscription when the trial ends, but may be canceled any time before that.
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/hour |
|---|---|
m6i.xlarge Recommended | $0.05 |
m6i.2xlarge | $0.05 |
m6i.large | $0.05 |
t3.large | $0.05 |
Dimensions summary
You pay by the hour based on the EC2 instance size you choose to run this hardened LLM server image. The four options are compute tiers: t3.large, m6i.large, m6i.xlarge, and m6i.2xlarge. Each step up gives you more CPU and memory, so hourly cost scales with the instance capacity you select. There are no separate feature tiers or add-ons. The same hardened, pre-configured image ships across all four sizes. You match the instance to your workload, then billing accrues per hour of use.
Top-of-mind questions for buyers
Each option maps to an AWS EC2 instance type. The t3.large and m6i sizes differ in CPU and memory. Larger instances like m6i.2xlarge give you more vCPUs and RAM. You pick the instance that matches your model size and traffic, and hourly cost reflects that instance's capacity.
The hourly software charge accrues only while the instance runs. A stopped instance stops accruing the hourly software fee. You may still pay underlying AWS storage costs for the volume. The software meters running time, so pausing outside working hours reduces the software portion of your bill.
Every size ships the same hardened Ubuntu 24.04 LTS base at CIS Level 1. Each includes CVE scanning results, a software bill of materials, and a conformance report bundled inside the instance. Unique credentials generate at first boot. Firewall, intrusion prevention, and access controls come pre-configured.
lynxroute.com
Helpful?
Vendor refund policy
We do not offer refunds for this product. AWS infrastructure charges (EC2, EBS, data transfer) are billed separately by AWS and are not refundable by us.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
vLLM 0.28.0 + Open WebUI 0.11.1
- vLLM upgraded to 0.28.0 (from 0.27.1) - OpenAI-compatible LLM inference server. The OpenAI API surface this image exposes is unchanged; upstream raises the default max_num_batched_tokens to 16384, moves bitsandbytes support to an out-of-tree plugin, and removes the deprecated calculate_kv_scales and override_attention_dtype options. Apache-2.0 unchanged
- Open WebUI upgraded to 0.11.1 (from 0.9.6). Replies now stream in increments instead of resending the whole message on every update, a reply in progress survives a page refresh, folders can be shared with users or groups under a new administrator permission that is off by default, and chat lists, file access checks and tool listings no longer slow down as an instance grows
- FIXED: the browser chat UI now works. The previous default model (facebook/opt-125m) is a base language model that defines no chat template, so the endpoint Open WebUI's chat box calls returned an error on every message while the direct API kept working. The default is now Qwen2.5-0.5B-Instruct (Apache-2.0, ~1GB, instruction-tuned), which answers in the chat UI out of the box. Any HuggingFace model can still be selected by editing /etc/vllm/server.env
- Open WebUI is source-available under the Open WebUI License, not MIT. Its branding may not be altered or removed in a deployment exceeding fifty end users in any rolling thirty-day period. This term is unchanged in 0.11.1
- Certbot pre-installed - enable a trusted HTTPS certificate with one command: sudo certbot --nginx -d yourdomain.com
- Rebuilt on the current CIS Level 1 hardened Ubuntu 24.04 LTS base to pick up the latest Ubuntu security updates
Additional details
Usage instructions
- Launch instance (m6i.xlarge recommended; minimum t3.large or m6i.large with 8 GB RAM)
- Open Security Group - allow TCP 443 from YOUR IP only until you have registered as the admin
- Open https://<PUBLIC_IP>/ in your browser - accept the self-signed certificate warning
- Click "Sign up" and register with YOUR real email - the first registered user becomes the workspace administrator
- Start chatting; the default model facebook/opt-125m is preloaded
- SSH if needed: ssh -i key.pem ubuntu@<PUBLIC_IP> ; credentials in /root/vllm-credentials.txt
To call the OpenAI-compatible API directly: curl https://<PUBLIC_IP>/v1/models -H "Authorization: Bearer <API_KEY>" -k The API key is the Bearer token shown in /root/vllm-credentials.txt.
To serve a different HuggingFace-compatible model: sudo nano /etc/vllm/server.env # change VLLM_MODEL=<huggingface-id> sudo systemctl restart vllm
After registration, restrict Security Group TCP 443 to your team's IP range. Replace the self-signed TLS certificate with a CA-signed certificate for production use.
Resources
Vendor resources
Support
Vendor support
Visit us online: https://lynxroute.com
For vLLM documentation: https://docs.vllm.ai/en/latest/getting_started/quickstart/ For vLLM upstream issues: https://github.com/vllm-project/vllm/issues For Open WebUI documentation: https://docs.openwebui.com/getting-started/ For Open WebUI upstream issues:
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
REQUIRES PRIVATE OFFER
To purchase LiteLLM Enterprise Self-Hosted, please reach out to sales@berri.ai for a Private Offer.
LiteLLM is an OpenAI compatible Proxy Server (LLM Gateway) to call 2,000+ LLM APIs using the OpenAI format Bedrock, Huggingface, VertexAI, TogetherAI, Azure OpenAI, OpenAI, etc. Get started with Opensource LiteLLM here: https://github.com/BerriAI/litellm (40,000+ Github Stars)
This product has charges associated with it for CoreNova hardening, AI stack packaging, maintenance, and seller support. Open WebUI + Ollama + vLLM Private AI Sandbox AMI packages Open WebUI, Ollama, vLLM, CUDA tooling, and HTTPS access for private LLM inference in your AWS account.
Deploy Open WebUI instantly with a preconfigured AMI for self hosted AI chat, LLM interaction, and collaborative AI workflows. This platform provides a modern web interface for large language models with secure access, customizable deployment, and scalable infrastructure for teams and developers.
This is a repackaged open source software product wherein additional charges apply for hardening, security configuration, and setup support.
Ollama + Open WebUI is a complete private AI stack - run Llama, Mistral, Gemma, and 100+ LLMs locally with a ChatGPT-like interface. No OpenAI subscription, no data leaving your VPC. Authentication enabled, Nginx TLS proxy, Ollama API localhost-only, and CIS Level 1 hardened Ubuntu 24.04 LTS base. Built and maintained by Lynxroute.
Models are not pre-loaded - pull via Web UI or CLI after launch. For GPU inference use g4dn.xlarge or g5.xlarge.
Ollama is MIT-licensed; Open WebUI uses a source-available license (see Long Description for details).
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.