Listing Thumbnail

    Open WebUI + Ollama + vLLM Private AI Sandbox AMI

     Info
    Deployed on AWS
    This product has charges associated with it for CoreNova hardening, AI stack packaging, maintenance, and seller support. Open WebUI + Ollama + vLLM Private AI Sandbox AMI packages Open WebUI, Ollama, vLLM, CUDA tooling, and HTTPS access for private LLM inference in your AWS account.

    Overview

    This is a repackaged open source software product wherein additional charges apply for CoreNova hardening, maintenance, validation notes, and seller support.

    Open WebUI + Ollama + vLLM Private AI Sandbox AMI is a private AI sandbox AMI for running local LLM workflows inside your AWS account. It packages a hardened Ubuntu base with Open WebUI, Ollama, vLLM, Docker, NVIDIA runtime integration, and an HTTPS front end so teams can launch an isolated AI workspace faster.

    Included AI stack

    • Open WebUI for browser-based chat, RAG workflows, and administration.
    • Ollama for local GGUF model serving; models are bring-your-own-model and are not bundled.
    • vLLM as an optional high-throughput OpenAI-compatible inference server.
    • Docker and NVIDIA container runtime integration for GPU instances.
    • HTTPS access through Nginx, with self-signed TLS on first boot that buyers can replace with their own certificate.

    First access

    After launch, allow 5 to 10 minutes for initialization. Open https://YOUR_PUBLIC_IP/ and sign in with the seeded administrator account. Public signup is disabled by default. Change the administrator password after first login.

    Security and privacy

    • Prompts, uploaded documents, embeddings, and model files remain in the buyer's AWS account.
    • Ollama and vLLM bind locally by default rather than exposing inference APIs directly to the internet.
    • SSH hardening, firewall controls, fail2ban, auditd, and unattended security updates are included where supported.
    • Optional secondary gp3 storage can be mounted at /mnt/models for model weights.

    Best for

    • Private AI demos and proof-of-concept deployments.
    • Teams testing local inference before building a larger platform.
    • Internal chat and RAG experiments where data should stay inside a VPC.

    Related CoreNova listings

    Support

    Email: support@corenovacloud.com  Web: https://www.corenovacloud.com/ 

    Include AWS Region, AMI ID, EC2 Instance ID, GPU instance type, browser error details, and steps to reproduce when opening a support request.

    Highlights

    • Private AI sandbox with Open WebUI, Ollama, vLLM, CUDA runtime integration, and HTTPS access.
    • Designed for local LLM inference inside the buyer's AWS account with signup disabled by default.
    • Hardened Ubuntu baseline with firewall controls, audit logging, fail2ban, and seller support.

    Details

    Delivery method

    Delivery option
    64-bit (x86) Amazon Machine Image (AMI)

    Latest version

    Operating system
    Ubuntu 22.04 LTS

    Deployed on AWS
    New

    Introducing multi-product solutions

    You can now purchase comprehensive solutions tailored to use cases and industries.

    Multi-product solutions

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    Open WebUI + Ollama + vLLM Private AI Sandbox AMI

     Info
    Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    Usage costs (7)

     Info
    Dimension
    Cost/hour
    g6.xlarge
    Recommended
    $0.25
    g5.12xlarge
    $0.25
    g6.48xlarge
    $0.25
    p5.48xlarge
    $0.25
    g5.xlarge
    $0.25
    g6.12xlarge
    $0.25
    g4dn.xlarge
    $0.25

    Vendor refund policy

    30-day refund on AWS Marketplace software fees for this product. Email support@corenovacloud.com  with your AWS account ID and purchase date. Software fees only; EC2 charges are not refundable by the seller. We reply within 5 business days. Free trial: no software charges during the trial.

    How can we make this page better?

    Tell us how we can improve this page, or report an issue with this product.
    Tell us how we can improve this page, or report an issue with this product.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    64-bit (x86) Amazon Machine Image (AMI)

    Amazon Machine Image (AMI)

    An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.

    Version release notes

    Enterprise Secure AI Inference Sandbox Ubuntu 22.04 LTS on Ubuntu 22.04 LTS (x86_64, HVM).

    Version: v20260610

    Stack:

    • SSH hardening: key-only access, root login disabled (user: ubuntu)
    • Firewall baseline (UFW)
    • auditd, rsyslog, chrony enabled
    • NVIDIA CUDA drivers pre-installed (verified with nvidia-smi)
    • NVIDIA AI Enterprise stack: CUDA 12.x, cuDNN, TensorRT
    • Ollama runtime for local LLM inference
    • Automatic security updates via unattended-upgrades

    Compliance: CIS Benchmark guidance with OpenSCAP profile for transparency. Organizations should run their own validation to meet specific regulatory requirements.

    Part of the CoreNova Hardened AMI product family.

    AMI: ami-0a72d9650178b60b5 (us-east-1)

    Additional details

    Usage instructions

    Overview

    Enterprise Secure AI Inference Sandbox Ubuntu 22.04 LTS - security-hardened AI inference AMI for Ubuntu 22.04 LTS (x86_64). Recommended instance type: g5.xlarge (GPU instances with NVIDIA AI stack pre-installed).

    Launch checklist

    Step 1 - Subscribe in AWS Marketplace, then Launch in us-east-1.

    Step 2 - Instance type: g5.xlarge, p3.2xlarge, g4dn.xlarge, or other NVIDIA GPU instance.

    Step 3 - Key pair: select your EC2 SSH key. Password login is disabled.

    Step 4 - Security group: allow inbound TCP 22 from your administrator IP only.

    First connection

    ssh -i your-key.pem ubuntu@YOUR_PUBLIC_IP

    Post-launch verify

    nvidia-smi Expected: shows NVIDIA driver version and GPU(s). systemctl is-active auditd chrony rsyslog sudo systemctl is-active ufw ollama list Expected: shows available AI models (if pre-configured).

    Support

    Email: support@corenovacloud.com  Web: https://www.corenovacloud.com/  Refund: 30-day refund on Marketplace software fees. EC2 charges not refundable by seller.

    Include AWS Region, AMI ID, EC2 Instance ID, instance type, and steps to reproduce.

    Support

    Vendor support

    Email: support@corenovacloud.com 

    Web: https://www.corenovacloud.com/ 

    CoreNova supports launch, SSH access, baseline service checks, Marketplace AMI metadata, and documented hardening behavior. Include AWS Region, AMI ID, EC2 Instance ID, instance type, and steps to reproduce.

    Refund: 30-day refund on Marketplace software fees for verified technical issues. AWS infrastructure charges are billed by AWS and are not refundable by the seller.

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 reviews
    No customer reviews yet
    Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.