Sold by: Techlatest.net
Deployed on AWS
Preconfigured LocalAI virtual machine for running AI models on your own infrastructure. Unified platform for AI Chat, image and voice generation, LLMs and embeddings with OpenAI API compatibility.
Available in both CPU and GPU configurations.
Overview
Important: For step by step guide on how to setup this vm please refer to our Getting Started guide
Run powerful language models, autonomous agents, and document intelligence workloads directly on your own infrastructure with a fully configured LocalAI virtual machine.
LocalAI is a lightweight, Drop-in replacement for OpenAI platform that enables you to run AI models locally without depending on external AI services. Built with a lean and composable architecture, LocalAI downloads and uses only the model backends you need, helping reduce resource usage and simplify operations.
Key Features
- LocalAI preinstalled and preconfigured
- Privacy focused - Maintain full control over your data
- No third party API or token consumption costs or budget overruns
- Drop - in API compatibility - OpenAI, Anthropic, ElevenLabs APIs
- Run LLM, embedding, image, audio and vision models
- Built-in web interface for model management
- One-click model installation
- Available in both CPU-only and GPU-accelerated deployments
LocalAI supports 36+ backends including llama.cpp vLLM, transformers, whisper cpp, diffusers, MLX, MLX-VLM, and many more.
Disclaimer Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and/or names or their products and are the property of their respective owners. We disclaim proprietary interest in the marks and names of others.
Highlights
- Deploy & Run AI locally in minutes. No vendor lock-in, no usage limits or budget constraints. OpenAI-compatible APIs.
Details
Sold by
Delivery method
Delivery option
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 24.04 LTS
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/hour |
|---|---|
t2.large Recommended | $0.09 |
m7a.32xlarge | $0.09 |
x1e.8xlarge | $0.09 |
c5d.2xlarge | $0.09 |
r6a.16xlarge | $0.09 |
m6a.xlarge | $0.09 |
c8i-flex.2xlarge | $0.09 |
c8in.24xlarge | $0.09 |
m5a.12xlarge | $0.09 |
c5.2xlarge | $0.09 |
Dimensions summary
You pay by the hour for the EC2 instance that runs this self-hosted AI software. The software price is the same across all options; your cost changes with the instance you pick. Each dimension maps to one AWS instance type, grouped into families for general-purpose, compute, memory, storage, and GPU-accelerated workloads. Sizes scale from small (large, xlarge) up to very large metal instances, so hourly cost rises with vCPU, memory, and hardware. GPU instances suit models needing acceleration; CPU-only instances suit lighter workloads. Choose the instance that matches your model size and performance needs.
Top-of-mind questions for buyers
Each dimension maps to one AWS EC2 instance running the preconfigured LocalAI virtual machine. The hourly rate covers the software plus that instance type's vCPU, memory, and hardware. The VM defaults to t2.xlarge with 4 vCPUs and 16 GB RAM, and ships with 50 GB disk you can increase.
Hourly software charges apply only while the instance runs. If you stop the VM to increase its size or disk for a larger model, software metering pauses. You may still owe underlying AWS storage fees for the stopped volume. You resume charges when you restart the instance.
The VM runs on both CPU-only and GPU-accelerated instances. GPU instances, such as the g4dn family, suit models needing acceleration or high VRAM. CPU-only instances suit lighter workloads. The web interface shows estimated VRAM per model, helping you match instance choice to your model before launching.
www.techlatest.net
Helpful?
Vendor refund policy
Will be charged for usage, can be canceled anytime and usage fee is non refundable.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
first release
Additional details
Usage instructions
-
On the EC2 Console page, instance is up and running. To connect to this instance through putty, copy the IPv4 Public IP Address.
(refer Putty Guide available at https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/connect-linux-inst-from-windows.html for details on how to connect using putty/ssh)
-
Open putty, paste the IP address and browse your private key you downloaded while deploying the VM, by going to SSH->Auth click on Open.
-
login as ubuntu
-
run below command to update the password of ubuntu user.
sudo passwd ubuntu
-
To connect using RDP via Windows Machine, copy the public IP address of the VM from VM details page, then from your local windows machine, goto "start" menu, in the search box type and select "Remote desktop connection". In the "Remote Desktop connection" wizard, copy the public IP address and click connect.
-
This will connect you to the VM desktop environment. Provide the username as ubuntu and the password set in the step 4 to authenticate. Click OK.
-
Now you are connected to the out of box LocalAI: Self-Hosted Alternative to OpenAI & Anthropic VM's desktop environment via Windows Machine.
-
To access the LocalAI Web Interface, copy the public IP address of the VM and paste it in your local browser as:
https://public_ip_of_vm
Browser will display an SSL certificate warning message. Expand the warning message, accept the certificate warning and Continue.
-
It will open a Signup page. Provide the Email-ID, Username and Password of your choice and click Create Admin Account button.
-
Now you are logged in to LocalAI Web Interface.
For more details please visit - https://techlatest.net/support/local-ai-support/aws_gettingstartedguide/ index.html
Support
Vendor support
Email: info@techlatest.net
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
The Claude Platform on AWS delivers the complete Claude experience through your AWS account, including IAM authentication, native billing, and commitment retirement. Access Claude's frontier models alongside API features like skills, code execution, web search, and MCP connectors.
OpenAI GPT-5.6 Terra brings a balanced GPT-5.6 model for everyday work, software engineering, knowledge workflows, and scalable AI applications to Amazon Bedrock.
OpenAI GPT-6.1 Sol brings intelligence approaching GPT-6 Astra to everyday work on Amazon Bedrock. Build and scale capable agents for coding, computer use, and professional workflows at Sol pricing.
Claude Enterprise gives every employee access to Claude Chat, Claude Code, and Cowork - Anthropic's full suite of AI tools for chat, coding, and workflow automation with enterprise-grade security, controls, and data privacy by default. Claude Enterprise is HIPAA-eligible, with a BAA available. Recently added capabilities include Claude Security and Claude Design. For AWS customers, spend draws down directly from your EDP or PPA commitment.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.