Sold by: Techlatest.net
Deployed on AWS
Preconfigured LocalAI virtual machine for running AI models on your own infrastructure. Unified platform for AI Chat image and voice generation LLMs and embeddings with OpenAI API compatibility.
Available in both CPU and GPU configurations.
Overview
Important: For step by step guide on how to setup this vm please refer to our Getting Started guide
Run powerful language models autonomous agents and document intelligence workloads directly on your own infrastructure with a fully configured LocalAI virtual machine.
LocalAI is a lightweight Drop in replacement for OpenAI platform that enables you to run AI models locally without depending on external AI services. Built with a lean and composable architecture LocalAI downloads and uses only the model backends you need helping reduce resource usage and simplify operations.
Key Features
- LocalAI preinstalled and preconfigured
- Privacy focused Maintain full control over your data
- No third party API or token consumption costs or budget overruns
- Drop in API compatibility OpenAI Anthropic ElevenLabs APIs
- Run LLM embedding image audio and vision models
- Built in web interface for model management
- One click model installation
- Available in both CPU only and GPU accelerated deployments
LocalAI supports 36+ backends including llama.cpp vLLM transformers whisper cpp diffusers MLX MLX VLM and many more.
Disclaimer Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and or names or their products and are the property of their respective owners. We disclaim proprietary interest in the marks and names of others.
Highlights
- Deploy & Run AI locally in minutes. No vendor lock-in, no usage limits or budget constraints. OpenAI-compatible APIs.
Details
Sold by
Delivery method
Delivery option
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 24.04 LTS
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/hour |
|---|---|
t2.large Recommended | $0.09 |
g4ad.4xlarge | $0.09 |
m7a.32xlarge | $0.09 |
g3.8xlarge | $0.09 |
x1e.8xlarge | $0.09 |
c5d.2xlarge | $0.09 |
r6a.16xlarge | $0.09 |
m6a.xlarge | $0.09 |
c8i-flex.2xlarge | $0.09 |
c8in.24xlarge | $0.09 |
Vendor refund policy
Will be charged for usage, can be canceled anytime and usage fee is non refundable.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
first release
Additional details
Usage instructions
-
On the EC2 Console page instance is up and running. To connect to this instance through putty copy the IPv4 Public IP Address.
(refer Putty Guide available at https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/connect-linux-inst-from-windows.html for details on how to connect using putty/ssh)
-
Open putty paste the IP address and browse your private key you downloaded while deploying the VM by going to SSH->Auth click on Open.
-
login as ubuntu
-
run below command to update the password of ubuntu user.
sudo passwd ubuntu
-
To connect using RDP via Windows Machine copy the public IP address of the VM from VM details page then from your local windows machine goto start menu in the search box type and select Remote desktop connection. In the Remote Desktop connection wizard copy the public IP address and click connect.
-
This will connect you to the VM desktop environment. Provide the username as ubuntu and the password set in the step 4 to authenticate. Click OK.
-
Now you are connected to the out of box LocalAI: Self-Hosted Alternative to OpenAI & Anthropic VM desktop environment via Windows Machine.
-
To access the LocalAI Web Interface copy the public IP address of the VM and paste it in your local browser as:
https://public_ip_of_vm
Browser will display an SSL certificate warning message. Expand the warning message accept the certificate warning and Continue.
-
It will open a Signup page. Provide the Email-ID Username and Password of your choice and click Create Admin Account button.
-
Now you are logged in to LocalAI Web Interface.
For more details please visit - https://techlatest.net/support/local-ai-support/aws_gettingstartedguide/ index.html
Support
Vendor support
Email: info@techlatest.net
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
This product includes additional charges for seller support. Root partition and filesystem automatically expands at boot for volumes larger than 8 GiB, for seamless scalability. Preconfigured with Cloud-init and ENA support for enhanced network performance. LocalAI.io provides a cutting-edge solution for running and deploying AI models directly on your local infrastructure. With support for advanced machine learning frameworks, seamless integrations, and optimized performance, LocalAI.io enables businesses to achieve low-latency, cost-effective AI capabilities while maintaining full data sovereignty and control. Ideal for privacy-sensitive applications and edge deployments, LocalAI.io empowers users to scale AI workflows without relying on external cloud providers.
This product has charges associated with it for hardening, security configuration, and support.
LocalAI is an open-source, drop-in OpenAI-compatible API server delivered as a single statically linked Go binary - chat, embeddings, images, and audio served from your own VM with no GPU and no cloud egress. Unlike bare LocalAI AMIs that expose port 8080 unauthenticated to the public internet and ship without any TLS termination, this Lynxroute build is ready out of the box: per-instance LOCALAIAPIKEY at first boot, host Nginx with TLS in front of the API, the LocalAI process bound to loopback, UFW firewall pre-configured, and a CIS Level 1 hardened Ubuntu 24.04 LTS base.
MIT license - fully auditable, no vendor lock-in.
Self-hosted drop-in replacement for OpenAI API. Run LLMs, generate images, transcribe audio locally with full API compatibility. No GPU required for smaller models.
Deepdub GO is a cutting-edge virtual AI studio designed to streamline the post-production dubbing process. This platform empowers creators to produce high-quality localized content quickly and efficiently by leveraging proprietary emotion-based text-to-speech technologies and professional voice creation.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.