Sold by: Software Sushi
Deployed on AWS
Free Trial
AnythingLLM is a self-hosted workspace for chatting with your own documents and websites (RAG) using the LLM and embedding providers you choose. This Ubuntu 24.04 AMI stores documents persistently and creates its admin password on first boot. You reach the UI through Session Manager port forwarding.
Overview
AnythingLLM 1.17.0 lets teams load documents and web pages into workspaces and ask questions about them with a large language model (retrieval-augmented generation). This AMI is for teams that want that workbench inside their own account, with data on an EBS volume they control and the UI kept off the public internet.
What you get: AnythingLLM listening on localhost port 3001, a per-instance admin password generated at first boot (/etc/anythingllm/admin.password, readable only with sudo), persistent document storage under /var/lib/anythingllm, and a separately pinned Chrome for Testing runtime for the built-in web page collector. No provider keys or model weights are included. Configure your LLM and embedding providers in the UI after launch.
Getting started takes a few minutes: launch t3.medium (4 GiB RAM, 40 GiB encrypted gp3 or larger), attach an instance profile with AmazonSSMManagedInstanceCore, allow outbound HTTPS and keep the security group free of inbound rules. Connect with Session Manager, run sudo -iu ubuntu bash /opt/sushi/docs/demo.sh, then start a Session Manager port-forwarding session to port 3001 and open that port on localhost in your browser. To chat, choose the Generic OpenAI provider with any OpenAI-compatible endpoint, including Amazon Bedrock through its OpenAI-compatible endpoint for your Region (see the Bedrock documentation) with a Bedrock API key, and set each workspace's chat mode to Chat for plain document Q&A.
Pricing: a software fee of USD 0.02 per running t3.medium instance-hour. An optional five-day free trial for one concurrent instance changes software billing only and then converts to the hourly fee; the same full software is installed before and after it. This is not a separate trial or evaluation edition, and there is no product-imposed time, user or usage limit. Additional concurrent instances incur software fees. EC2, EBS, data transfer and any model-provider charges are billed separately, including during the free trial. No annual offer is configured.
This is a repackaged open source software product wherein additional charges apply for independent packaging, validation, maintenance and setup documentation. Mintplex Labs authors AnythingLLM under the MIT license. Software Sushi supplies the AMI recipe, derived runtime and setup guide without claiming upstream endorsement. Google Chrome terms apply separately to the bundled browser. Back up /var/lib/anythingllm and /etc/anythingllm together before replacing an instance.
Highlights
- Chat with your own documents and web pages (RAG) using the LLM and embedding providers you choose, including Amazon Bedrock through its OpenAI-compatible endpoint.
- Documents persist on your EBS volume, and each instance creates its own admin password on first boot.
- The UI stays off the internet: it binds to localhost and you reach it through Session Manager port forwarding.
Details
Sold by
Categories
Delivery method
Delivery option
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 24.04
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Free trial
Try this product free for 5 days according to the free trial terms set by the vendor. Usage-based pricing is in effect for usage beyond the free trial terms. Your free trial gets automatically converted to a paid subscription when the trial ends, but may be canceled any time before that.
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/hour |
|---|---|
t3.medium Recommended | $0.02 |
Dimensions summary
This listing bills on a single usage-based dimension: an hourly software fee for the t3.medium instance size. You pay this fee for each hour the instance runs, with no upfront commitment. Pricing scales directly with runtime, so stopping the instance stops the software charge. AWS infrastructure costs, including EC2 compute, EBS storage, and data transfer, are billed separately by AWS. Any model or embedding providers you connect bill their own usage under your own accounts. There are no additional tiers or add-on dimensions to choose from.
Top-of-mind questions for buyers
The t3.medium instance provides 4 GiB of memory. It runs on an encrypted gp3 root volume of at least 40 GiB with IMDSv2. The default vector database needs a CPU with AVX2, which T3 instances supply. Documents and vectors grow with use, so watch your disk space.
You pay the hourly software fee only while the instance runs. Stopping the instance stops the software charge. Note that AWS may still bill EBS storage for a stopped instance, since your documents and vectors persist on the EBS volume across restarts and reboots.
AWS bills EC2 compute, EBS storage, and data transfer separately from the software fee. Any language model or embedding providers you connect bill their own usage under your own accounts. No provider keys or model weights come with the image, so those charges are yours to manage.
docs.softwaresushi.com
Helpful?
Vendor refund policy
We offer a full refund of software charges for the first 48 hours billing starts if the product does not perform as described. To request a refund, email info@softwaresushi.com with your EC2 instance ID and a description of the issue. AWS infrastructure costs (EC2, EBS, data transfer) are billed by AWS and are not eligible for refund by us.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
AnythingLLM v1.17.0 (MIT, by Mintplex Labs) on Ubuntu 24.04 LTS, packaged by Software Sushi with a Sushi-derived runtime and a separately pinned Chrome for Testing browser for the web page collector. The UI listens on 127.0.0.1:3001 and is reached through Session Manager port forwarding; the admin password is generated at first boot. Documents persist under /var/lib/anythingllm. Includes a guided walkthrough (sudo -iu ubuntu bash /opt/sushi/docs/demo.sh). No provider keys or model weights are included.
Additional details
Usage instructions
- Launch t3.medium (4 GiB RAM, 40 GiB or larger encrypted gp3, IMDSv2) with AmazonSSMManagedInstanceCore and outbound HTTPS. No inbound rules are needed.
- Connect: aws ssm start-session --target <instance-id>. After cloud-init finishes, run: sudo -iu ubuntu bash /opt/sushi/docs/demo.sh (expect SUSHI_CUSTOMER_DEMO_PASSED).
- Read the admin password: sudo cat /etc/anythingllm/admin.password
- From your workstation: aws ssm start-session --target <instance-id> --document-name AWS-StartPortForwardingSession --parameters '{"portNumber":["3001"],"localPortNumber":["3001"]}', open 127.0.0.1:3001 in your browser (plain http) and sign in.
- LLM: in Settings > LLM choose Generic OpenAI with any OpenAI-compatible endpoint and key. For Amazon Bedrock use Base URL https://bedrock-runtime.us-east-1.amazonaws.com/openai/v1 , a Bedrock API key and a model such as openai.gpt-oss-20b-1:0. The built-in AWS Bedrock option needs keys and does not use the instance role.
- New workspaces start in automatic (agent) mode; set Chat mode to Chat in workspace settings for plain document chat. Docs: https://docs.anythingllm.com . Back up /var/lib/anythingllm and /etc/anythingllm together. Launch guide: https://docs.softwaresushi.com/launch-kit/
Resources
Support
Vendor support
Software Sushi provides installation and configuration guidance for this image. Contact info@softwaresushi.com with your product version and the steps you took; never send credentials or private documents. Guaranteed response times require a separate agreement. This offer does not include Mintplex Labs or Google support.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
Evaluate assistant answers with DeepEval on Ubuntu 24.04, with optional model judging and saved JSON score reports. This is paid repackaged open-source software.
Compare prompt variants, run response assertions and inspect persisted JSON and SQLite evaluation results with Promptfoo on Ubuntu 24.04.
LiteLLM Proxy gives all your applications one OpenAI-compatible API in front of the LLM providers you use, so you can switch or combine models and keep provider keys in one place without changing application code. This Ubuntu 24.04 image starts the open source LiteLLM 1.104.2 gateway on first boot, with loopback-only HTTPS and a per-instance master key.
Pre-installed and security-hardened OpenClaw AI agent AMI. Launch an EC2 instance, add your credentials, and start using your agent. Ready to configure out of the box.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.