Sold by: Software Sushi
Deployed on AWS
Free Trial
AnythingLLM is a self-hosted workspace for chatting with your own documents and websites (RAG) using the LLM and embedding providers you choose. This Ubuntu 24.04 AMI stores documents persistently and creates its admin password on first boot. You reach the UI through Session Manager port forwarding.
Overview
AnythingLLM 1.17.0 lets teams load documents and web pages into workspaces and ask questions about them with a large language model (retrieval-augmented generation). This AMI is for teams that want that workbench inside their own account, with data on an EBS volume they control and the UI kept off the public internet.
What you get: AnythingLLM listening on localhost port 3001, a per-instance admin password generated at first boot (/etc/anythingllm/admin.password, readable only with sudo), persistent document storage under /var/lib/anythingllm, and a separately pinned Chrome for Testing runtime for the built-in web page collector. No provider keys or model weights are included. Configure your LLM and embedding providers in the UI after launch.
Getting started takes a few minutes: launch t3.medium (4 GiB RAM, 40 GiB encrypted gp3 or larger), attach an instance profile with AmazonSSMManagedInstanceCore, allow outbound HTTPS and keep the security group free of inbound rules. Connect with Session Manager, run sudo -iu ubuntu bash /opt/sushi/docs/demo.sh, then start a Session Manager port-forwarding session to port 3001 and open that port on localhost in your browser. To chat, choose the Generic OpenAI provider with any OpenAI-compatible endpoint, including Amazon Bedrock through its OpenAI-compatible endpoint for your Region (see the Bedrock documentation) with a Bedrock API key, and set each workspace's chat mode to Chat for plain document Q&A.
Pricing: a software fee of USD 0.02 per running t3.medium instance-hour. An optional five-day free trial for one concurrent instance changes software billing only and then converts to the hourly fee; the same full software is installed before and after it. This is not a separate trial or evaluation edition, and there is no product-imposed time, user or usage limit. Additional concurrent instances incur software fees. EC2, EBS, data transfer and any model-provider charges are billed separately, including during the free trial. No annual offer is configured.
This is a repackaged open source software product wherein additional charges apply for independent packaging, validation, maintenance and setup documentation. Mintplex Labs authors AnythingLLM under the MIT license. Software Sushi supplies the AMI recipe, derived runtime and setup guide without claiming upstream endorsement. Google Chrome terms apply separately to the bundled browser. Back up /var/lib/anythingllm and /etc/anythingllm together before replacing an instance.
Highlights
- Chat with your own documents and web pages (RAG) using the LLM and embedding providers you choose, including Amazon Bedrock through its OpenAI-compatible endpoint.
- Documents persist on your EBS volume, and each instance creates its own admin password on first boot.
- The UI stays off the internet: it binds to localhost and you reach it through Session Manager port forwarding.
Details
Sold by
Categories
Delivery method
Delivery option
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 24.04
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Free trial
Try this product free for 5 days according to the free trial terms set by the vendor. Usage-based pricing is in effect for usage beyond the free trial terms. Your free trial gets automatically converted to a paid subscription when the trial ends, but may be canceled any time before that.
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/hour |
|---|---|
t3.medium Recommended | $0.02 |
Vendor refund policy
We offer a full refund of software charges for the first 48 hours billing starts if the product does not perform as described. To request a refund, email info@softwaresushi.com with your EC2 instance ID and a description of the issue. AWS infrastructure costs (EC2, EBS, data transfer) are billed by AWS and are not eligible for refund by us.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
AnythingLLM v1.17.0 (MIT, by Mintplex Labs) on Ubuntu 24.04 LTS, packaged by Software Sushi with a Sushi-derived runtime and a separately pinned Chrome for Testing browser for the web page collector. The UI listens on 127.0.0.1:3001 and is reached through Session Manager port forwarding; the admin password is generated at first boot. Documents persist under /var/lib/anythingllm. Includes a guided walkthrough (sudo -iu ubuntu bash /opt/sushi/docs/demo.sh). No provider keys or model weights are included.
Additional details
Usage instructions
- Launch t3.medium (4 GiB RAM, 40 GiB or larger encrypted gp3, IMDSv2) with AmazonSSMManagedInstanceCore and outbound HTTPS. No inbound rules are needed.
- Connect: aws ssm start-session --target <instance-id>. After cloud-init finishes, run: sudo -iu ubuntu bash /opt/sushi/docs/demo.sh (expect SUSHI_CUSTOMER_DEMO_PASSED).
- Read the admin password: sudo cat /etc/anythingllm/admin.password
- From your workstation: aws ssm start-session --target <instance-id> --document-name AWS-StartPortForwardingSession --parameters '{"portNumber":["3001"],"localPortNumber":["3001"]}', open http://127.0.0.1:3001 and sign in.
- LLM: in Settings > LLM choose Generic OpenAI with any OpenAI-compatible endpoint and key. For Amazon Bedrock use Base URL https://bedrock-runtime.us-east-1.amazonaws.com/openai/v1 , a Bedrock API key and a model such as openai.gpt-oss-20b-1:0. The built-in AWS Bedrock option needs keys and does not use the instance role.
- New workspaces start in automatic (agent) mode; set Chat mode to Chat in workspace settings for plain document chat. Docs: https://docs.anythingllm.com . Back up /var/lib/anythingllm and /etc/anythingllm together.
Resources
Vendor resources
Support
Vendor support
Software Sushi provides installation and configuration guidance for this image. Contact info@softwaresushi.com with your product version and the steps you took; never send credentials or private documents. Guaranteed response times require a separate agreement. This offer does not include Mintplex Labs or Google support.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
Production-ready Hermes AI messaging agent on hardened Ubuntu 24.04. Add your model-provider and Telegram credentials and run it in your AWS account.
Langfuse is an open source LLM observability platform for tracing, evaluating and debugging LLM applications. This Ubuntu 24.04 AMI runs the full single-node stack with per-instance credentials created at first boot, and you reach the UI through AWS Systems Manager port forwarding.
Open Interpreter lets a language model write and run code to get real work done from plain-English requests: analyze and chart data, clean up files, convert formats and automate scripts. This Ubuntu 24.04 image runs it on an isolated cloud instance instead of your laptop, asks before running any code and works with the model provider you choose.
This is a repackaged open source software product wherein additional charges apply for AMI packaging, first-boot configuration and setup documentation. Run rclone v1.75.1 on Ubuntu 24.04 with a daily copy timer, local destination defaults, checksum check script, and optional customer object-storage destination via instance role.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.