Tabby is an open source, self-hosted AI coding assistant server for code completion and chat that runs in your own AWS account. This Ubuntu 24.04 AMI runs the Tabby v0.32.0 CPU server on localhost, with no model weights baked in; model-backed completion is untested until you attach a model. Attach the completion model you choose and keep code and prompts in your own AWS account.
Tabby v0.32.0 is a self-hosted coding assistant server: IDE extensions send code context to it and it returns completions and chat answers from a model you control. This AMI is for engineering teams that want a self-hosted copilot alternative inside their own AWS account.
What you get: the Tabby CPU server (official v0.32.0 release binaries, with SHA-256 recorded) listening on 127.0.0.1:8080, first-boot state under /var/lib/tabby, a loopback embedding stub on 127.0.0.1:18080 so the server starts without downloading any model, and an example config for attaching a model at /opt/sushi/etc/tabby/customer-model.example.toml. No completion, chat or embedding weights are included; completions and chat start working once you attach a model. Model-backed completion is untested in this image until you attach a model, so validate it with your chosen model before rolling it out to IDEs. The Enterprise web UI is disabled (--no-webserver); GPU/CUDA builds are out of scope.
Getting started takes a few minutes: launch t3.medium (16 GiB encrypted gp3 or larger, IMDSv2), attach an instance profile with AmazonSSMManagedInstanceCore, allow outbound HTTPS and keep the security group free of inbound rules. Connect, run sudo -iu ubuntu bash /opt/sushi/docs/demo.sh to check health and the no-model boundary, then copy the example model config into /var/lib/tabby/config.toml and restart tabby.service. Local models need more RAM and disk, so size up before downloading weights.
Software fee: USD 0.02 per running t3.medium instance-hour with the first five days free for one concurrent instance; the same full software runs throughout and there is no product-imposed time, user or usage limit. Additional concurrent instances incur software fees. EC2, EBS, data transfer and any model-provider charges are billed separately. No annual offer is configured.
This is a repackaged open source software product wherein additional charges apply for independent AWS packaging, validation, maintenance and setup documentation (https://tabby.tabbyml.com/docs/welcome/). TabbyML publishes non-ee/ content under Apache-2.0. The ee/ tree uses the Tabby Enterprise license and is not part of this offer. Software Sushi supplies the AMI recipe and setup guide without claiming TabbyML endorsement. Back up /var/lib/tabby and /etc/tabby after adding models or changing config.
Highlights
Self-hosted AI code completion and chat server, so code context stays in your AWS account.
Starts with no model downloads. Attach the completion model you choose using the included example config.
The server binds to localhost and you connect through Session Manager. No inbound ports are needed.
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Try this product free for 5 days according to the free trial terms set by the vendor. Usage-based pricing is in effect for usage beyond the free trial terms. Your free trial gets automatically converted to a paid subscription when the trial ends, but may be canceled any time before that.
You pay one hourly software fee for each running instance on the t3.medium instance type. There is a single pricing dimension, billed per hour of use. Pricing scales only with how long you run the instance and how many instances you launch. An optional five-day free trial covers the software fee for one instance, then converts to the same hourly billing. The software is identical before and after the trial. EC2, EBS, data transfer, and any model provider charges are billed separately from this software fee.
Top-of-mind questions for buyers
What resources do I get with the t3.medium hourly fee?
The t3.medium instance gives you 2 vCPUs and 4 GiB of RAM, running the CPU-only code completion and chat server. This spec suits the server without local models. If you attach larger local models, you will need to pick a bigger instance and volume before downloading weights.
Am I charged the software fee when the instance is stopped?
You pay the hourly software fee only while the instance runs. A stopped instance accrues no software charge. Note that EBS storage, data transfer, and other AWS infrastructure costs may still apply while the instance is stopped. Those AWS charges are billed separately from the software fee.
What costs are not covered by the hourly software fee?
The hourly fee covers only the packaged software. EC2 compute, EBS storage, and data transfer are billed separately by AWS. No model weights are included, so any remote model provider you connect charges you directly. You supply your own credentials and keys after launch.
docs.softwaresushi.com
Helpful?
Vendor refund policy
We offer a full refund of software charges for the first 48 hours billing starts if the product does not perform as described. To request a refund, email info@softwaresushi.com with your EC2 instance ID and a description of the issue. AWS infrastructure costs (EC2, EBS, data transfer) are billed by AWS and are not eligible for refund by us.
How can we make this page better?
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Tabby v0.32.0 on Ubuntu 24.04 LTS, packaged by Software Sushi. Usage statistics reporting to TabbyML is switched off by default. The guided demo is repeatable, the documentation under /opt/sushi/docs is root-owned and a first-login guide appears after sudo -iu ubuntu. Connect with Session Manager, run sudo -iu ubuntu, then bash /opt/sushi/docs/demo.sh. Configure your own provider keys and models privately after launch.
Additional details
Usage instructions
Launch t3.medium (16 GiB or larger encrypted gp3, IMDSv2) with AmazonSSMManagedInstanceCore and outbound HTTPS. No inbound rules are needed.
Connect with aws ssm start-session --target <instance-id>. You land as ssm-user; sudo -iu ubuntu switches to the ubuntu account and shows the first-login guide. After cloud-init finishes, run: sudo -iu ubuntu bash /opt/sushi/docs/demo.sh (expect SUSHI_CUSTOMER_DEMO_PASSED).
Attach a model: copy guidance from /opt/sushi/etc/tabby/customer-model.example.toml into /var/lib/tabby/config.toml (with sudo), then sudo systemctl restart tabby.service. Local models need more RAM and disk.
From your workstation: aws ssm start-session --target <instance-id> --document-name AWS-StartPortForwardingSession --parameters '{"portNumber":["8080"],"localPortNumber":["8080"]}' and check 127.0.0.1:8080/v1/health from your computer. Add your own reverse proxy and authentication before exposing it to IDEs over a network.
Software Sushi provides AMI packaging and setup guidance. Contact info@softwaresushi.com for installation questions. Support coverage requires a separate agreement. This offer does not include TabbyML support or Tabby Enterprise features.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
This is a repackaged open source software product wherein additional charges apply for independent packaging, maintenance and a tested coding starter. Run OpenCode in the terminal with real file-edit tools and independently checked sample-workspace results.
Sushi ML Studio is no-code machine learning that runs in your browser, on your own EC2 instance. Upload a CSV or Excel file, pick the column you want to predict, and it trains and compares against many scikit-learn models, tells you in plain language how good the best one is, and adds predictions to new spreadsheets. Your data never leaves the instance, and you keep the model file and the Python code that reproduces it.
Aider is an AI pair programmer for your terminal. Describe a change in plain English and Aider edits the right files in your git repository, then commits each change so you can review it or undo it. This Ubuntu 24.04 image installs Aider with a git workspace on first boot, with Session Manager access and no inbound ports.
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.