Sold by: Luminite
AWS Free Tier
***REQUIRES PRIVATE OFFER*** To purchase GateLLM Enterprise Self-Hosted, please reach out to yi.si@luminite.com.cn for a Private Offer.
An AI API gateway that translates and routes requests across OpenAI, Anthropic, Gemini, and Bedrock.
Overview
GateLLM is an enterprise multi model AI gateway aggregating more than 100 LLMs with cross protocol request routing. Fully self hosted, Xinchuang ready and MLPS Level 3 compliant. It features workflow composition, ensemble multi model inference and full token governance. Powered by open model execution and caching, it cuts AI API costs by up to 90 percent for finance, government, healthcare and manufacturing enterprises.
Highlights
- GateLLM: Enterprise multi model gateway cutting LLM API costs by up to 90% with 97% capability retained, unifying 100+ providers via one interface, self hostable and compliance ready.
Details
Sold by
Delivery method
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
This product is available free of charge. Free subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Vendor refund policy
GateLLM is a SaaS product sold via AWS Marketplace under free pricing. All software related fees are billed and invoiced exclusively through AWS Marketplace. No direct contracts or invoicing occur between customers and the seller. AWS infrastructure charges are subject to AWS own refund policy and are excluded from this seller refund policy. Since this product is offered for free, there are no software fees eligible for refunds.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Resources
Vendor resources
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
REQUIRES PRIVATE OFFER
To purchase LiteLLM Enterprise Self-Hosted, please reach out to sales@berri.ai for a Private Offer.
LiteLLM is an OpenAI compatible Proxy Server (LLM Gateway) to call 2,000+ LLM APIs using the OpenAI format Bedrock, Huggingface, VertexAI, TogetherAI, Azure OpenAI, OpenAI, etc. Get started with Opensource LiteLLM here: https://github.com/BerriAI/litellm (40,000+ Github Stars)
Self-hosted API and AI gateway for platform engineers managing microservices, LLM traffic, and multi-cloud architectures on AWS EC2.
9Router is a self-hosted LLM gateway that connects Claude Code, Codex, Cursor, Cline, Copilot, and other AI coding tools to 40+ model providers through a single OpenAI-compatible endpoint. It translates request formats across OpenAI, Claude, and Gemini APIs, tracks quota, auto-refreshes tokens, and falls back from subscription to cheap to free providers so requests never stop. A built-in RTK token saver compresses tool output to cut input token usage by 20 to 40 percent. This AWS Marketplace AMI deploys a pre-configured 9Router instance on EC2 with Docker, an SSE-tuned nginx reverse proxy, automatic Let's Encrypt SSL, and optional daily SQLite backups to S3, giving developers and engineering teams a unified AI model router they fully control.
A self-hosted, production-ready Gemma 4 26B model, with 4 billion active parameters deployed into your AWS environment with a single click. Because everything runs entirely within your private cloud, your data stays secure, isolated, and fully under your control. Best of all, unlimited tokens.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.