Overview
One endpoint for Amazon Bedrock
An OpenAI-compatible LLM router for Amazon Bedrock. Inference runs in your own AWS account at your Bedrock prices, with no markup on tokens.
One endpoint for Amazon Bedrock
Rule-based model routing
Bedrock runs in your AWS account
Usage dashboard
AI Cloud Gateway in one minute
AI Cloud Gateway is an LLM router for Amazon Bedrock. You send chat requests to one HTTPS endpoint, and for each request it picks the cheapest Bedrock model that is expected to answer it well, then runs it in your own AWS account.
How it works:
- Subscribe, sign in at dashboard.aicloudgateway.com, and create an API key.
- Connect your AWS account with one CloudFormation stack. It creates a role that can only use Amazon Bedrock, and that we can only assume with an External ID unique to your subscription.
- Point your client at https://api.aicloudgateway.com/v1 with your key.
Routing: set model to auto and the router reads each request (task type, difficulty, length, tools, images) and chooses among Amazon Nova, Anthropic Claude, Meta Llama and other Bedrock models. auto:cost and auto:quality lean either way, and you can pin a single model. Add task:simple or task:complex to a prompt to move the choice, and effort:low, medium or high to make the chosen model reason harder. If a model is throttled or not enabled in your account, the request falls back to the next suitable one. Every response names the model that answered.
How it decides: a deterministic rules engine, not another language model. For a given catalog and engine version, the same request and settings always choose the same model, in milliseconds and without an extra model call, so routing adds no token cost and can be reproduced when you audit a decision. Response headers name the model, the mode and the catalog version that made the choice.
Controls: set a monthly cap on estimated Bedrock spend or on routed requests, for the whole subscription or for each API key; once reached, requests are refused until the next month or until you raise it. Optionally, name an Amazon Bedrock Guardrail from your own account and it is applied to every routed request.
The API is compatible with the OpenAI API format (chat completions with streaming, tool calls, images and JSON output), so existing SDKs and agent frameworks work by changing the base URL and key, including agents on Amazon Bedrock AgentCore. AI Cloud Gateway is not affiliated with OpenAI.
Billing: Amazon Bedrock usage is billed by AWS to your own AWS account, at your Bedrock prices. AI Cloud Gateway bills only for routing: a monthly or annual Starter, Team or Business plan, each with a monthly allowance of routed requests, then a usage charge per 1,000 routed requests beyond it at that plan's rate. Larger plans cost less per request, and refused calls are free. Each plan covers one connected AWS account. Upgrade to a larger plan during the term.
Data handling: prompts and completions are never stored. AI Cloud Gateway keeps only usage counts (requests and tokens per model per hour) and routing decision features. Requests pass through our service in AWS us-east-1, in memory.
Supported Bedrock regions for the connection: us-east-1, us-east-2, us-west-2.
Highlights
- Deterministic, cost-aware routing: each request goes to the lowest-cost Amazon Bedrock model expected to answer it well. A rules engine picks it in milliseconds, the same way every time, with no extra model call. Every response names it.
- Runs in your AWS account: a CloudFormation role that can only use Bedrock, assumed with your External ID. AWS bills Bedrock to you at your prices, with no markup on tokens. Prompts are never stored. Optional Amazon Bedrock Guardrails.
- Control and drop-in: monthly spend and request caps per subscription and API key, and fallback on throttling. Works with the SDKs and agent frameworks you use, including Bedrock AgentCore, by changing the base URL and key.
Details
Features and programs
Financing for AWS Marketplace purchases
Pricing
Dimension | Description | Cost/month |
|---|---|---|
Starter plan | One AWS account, email support, 50,000 routed requests a month. | $19.00 |
Team plan | One AWS account, faster support, 1,000,000 routed requests a month. | $139.00 |
Business plan | One AWS account, priority support, 5,000,000 routed requests a month. | $649.00 |
The following dimensions are not included in the contract terms, which will be charged based on your usage.
Dimension | Description | Cost/unit |
|---|---|---|
Starter requests (1k) | Starter: routed requests beyond 50,000 a month, per 1,000. | $0.30 |
Team requests (1k) | Team: routed requests beyond 1,000,000 a month, per 1,000. | $0.25 |
Business requests (1k) | Business: routed requests beyond 5,000,000 a month, per 1,000. | $0.22 |
Dimensions summary
Top-of-mind questions for buyers
Vendor refund policy
Charges are your plan's fee plus routed requests beyond its monthly allowance, billed through AWS Marketplace. Amazon Bedrock usage is billed by AWS to your own account.
Cancel through AWS Customer Service within 48 hours of purchase for a full refund, processed by AWS. After that the term runs to its end; turn off auto-renewal to stop billing.
To request a refund or raise any other billing question, email contact@aicloudgateway.com with your AWS account ID. We reply within one business day.
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
API-Based Agents & Tools
API-Based Agents and Tools integrate through standard web protocols. Your applications can make API calls to access agent capabilities and receive responses.
Additional details
Usage instructions
API
After subscribing, choose "Set up your account", then follow the getting started guide: https://github.com/infoinlet-com/aws-marketplace-resources/blob/main/api/saas/ai_cloud_gateway/getting-started.md
Support: contact@aicloudgateway.com Website: https://aicloudgateway.com/
Resources
Vendor resources
Support
Vendor support
Email contact@aicloudgateway.com or use the contact form at https://aicloudgateway.com/contact/ (no account needed). We reply within one business day, Monday to Friday.
Include your AWS account ID. For a question about a specific call, include the x-request-id response header. Prompts and completions are never stored, so we cannot see your requests; the request id lets us trace the routing decision.
Your subscriptions, API keys, AWS account connection and usage are at https://dashboard.aicloudgateway.com
Billing, cancellation and refunds run through AWS Marketplace. Amazon Bedrock usage is billed by AWS to your own AWS account. What we refund is set out in the refund policy on this listing.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.