Sold by: Esich holdings llc
Deployed on AWS
Esich Model Router sits in your VPC and sends LLM traffic to the provider you choose. Apps talk to one OpenAI-compatible URL; you manage rules, keys, and budgets in a built-in admin UI.
Works with OpenAI, Anthropic, Gemini, Azure OpenAI, Bedrock, Groq, Together, OpenRouter, Ollama, and vLLM. Routing is YAML. Redis handles caching. Postgres stores config and audit data. Helm chart included for EKS.
Billing runs through AWS Marketplace. You run the containers.
Overview
Esich Model Router is a container you deploy in your own AWS account. It accepts normal OpenAI API calls and forwards them to upstream models based on rules you define.
Most teams adopt it when different services already call different vendors and nobody has a shared view of cost, failures, or who used which model. Esich does not host your traffic. Prompts and keys stay in your VPC.
What it does
The router exposes /v1/chat/completions, /v1/embeddings, /v1/responses, /v1/images/generations, /v1/audio/speech, and /v1/models. You can pin a model in the request or let routing rules decide. Rules support priority, conditions, splits across targets, and fallback when a provider returns errors or hits a budget cap.
Governance checks can flag PII, SSN patterns, and leaked API keys in prompts. API keys are scoped to org, team, or project. Provider credentials are encrypted at rest.
Running it on AWS
Common setup: EKS with the included Helm chart, RDS for Postgres, ElastiCache for Redis, S3 for exports, ALB for ingress. ECS Fargate and a single EC2 host with Docker Compose also work for smaller installs.
Put the router in private subnets. It needs outbound HTTPS to reach model APIs unless you only use internal endpoints like Ollama or vLLM.
Set ESICH_AIRGAP=true if the environment must not phone home.
Bundled pieces Router image (Go, distroless, non-root) Admin UI at /admin Prometheus metrics at /metrics Grafana dashboard definitions Docker Compose, Helm, and plain Kubernetes manifests
Docs: https://esichholding.com/docs
Support
Highlights
- VPC-hosted LLM router with OpenAI-compatible API and YAML routing rules.
Details
Sold by
Delivery method
Supported services
Delivery option
VPC container (EKS or Compose)
Latest version
Operating system
Linux
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Description | Cost/month |
|---|---|---|
Starter | Up to 5M routed requests/month, 3 provider connections, basic routing, email support | $500.00 |
Business | Up to 50M routed requests/month, unlimited providers, RBAC, budgets, caching, priority support | $8,000.00 |
Vendor refund policy
Esich Holdings LLC - Esich Model Router. Monthly Marketplace contracts are not refunded after the billing period starts. Cancel in the AWS Marketplace console to stop the next renewal; access continues until period end. First paid subscription: full refund within 14 days if you cannot deploy using our documentation and we cannot fix the issue within 5 business days. Email sales@esichholding.com with your AWS account ID.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
VPC container (EKS or Compose)
Supported services: Learn more
- Amazon ECS
- Amazon EKS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
Provider and model management in the admin console: enable/disable providers and models, save provider API keys in the UI (encrypted at rest), and add custom models without a restart.
Security: the router refuses to start with default ESICH_ENCRYPTION_KEY / ESICH_JWT_SECRET. The hardcoded esich-dev-key gateway bypass is disabled unless ESICH_DEV=true.
Admin fixes: working API key creation, Account page for login email/password changes, provider credential forms, model toggles.
Additional details
Usage instructions
What you need
AWS subscription; EC2 with Docker or EKS PostgreSQL 14+, Redis 7+, NATS 2.10+ (included Compose stack works) At least one LLM provider API key Image: 709825985650.dkr.ecr.us-east-1.amazonaws.com/esich-holdings/model-router:1.0.1
Pull
aws ecr get-login-password --region us-east-1 | docker login --username AWS --password-stdin 709825985650.dkr.ecr.us-east-1.amazonaws.com docker pull 709825985650.dkr.ecr.us-east-1.amazonaws.com/esich-holdings/model-router:1.0.1
Compose (easiest)
export ESICH_ENCRYPTION_KEY, ESICH_JWT_SECRET (openssl rand -base64 32 each), ESICH_OPENAI_API_KEY=sk-...
docker tag 709825985650.dkr.ecr.us-east-1.amazonaws.com/esich-holdings/model-router:1.0.1 esich/model-router:1.0.1 export ESICH_VERSION=1.0.1 && docker compose up -d --no-build
Verify: curl -s http://localhost:8080/healthz && curl -s http://localhost:8080/readyz
Admin login and credentials (http://YOUR_HOST:8080/admin)
Default sign-in: admin@esich.local / changeme - change immediately. UI: Account: new email/password, Save. API Keys: Create, copy esk_ key (shown once). API: TOKEN=$(curl -s -X POST http://YOUR_HOST:8080/api/v1/auth/login -H "Content-Type: application/json" -d '{"email":"admin@esich.local ","password":"changeme"}' | python3 -c "import sys,json; print(json.load(sys.stdin)['token'])") curl -s -X PATCH http://YOUR_HOST:8080/api/v1/me -H "Authorization: Bearer $TOKEN" -H "Content-Type: application/json" -d '{"email":"you@co.com ","current_password":"changeme","new_password":"STRONG-PASS"}' curl -s -X POST http://YOUR_HOST:8080/api/v1/api-keys -H "Authorization: Bearer $TOKEN" -H "Content-Type: application/json" -d '{"name":"app","rate_limit":1000}'
Test API
curl -s http://localhost:8080/v1/chat/completions -H "Authorization: Bearer YOUR_ESK_KEY" -H "Content-Type: application/json" -d '{"model":"gpt-4o-mini","messages":[{"role":"user","content":"hello"}]}'
EKS: helm upgrade --install esich-router deploy/helm/esich-model-router -n esich --create-namespace --set image.repository=709825985650.dkr.ecr.us-east-1.amazonaws.com/esich-holdings/model-router --set image.tag=1.0.1 --set secrets.encryptionKey="$(openssl rand -base64 32)" --set secrets.jwtSecret="$(openssl rand -base64 32)"
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.