Overview
This professional service is delivered for MAI Gateway - Enterprise LLM Governance and Cost Control, an AMI-based software product listed on AWS Marketplace (product ID: prod-bdjzrk4yzjwr4), deployed and operated on Amazon EC2 within the customer's AWS environment. The engagement covers deployment, implementation, and one year of managed operations for that product on AWS.
MAI Gateway Deployment, Implementation & Annual Managed Service
This service is for enterprise customers who have adopted or plan to adopt MAI Gateway, providing complete delivery from environment setup and system integration through one full year of ongoing operations. We transform dispersed, uncontrolled LLM call consumption into a budgetable, attributable, auditable, and stably-running enterprise LLM infrastructure — making every token a managed asset.
Service Scope
- Deployment & Implementation (one-time)
- Installation and initialization of the MAI Gateway in the customer environment (AWS / hybrid cloud / on-premises)
- Multi-model aggregation configuration: unified management of multi-brand LLM APIs including DeepSeek, Qwen, GLM, Kimi, MiniMax, Anthropic, OpenAI, and Google
- OpenAI-compatible API integration with zero code changes to business systems
- GPU compute node onboarding and configuration (NVIDIA H100 / A100 / L40S)
- Internal/external isolation deployment architecture with a unified enterprise firewall exit and zero public network exposure
- Governance Framework Configuration (one-time)
- Setup of a 4-level layered budget system: organization / department / project / key
- RBAC permission matrix configuration: Employee, Project Lead, Department Admin, and Auditor roles
- Intelligent routing and failover strategy configuration (default / high-availability / primary-backup modes)
- Token full-lifecycle key management, IP blacklist/whitelist, access frequency limits, prompt injection protection, content filtering, and sensitive data desensitization
- Annual Managed Service (one-year term)
- One-year MAI Gateway platform usage authorization and operational assurance
- 7x24 full-chain monitoring: daily request volume, token consumption, interface failure rate (SLO ≤ 0.10%), and anomaly events
- Second-level switching against upstream fluctuations, with automatic downgrade and self-healing recovery
- Trace ID full-chain tracking and monthly cost attribution reports (by department / project / user / token)
- 3-tier consumption alerts (80% / 95% / 100%) and overrun handling
- Periodic key rotation and visual cost dashboard operational support
- Version updates, security patches, and technical support
Who It's For
Enterprise IT teams, finance and CFO teams, AI engineering teams, department managers, and compliance/audit teams.
Delivery
Delivered by the MAI Gateway team remotely and on-site (as needed). The contract term is one year and can be renewed on expiry. Exact scope, term, and price are governed by the private offer.
Highlights
- Unified multi-model access with zero code changes — aggregate multi-brand LLMs including DeepSeek, Qwen, GLM, Anthropic, OpenAI, and Google through a single OpenAI-compatible interface. Decouple business logic from model providers to eliminate vendor lock-in; assign model visibility and call permissions by project or employee.
- Full-chain cost governance — 4-level layered budgets (organization/department/project/key), millisecond-level real-time validation, 3-tier alerts at 80%/95%/100%, and automated month-end attribution reports. Visual dashboards show real-time cost overview, remaining budget, and top consumers, making every token budgetable, attributable, and optimizable.
- Production-grade stability and security — intelligent routing (default/high-availability/primary-backup), automatic failover on upstream timeout or outage, and 7x24 monitoring with second-level switching. Token lifecycle management includes periodic rotation, IP blacklist/whitelist, prompt injection protection, content filtering, and sensitive data desensitization for security compliance.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Pricing
Custom pricing options
How can we make this page better?
Legal
Content disclaimer
Support
Vendor support
The MAI Gateway team provides deployment, implementation, configuration tuning, and technical support during the annual operating term. Within the service term we provide 7x24 platform monitoring and alert response, along with version updates and security patches. For product setup, troubleshooting, or general inquiries, contact the MAI Gateway support team by email at aws@itqm.com . Support hours: 7x24, with responses to support requests within one business day.