Overview
AlphaBitCore Nexus AI Gateway is the open-source AI traffic gateway from AlphaBitCore. Deployed as a single-instance appliance, it provides an OpenAI-compatible HTTP endpoint for routing, caching, and governing traffic to upstream LLM providers across multiple model families. Most LLM gateways stop at proxying and load-balancing. Nexus AI Gateway ships with a programmable compliance plane built in: hooks, policies, interception domains, and exemption logic that let teams enforce data handling, redaction, and audit requirements at the traffic layer itself. Streaming compliance, payload capture, and operation logs are first-class capabilities, not paid add-ons. The observability surface reports gateway overhead transparently against upstream model latency on every request, so teams can see exactly what governance costs them per call. This AMI deploys a production-ready Nexus AI Gateway instance on Amazon EC2 in minutes. Use it as a drop-in OpenAI-compatible endpoint for LangChain, LlamaIndex, and custom agent frameworks, or as the governance fabric for a multi-provider LLM strategy across OpenAI, Anthropic, Amazon Bedrock, and self-hosted models. Teams operating in regulated environments such as financial services, healthcare, and public sector can extend Nexus AI Gateway with AlphaBitCore Nexus Enterprise for supported rule packs, FINRA and SOC2 content packs, and VPC-deployed enterprise features.
Highlights
- Open-source AI traffic gateway. OpenAI-compatible HTTP endpoint, response caching, webhooks, and multi-provider routing across OpenAI, Anthropic, Amazon Bedrock, and self-hosted model endpoints. Apache 2.0 licensed, with the full traffic and compliance hooks framework included in OSS.
- Programmable compliance plane built into the gateway. Hooks, policies, interception domains, and exemption logic enforce data handling, redaction, and audit requirements at the traffic layer. Streaming compliance with payload capture and operation logs included. Bring your own rule packs for OSS, or upgrade to AlphaBitCore Nexus Enterprise for supported FINRA, SOC2, and HIPAA content packs.
- Transparent performance measurement. Nexus AI Gateway reports its own overhead alongside upstream model latency on every request, so engineering teams can see exactly what governance costs them and where the slowdowns actually live. No marketing benchmarks. Your dashboard is the benchmark.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
Vendor refund policy
Nexus Gateway is distributed at no charge under the Apache License 2.0. AWS infrastructure charges (EC2, EBS, data transfer) are billed by AWS and subject to AWS's standard refund terms; AlphaBitCore does not collect software fees and therefore no software refunds are applicable. For questions about this listing, contact [support@alphabitcore.com ].
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Initial public release of AlphaBitCore Nexus AI Gateway. AlphaBitCore Nexus AI Gateway is the open-source AI traffic gateway from AlphaBitCore. This 0.1.0 release deploys as a single-instance appliance providing an OpenAI-compatible HTTP endpoint for routing, caching, and governing traffic to upstream LLM providers. What is included in 0.1.0:
OpenAI-compatible chat completions API with SSE streaming support Multi-provider routing across OpenAI, Anthropic, Amazon Bedrock, and self-hosted model endpoints Response caching with configurable TTL and key strategies Webhook emission on request lifecycle events Built-in observability: gateway overhead reported alongside upstream model latency on every request Compliance hooks framework with policies, interception domains, and exemption logic for enforcing data handling and audit requirements at the traffic layer Streaming compliance with payload capture and operation logs
Known limitations:
Single-instance deployment only. Clustering and high-availability are planned for a future release. Rule packs and packaged regulatory content (FINRA, SOC2, HIPAA) are not included in OSS. These are available through AlphaBitCore Nexus Enterprise.
License: Apache 2.0 Commercial support: AlphaBitCore Nexus Enterprise
Additional details
Usage instructions
Credential Retrieval Process:
- SSH into the EC2 instance using the key pair selected at launch.
- Read the auto-generated admin credentials: sudo cat /root/nexus-admin-credentials.txt
- Record the admin username and password.
- Delete the credentials file after recording the credentials: sudo rm /root/nexus-admin-credentials.txt
- Log in to the Nexus AI Gateway admin interface and change the admin password.
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.