
Overview
Verax Control Center
Verax Control Center provides visibility and control for LLMs (Large Language Models) in production. As an all-in-one platform, Verax delivers in-depth insights, real-time issue detection, and automated mitigation. Enterprises can monitor LLM performance, auto-correct behavioral issues like hallucinations, biases, or toxic outputs, and safeguard sensitive data from breaches or compliance risks. Verax seamlessly integrates with new and existing LLM deployments, whether built internally, third-party, or a mix of both.
User Personas
Data and AI Specialists:
- Gain actionable insights into LLM behavior, biases, and other issues
- Auto-correct errors like hallucinations and biases for high-quality outputs
Governance, Risk, and Compliance Officers:
- Safeguard sensitive data and ensure regulatory compliance
- Proactively prevent data leaks and secure LLM interactions
Enterprise IT Teams:
- Gain visibility into production LLMs and ensure reliable operations
- Ensure smooth and risk-free operation of LLMs in production
Customer Needs Addressed
Key Challenges
Lack of Predictability in LLM Behavior
- Real-life inputs are inconsistent, resulting in variable outputs that impact reliability and user trust
Lack of Determinism in LLMs
- LLMs produce different responses to the same prompt, complicating debugging, reproducibility, and output validation - key for enterprise-grade solutions
LLMs Frequently Generate Undesired Responses
- Issues like hallucinations, biases, and unsafe outputs harm trust, brand reputation, and compliance
Data Leakage Risks
- LLMs may expose sensitive data, creating risks for privacy, regulatory compliance (e.g., GDPR, HIPAA), and security
Hard to Quantify an LLM-Based Solution for an Organization
- Measuring LLM ROI is challenging due to unclear metrics and unpredictable outputs, difficulty aligning results with business goals, making AI adoption harder to justify
One Control Center for Your LLMs
Verax Explore
- Detect trends and identify biases
- Optimize LLM quality and performance
- Analyze risks for informed decision-making
Verax Control
- Auto-correct hallucinations, false, or biased responses.
- Prevent undesired outputs from reaching users
- Deliver customized, high-quality interactions
Verax Protect
- Secure your systems against costly data breaches
- Maintain regulatory compliance with robust safeguards
- Protect PII through contextual access controls
Ensure Verified & Responsible AI
- Complete Visibility: Full transparency into LLM behavior for informed decisions
- Real-Time Risk Mitigation: Instantly resolve hallucinations, biases, and errors
- Advanced Data Protection: Protect against data leaks and safeguard sensitive information
Highlights
- Comprehensive insights into LLM behavior and user interactions
- Responsible AI with real-time issue detection and resolution
- Prevent sensitive data leaks to and from LLMs
Details
Features and programs
Financing for AWS Marketplace purchases
Pricing
- $2,750.00/month
Vendor refund policy
We do not currently support refunds, but you can cancel at any time.
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Verax Single VM
Verax Control Center operates on an EC2 instance, leveraging an EBS volume for persistent storage.
The system uses the EC2 instance for the application server and database, with both application configurations and database data securely stored on the shared EBS volume.
The application server processes tasks using Generative AI powered by the Anthropic Claude 3 Sonnet foundational model via AWS Bedrock. This model, a state-of-the-art Large Language Model (LLM), enables advanced natural language processing capabilities.
At runtime, Verax Control Center functions as a proxy, managing requests based on predefined logic, either routing or modifying them as required.
A web interface is also provided for controlling and managing the proxy functionality.
The logs related to Verax Control Center operation are stored in CloudWatch.
List of IAM roles and policies: VeraxInstanceRole
- AmazonSSMManagedInstanceCore - to enable instance access by AWS System Manager
- CloudWatchAgentServerPolicy - to push logs into CloudWatch Logs
CloudFormation Template (CFT)
AWS CloudFormation templates are JSON or YAML-formatted text files that simplify provisioning and management on AWS. The templates describe the service or application architecture you want to deploy, and AWS CloudFormation uses those templates to provision and configure the required services (such as Amazon EC2 instances or Amazon RDS DB instances). The deployed application and associated resources are called a "stack."
Version release notes
This version of Verax Control Center provides capabilities from Verax Explore and Verax Control, allowing you to gain in-depth behavioral insights with automatic issue detection. It also introduces new classifiers on the request, and provides tools to automatically improve chatbot responses
Additional details
Usage instructions
- Launch the product via 1-Click.
- Once deployed successfully, AWS automatically assigns the VPC's default Security Group. Ensure that inbound access on port 3000 is allowed to access the Verax Control Center UI.
- Use a web browser to access the application at https://<EC2_Instance_Public_DNS>:3000
- Sign in using the following credentials: Username: admin Password: the instance_id of the instance
You will be required to change your password on your first login.
Resources
Vendor resources
Support
Vendor support
Verax AI will provide support during business hours, 8:00am - 6:00pm ET Monday - Friday via email at support@verax.ai for general advice and technical support, as well as technical assistance and remediation for operational issues.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.