Overview

With LiteLLM Proxy Server, you'll get access to a Proxy Server to call 100+ LLMs in a unified interface where you'll be able to track spend, set budgets per virtual key and users.

You'll be able to set budgets & rate limits per project, API key, and model on OpenAI Proxy Servers.

You can also translate inputs to the provider's completion, embedding, and image_generation endpoints as well as retry/fallback logic across multiple LLM deployments.

Highlights

Call 100+ LLM APIs in OpenAI format https://docs.litellm.ai/docs/providers
Track metrics on Prometheus and send logs to s3, GCS Bucket, Langfuse, OpenTelemetry, Datadog https://docs.litellm.ai/docs/proxy/logging
Get started with Opensource LiteLLM here: https://github.com/BerriAI/litellm (12,000+ Github Stars)

Details

Sold by

LiteLLM

Features and programs

Financing for AWS Marketplace purchases

AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.

View financing details

Pricing

LiteLLM LLM Gateway (Proxy Server)

Info

View purchase options

Pricing is based on contract duration. You pay upfront or in installments according to your contract terms with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.

12-month contract (1)

Info

Dimension	Description	Cost/12 months
LiteLLM Enterprise	All features under LiteLLM Enterprise License, SSO sign on, Feature Prioritization, Proffesional Support, Custom SLAs	$30,000.00

Vendor refund policy

All fees are non-cancellable and non-refundable except as required by law.

Legal

Vendor terms and conditions

Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

Content disclaimer

Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

Usage information

Info

Delivery details

Software as a Service (SaaS)

SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.

Resources

Vendor resources

Website

Schedule Demo

Github Repo

Support

Vendor support

For dedicated support, please send an email to support@berri.ai

AWS infrastructure support

AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

Get support