Overview
Please contact marketplace-aws@langfuse.com to request a private offer.
Langfuse is an open-source LLM engineering platform designed to streamline the development, monitoring, and testing of LLM-based applications. It addresses the unique challenges posed by LLMs, such as complex control flows, non-deterministic outputs, and mixed user intents, by offering robust tools for tracing, debugging, and evaluating these applications. With Langfuse, teams can collaboratively debug, analyze, and iterate on their LLM applications, making it easier to track all relevant logic, manage prompts, and monitor the performance and quality of their models over time.
Core features of Langfuse include observability through detailed tracing of all LLM calls and relevant application logic, along with integrations for popular tools like OpenAI SDK, Langchain, and others. The platform provides a UI for inspecting and debugging logs, managing prompts, and conducting experiments to test application behavior before deployment. Additionally, Langfuse offers powerful analytics and evaluation tools to monitor LLM performance, track metrics like cost and latency, and gather user feedback, all of which contribute to a deeper understanding of application quality and user behavior.
Langfuse's open-source nature, model and framework agnosticism, and incremental adoptability make it ideal for teams building complex LLM applications. By capturing the full context of LLM executions and providing tools to classify and analyze user inputs, Langfuse helps developers maintain control over their applications, ensuring they can effectively manage and improve the performance and quality of their LLM systems.
Highlights
- Automated Evals -- Use Langfuse to automatically score the quality of your LLM application with an LLM-as-a-Judge approach or by collecting user and employee feedback.
- Integration -- Langfuse provides robust integrations via Python and Typescript SDKs as well as with frameworks such as Llama Index, Langchain, OpenAI, Dify or Litellm.
Details
Pricing
Dimension | Description | Cost/month |
---|---|---|
Langfuse Enterprise Edition (EE) | Langfuse Enterprise Edition (EE) - Self-Hosted | $8,500.00 |
Vendor refund policy
Customers can cancel their contract at any time and remain liable for the payment of the last remaining billing period. By default, Langfuse enters into monthly contracts.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Resources
Vendor resources
Support
Vendor support
Customers have access to the Langfuse team via Slack or Email.
Customers can purchase additional support and SLAs.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.