Sold by: Langfuse
Deployed on AWS
Langfuse is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.
Overview
Please contact marketplace-aws@langfuse.com to request a private offer.
Langfuse is an open-source LLM engineering platform designed to streamline the development, monitoring, and testing of LLM-based applications. It addresses the unique challenges posed by LLMs, such as complex control flows, non-deterministic outputs, and mixed user intents, by offering robust tools for tracing, debugging, and evaluating these applications. With Langfuse, teams can collaboratively debug, analyze, and iterate on their LLM applications, making it easier to track all relevant logic, manage prompts, and monitor the performance and quality of their models over time.
Core features of Langfuse include observability through detailed tracing of all LLM calls and relevant application logic, along with integrations for popular tools like OpenAI SDK, Langchain, and others. The platform provides a UI for inspecting and debugging logs, managing prompts, and conducting experiments to test application behavior before deployment. Additionally, Langfuse offers powerful analytics and evaluation tools to monitor LLM performance, track metrics like cost and latency, and gather user feedback, all of which contribute to a deeper understanding of application quality and user behavior.
Langfuse's open-source nature, model and framework agnosticism, and incremental adoptability make it ideal for teams building complex LLM applications. By capturing the full context of LLM executions and providing tools to classify and analyze user inputs, Langfuse helps developers maintain control over their applications, ensuring they can effectively manage and improve the performance and quality of their LLM systems.
Highlights
- Automated Evals -- Use Langfuse to automatically score the quality of your LLM application with an LLM-as-a-Judge approach or by collecting user and employee feedback.
- Integration -- Langfuse provides robust integrations via Python and Typescript SDKs as well as with frameworks such as Llama Index, Langchain, OpenAI, Dify or Litellm.
Details
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Description | Cost/month |
|---|---|---|
Langfuse Enterprise Edition (EE) | Langfuse Enterprise Edition (EE) - Self-Hosted | $20,000.00 |
Vendor refund policy
Customers can cancel their contract at any time and remain liable for the payment of the last remaining billing period. By default, Langfuse enters into monthly contracts.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Resources
Vendor resources
Support
Vendor support
Customers have access to the Langfuse team via Slack or Email.
Customers can purchase additional support and SLAs.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Updated weekly
By Patronus AI
By Lunary AI
AI generated from product descriptions
Distributed Tracing and Observability
Detailed tracing of all LLM calls and relevant application logic with UI for inspecting and debugging logs
Automated Evaluation Framework
LLM-as-a-Judge approach for automatically scoring application quality with support for user and employee feedback collection
Multi-Framework Integration
Native integrations via Python and Typescript SDKs with frameworks including Llama Index, Langchain, OpenAI, Dify, and Litellm
Prompt Management and Experimentation
Centralized prompt management capabilities with experimentation tools to test application behavior before deployment
Performance Analytics and Monitoring
Analytics and evaluation tools to monitor LLM performance with tracking of metrics including cost, latency, and user feedback
Retrieval-Augmented Generation Testing
Verification of LLM-based retrieval systems through retrieval evaluation API to ensure consistent delivery of reliable information.
Automated Test Suite Generation
Auto-generation of test suites and scoring of model performance on real-world scenarios with benchmark capabilities for LLMs.
LLM Failure Monitoring and Visualization
Continuous evaluation, tracking, and visualization of LLM system performance in production environments with failure aggregation and filtering capabilities.
Adversarial Test Case Generation
Generation of adversarial test cases at scale to detect hallucinations and unexpected unsafe behavior in LLM systems.
Real-time LLM Validation and Logging
Real-time validation, logging, and addressing of LLM failures through API integration with support for CI and production environments.
Observability and Monitoring
Track metrics including cost, token usage, and latency with detailed traces for logging and debugging LLM calls and agents.
Prompt Management and Versioning
Collaborate on prompts with versioning capabilities and perform A/B testing to improve LLM prompt performance.
Evaluation and Testing Integration
Test prompts and models for optimal performance with evaluation suite integration into CI pipeline.
Content Safety and Guardrails
Implement guardrails to prevent toxic content, detect prompt injections, and prevent PII data leakage in AI responses.
Security and Compliance Features
Support for on-premises deployment and GDPR-compliant cloud hosting with PII removal and anomaly detection capabilities.
Standard contract
No
No
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.