Overview
Langfuse is the leading open-source LLM engineering platform designed to trace, monitor, evaluate, and optimize generative AI applications and agent workflows.
This appliance delivers a fully integrated, self-contained deployment built natively on Ubuntu 24.04 LTS:
Turnkey Reverse Proxy with Auto-SSL: Built-in Caddy reverse proxy terminates external traffic on ports 80 and 443 with automated Let's Encrypt certificate acquisition via sudo langfuse-ssl .
High-Throughput Analytics Backend: Embedded ClickHouse 24.3 columnar storage engine optimized for millisecond ingestion and querying of high-volume LLM traces, token metrics, and spans.
Production Polyglot Architecture: Orchestrates Langfuse Web UI/API, background worker daemons, PostgreSQL 16 relational storage, Redis 7 task brokers, and local S3-compatible MinIO blob storage.
Zero-Touch Credential Provisioning: Automatically generates cryptographically unique admin passwords, project API keys (pk-lf-..., sk-lf-...), encryption salts, and database credentials on initial boot, printed to /home/ubuntu/langfuse-credentials.txt and the EC2 system console log.
Enterprise Isolation: All internal databases (PostgreSQL, ClickHouse, Redis, MinIO) are strictly isolated on an internal bridge network with zero public ports exposed, meeting AWS Marketplace security requirements.
Highlights
- Comprehensive LLM Observability and Tracing - Langfuse v3 delivers end-to-end observability for large language model applications. Capture detailed traces of every LLM call, chain, and agent interaction to understand latency, token usage, and model behavior. Gain full visibility into your AI pipelines so you can debug issues faster, optimize prompts, and improve overall application quality with structured, queryable trace data.
- Auto-SSL and Secure Deployment on Ubuntu 24.04 - This listing comes pre-configured with automatic SSL certificate provisioning, eliminating the manual overhead of TLS setup. Built on Ubuntu 24.04 LTS for long-term stability and security patching, the deployment is production-ready from launch. Reduce time-to-value by deploying a fully secured Langfuse instance directly from AWS Marketplace without complex infrastructure configuration.
- Open-Source Flexibility and Self-Hosted Control - Langfuse v3 is an open-source platform, giving you complete control over your data and infrastructure. Self-host on your own AWS environment to meet data residency and compliance requirements. Benefit from an active community, transparent development, and the ability to customize and extend the platform to fit your specific LLM monitoring and evaluation workflows.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
- ...
Dimension | Cost/hour |
|---|---|
t3.xlarge Recommended | $0.075 |
r7a.xlarge | $0.075 |
r7i.xlarge | $0.075 |
r7iz.xlarge | $0.075 |
r7a.2xlarge | $0.075 |
r7i.2xlarge | $0.075 |
r7iz.2xlarge | $0.075 |
r7a.4xlarge | $0.075 |
r7i.4xlarge | $0.075 |
r7iz.4xlarge | $0.075 |
Vendor refund policy
Software is usage-based, charged hourly, and can be terminated at any time. No refunds are available.
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
RELEASE NOTES: Langfuse v3 LLM Observability Appliance v1.0.0
Product: Langfuse v3 LLM Observability on Ubuntu 24.04 LTS Version: 1.0.0 Base OS: Ubuntu 24.04 LTS (Noble Numbat - x86_64) Release Date: October 2026
OVERVIEW This release delivers an enterprise-hardened, production-ready appliance of Langfuse v3.225.11 running on Ubuntu 24.04 LTS. Designed for high-throughput LLM observability, tracing, prompt evaluation, and metrics aggregation, this deployment features native Caddy reverse proxying with automated Let's Encrypt SSL, embedded ClickHouse 24.3 columnar storage, PostgreSQL 16 relational storage, Redis 7 caching, and local MinIO S3-compatible event staging.
SOFTWARE VERSIONS INSTALLED
Core Platform and Reverse Proxy:
Ubuntu Linux: 24.04 LTS (Kernel 6.8+, x86_64)
Langfuse Web Console and API: v3.225.11 (langfuse/langfuse:3)
Langfuse Background Worker: v3.225.11 (langfuse/langfuse-worker:3)
Docker Engine: 27.x with Docker Compose V2 plugin
Caddy Reverse Proxy: 2.8.4 (standalone native binary)
Databases and Storage Engine:
ClickHouse Server: 24.3-alpine (columnar trace, span, and score storage)
PostgreSQL: 16-alpine (auth, project metadata, prompts, and API keys)
Redis Server: 7-alpine (BullMQ queue broker and cache)
MinIO Object Store: pgsty/minio:latest (local S3-compatible batch event store)
MinIO Client: pgsty/mc:latest (automated bucket initialization)
KEY FEATURES
Headless First-Boot Provisioning: Automatically generates secure admin credentials, project API keys (pk-lf and sk-lf), encryption keys, and internal database passwords on initial boot. Credentials are saved directly to /home/ubuntu/langfuse-credentials.txt and emitted to the EC2 system console log.
Pre-Cached Docker Layers: All container images are stored locally during AMI preparation, ensuring instant container startup without internet pull delays or rate limits on customer launch.
Zero External Database Ports: All internal database and storage interfaces (PostgreSQL 5432, ClickHouse 8123/9000, Redis 6379, MinIO 9000/9001) run on an isolated Docker bridge network and are never exposed to public or host interfaces.
One-Command SSL Automation: Configure automated Let's Encrypt TLS and redirect rules with a single command: sudo langfuse-ssl your-domain.com [email]
Enterprise Disk Sanitization: Golden AMI is purged of development logs, SSH host keys, shell histories, and cloud-init metadata states via automated shutdown scrubbers.
SYSTEM REQUIREMENTS
Architecture: 64-bit x86 (x86_64)
Minimum Instance Type: t3.xlarge or t3a.xlarge (4 vCPU, 16 GB RAM, 50 GB gp3 root volume)
Recommended Production Instance: m6i.xlarge, m7i.xlarge, or m6a.xlarge (4 vCPU, 16 GB RAM)
High-Throughput Production: m6i.2xlarge, m7i.2xlarge, or c6i.2xlarge (8 vCPU, 16 to 32 GB RAM)
Required Security Group Inbound Ports: 22 (SSH), 80 (HTTP), 443 (HTTPS)
Additional details
Usage instructions
RECOMMENDED INSTANCE SIZING AND SECURITY GROUP SETUP
Minimum Instance Type: t3.xlarge (4 vCPU, 16 GB RAM, 50 GB gp3 root storage)
Recommended Production: m6i.xlarge, m7i.xlarge, or m6a.xlarge (4 vCPU, 16 GB RAM)
Security Group Inbound Rules:
Port 22 (TCP) - SSH administrative access (restrict to your IP or bastion CIDR)
Port 80 (TCP) - HTTP access and Let's Encrypt TLS verification (0.0.0.0/0)
Port 443 (TCP) - HTTPS encrypted web console and SDK ingestion API access (0.0.0.0/0)
Note: Internal services (Langfuse Web 3000, PostgreSQL 5432, ClickHouse 8123/9000, Redis 6379, MinIO 9000) are strictly isolated and must not be exposed externally.
RETRIEVING INITIAL CREDENTIALS On initial boot, the appliance automatically generates cryptographically random passwords, provisions the database tables, creates an initial organization, and generates your first project API keys. This initialization typically completes within 45 to 60 seconds.
Option A - Via SSH Terminal: Connect to your instance via SSH using your key pair: ssh -i /path/to/key.pem ubuntu@<INSTANCE_PUBLIC_IP>
Read the provisioned credentials file: cat /home/ubuntu/langfuse-credentials.txt
Option B - Via AWS Management Console: If you prefer not to SSH immediately, view the EC2 System Log:
Open the Amazon EC2 console.
Select your running instance.
Choose Actions > Monitor and troubleshoot > Get system log.
Locate the Langfuse initialization block displaying your Web Console URL, admin login, and generated project API keys.
ACCESSING THE WEB CONSOLE
Open a browser and navigate to: http://<INSTANCE_PUBLIC_IP>
Log in using the credentials from the credentials file:
Username: admin@example.com
Password:
CONFIGURING A CUSTOM DOMAIN AND AUTOMATIC SSL (HTTPS) The image includes an automated TLS utility powered by Caddy. Before executing this setup, ensure your domain DNS A record points directly to your EC2 instance public IPv4 address.
SSH into the instance: ssh -i /path/to/key.pem ubuntu@<INSTANCE_PUBLIC_IP>
Run the SSL configuration helper: sudo langfuse-ssl <your-domain.com> [admin-email]
Example: sudo langfuse-ssl langfuse.example.com admin@example.com
The helper provisions a Let's Encrypt certificate, updates the internal NEXTAUTH_URL environment setting, reloads Caddy, and enforces HTTPS. You can then access the interface securely at: https://<your-domain.com>
CONNECTING APPLICATION SDKS (PYTHON AND TYPESCRIPT) The appliance comes pre-seeded with a default organization and project. You can immediately send traces and spans using the pre-generated API keys found in /home/ubuntu/langfuse-credentials.txt.
Python SDK Setup: Install the SDK: pip install langfuse
Set environment variables in your application: export LANGFUSE_PUBLIC_KEY="pk-lf-..." export LANGFUSE_SECRET_KEY="sk-lf-..." export LANGFUSE_HOST="https://<your-domain.com>" (or "http://<INSTANCE_PUBLIC_IP>")
Example Python integration: from langfuse import Langfuse langfuse = Langfuse() trace = langfuse.trace(name="chat-completion") trace.update(output="LLM response")
TypeScript SDK Setup: Install the package: npm install langfuse
Configure client initialization: import { Langfuse } from "langfuse"; const langfuse = new Langfuse({ publicKey: "pk-lf-...", secretKey: "sk-lf-...", baseUrl: "https://<your-domain.com>" });
SERVICE MANAGEMENT AND MONITORING All application containers and reverse proxies are managed via standard systemd daemons:
Check overall stack service status: sudo systemctl status langfuse.service caddy.service
Check individual container states and health checks: sudo docker compose -f /opt/langfuse/docker-compose.yml ps
Restart the entire Langfuse stack: sudo systemctl restart langfuse.service
View live application and worker logs: sudo docker compose -f /opt/langfuse/docker-compose.yml logs -f langfuse-web sudo docker compose -f /opt/langfuse/docker-compose.yml logs -f langfuse-worker
Configuration environment file location: /opt/langfuse/.env
Support
Vendor support
Deployment supported via email, chat, and bot.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
