Overview
Friendli Suite is our SaaS service powered by Friendli Engine, the fastest LLM serving engine on the market. Friendli Suite offers three options to suit your preferences:
- Friendli Container: Deploy the engine on your own infrastructure for ultimate control.
- Friendli Dedicated Endpoints: Run any custom generative AI models on dedicated GPU instances in autopilot.
- Friendli Serverless Endpoints: No setup required, simply call our APIs and let us handle the rest.
The Friendli Engine cuts LLM inference serving costs by 40-80% while providing low latency and high throughput during LLM serving. Friendli Engine employs various specialized optimizations including our groundbreaking iteration batching (a.k.a. continous batching) technology, protected by patents in the United States and Korea. Experience the extraordinary performance of LLM serving on the Friendli Suite!
Highlights
- Innovation for high speed and low cost
- Effortless deployment
- Automatic management
Details
Features and programs
Financing for AWS Marketplace purchases
Pricing
Dimension | Description | Cost/unit |
---|---|---|
fl_credit | Friendli Suite Compute Unit | $0.01 |
Vendor refund policy
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
