Sold by: Fission Labs Inc.
FloTorch is an open source tool designed to expedite the proof of concept journey for Generative AI workloads significantly. It enables users to optimize RAG implementations through systematic experimentation and validation, ensuring secure, automated, and cost efficient deployment within their AWS infrastructure.
Sold by: Fission Labs Inc.
Overview
FloTorch is an open-source, free-to-use tool that enables users to efficiently prototype and optimize Retrieval-Augmented Generation (RAG) workloads. It provides a robust framework for:
- experimentation and performance tuning,
- allowing users to configure critical hyperparameters,
- run experiments securely within their AWS infrastructure, and
- maintain full data sovereignty.
Highlights
- Optimized Experimentation: Tunes hyperparameters and tests strategies for cost, latency, and performance optimization. Saves weeks/months of valuable time.
- LLM and Database Integration: Enhances embedding models and vector databases for improved retrieval efficiency.
- Context Management and Dashboards: Fine-tunes LLM prompts and provides dashboards for data-driven decision-making.
Details
Sold by
Categories
Delivery method
Delivery option
FloTorch Container Based Installation
Latest version
Operating system
Linux
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
This product is available free of charge. Free subscriptions have no end date and may be canceled any time.
Vendor refund policy
Not applicable as the product is free
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
FloTorch Container Based Installation
Supported services: Learn more
- Amazon ECS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
New Features
- Human Evaluation
- Human evaluation allows users to select up to three completed experiments for further querying and assessment.
- Users can upvote answers and sort experiments based on human evaluation scores.
- Claude 3.7 Sonnet available for inferencing on Bedrock
Bug Fixes
- Answers not generated for the model "Mistral AI/mistral-7b-instruct-v0:2" has been resolved.
- In the Select Knowledge Base Type section, the option "None" has been updated to "I don't have knowledge bases", and "Bedrock knowledge bases" has been changed to "Use existing knowledge bases".
- The title of the info popup for "Chunk Size" and "Chunk Overlap Percentage" has been updated to "Fixed Chunk Size" and "Fixed Chunk Overlap Percentage", respectively.
- The info popup is now fixed in place and remains stable without moving while scrolling.
- The issue where clicking on the KNN column caused all columns and data to disappear on the Experiments page has been resolved.
Additional details
Usage instructions
All the installation steps for FloTorch are outlined here:
Resources
Vendor resources
Support
Vendor support
Primary Support Methods:
- GitHub Issues: a. Purpose: Bug Reports, feature requests, and discussions b. Response Time: Best-effort basis by community maintainers.
- GitHub Discussions: a. Purpose: Technical questions and community help b. Format: Q&A, troubleshooting, best practices
- Documentation: a. Location: Project Wiki and README b. Content: Setup guide, best practices, troubleshooting.
Reach out to discuss AI transformation and implementation needs: email: info@flotorch.ai
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Customer reviews
No customer reviews yet
Be the first to write a review for this product.