Sold by: Fiddler AIÂ
Free Trial
Fiddler is the all-in-one AI Observability and Security platform for responsible AI, providing centralized controls and actionable insights to operationalize ML models, GenAI, and LLMs applications with trust.
Overview
Fiddler offers a native integration with AWS SageMaker AI, enabling users to observe ML models such as binary classification, multi classification, regression, ranking, and more from within their secure AWS environment.
- Unified Platform for LLM and ML Observability: Monitor, analyze, and protect all your LLMs and ML models in one location for enhanced visibility and control.
- Built for the Enterprise and Government: Enterprise-grade scalability and stability for secure LLM/ML deployments in SaaS, VPC, and AWS GovCloud environments.
- Actionable Diagnostics: Quickly identify model issues with root cause analysis, enabling fast resolution and continuous improvement.
- Audit Evidence for GRC Standards: Access governance and compliance evidence to meet AI regulations with customizable dashboards and reports.
- Customer Centric: Fiddler brings expertise in data science to align your AI deployments with business goals for successful outcomes.
- Responsible AI Partnership: White glove support for advanced AI strategy and applications to help you build responsible AI practices.
Details on the Fiddler offering can be found at fiddler.ai. To discuss custom and Enterprise solutions, please reach out to sales@fiddler.ai .
Highlights
- Seamless Workflow Experience: Fiddler's native integration with SageMaker provides a smooth user experience, covering the entire ML lifecycle, from model building and deployment to ongoing production monitoring, within the AWS ecosystem
- Complete Data Privacy: SageMaker ensures sensitive data stays completely within customers' environment and will never be shared with a third party
- Rapid Deployment and Scaling: Available within the Amazon SageMaker Studio, ML platform owners can avoid additional security hurdles and InfoSec reviews, accelerating the path to scale production ML deployments
Details
Unlock automation with AI agent solutions
Fast-track AI initiatives with agents, tools, and solutions from AWS Partners.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Free trial
Try this product free according to the free trial terms set by the vendor.
Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Description | Cost/month |
|---|---|---|
5 Models | Onboard 5 models. Features include: Alerts for data drift, integrity, performance, traffic, stats, and custom metrics, Time series and analytics charts, Customizable dashboards and reports, Feature impact insights, Root cause analysis tools. Exclusions: Explainability, LLMs, SSO, and outbound alert notifications. For more information, visit: fdlr.ai/tour | $2,500.00 |
20 Models | Onboard 20 models. All features specified in the '5 Models' tier. | $9,166.67 |
50 Models | Onboard 50 models. All features specified in the '5 Models' tier. | $20,833.33 |
Vendor refund policy
We are unable to offer refunds at this time. If you have further questions, please contact support@fiddler.ai .
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA)Â .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Resources
Vendor resources
Support
Vendor support
Find our documentation at https://docs.fiddler.ai/ . AWS Marketplace will function as Tier 1 support and will contact the Fiddler team as Tier 2 support when needed. Please open AWS Marketplace support cases for any issues. To discuss custom solutions, please reach out to sales@fiddler.ai .
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
Fiddler AI (Lite Version)
By Fiddler AI
Fiddler is the pioneer in AI Observability for responsible AI. The unified environment provides centralized controls and actionable insights to operationalize ML models, GenAI, and LLM applications with trust. Monitoring, analytics, and security capabilities address the unique challenges of building in-house and secure LLM and MLOps at scale. Fiddler helps you grow into advanced capabilities and build a framework for responsible AI practices.
Fortune 500 organizations use Fiddler across pre-production and production to deliver high performance AI, reduce costs, and be responsible in governance.
Fiddler AI (Lite Version) includes observability for 1 model, .5 GB of Data/Monthly, and our lowest level of support. No LLM functionality is included.
Deepchecks LLM Evaluation
By Deepchecks
Deepchecks is an AI evaluation platform, for evaluating LLM-based applications during research, ci/cd and production. Deepchecks' robust automatic scoring, version comparison, and auto-calculated metrics (such as relevance and grounded in context) enables AI teams to efficiently detect, troubleshoot, and improve their application's performance. It supports single-step workflows, multi-step workflows, chat, and agentic use cases.
Customer reviews
0 ratings
0 AWS reviews
|
2 external reviews
Star ratings include only reviews from verified AWS customers. External reviews can also include a star rating, but star ratings from external reviews are not averaged in with the AWS customer star ratings.
ibrahim d.
Best AI monitoring and Observability tool
Reviewed on Jun 11, 2024
Review provided by G2
What do you like best about the product?
There are very few good observability tools available in the market when it comes to AI model's monitoring. Fiddler's monitoring capabilities especially around LLMs are extremely powerful. Its model explaination feature is simply awesome. Integrations are very good.
What do you dislike about the product?
The tool may be quite difficult to grasp and properly used for the people very new to AI, AIOps and AI monitoring.
What problems is the product solving and how is that benefiting you?
I have been in MLOps for quite some time now. The most difficult thing always used to be post model deployment monitoring. I developed several custom monitoring but none of that could provide a centralized and complete solution. Fiddler's features are so rich and powerful, it provides a complete, centralized and data driven observability for machine learning models. I extensively use LLMs as well and for the same reason I liked the fiddler's features for LLMs.
Computer Software
Good tool for monitiong you ML data
Reviewed on Feb 09, 2022
Review provided by G2
What do you like best about the product?
Clean interface easy to find issues and data points of interest. Easy to track down issues and other minor nuances
What do you dislike about the product?
I wish there were a free version with a subset of features. Creating dashboards could be a little more intuitive but not a huge pain point.
What problems is the product solving and how is that benefiting you?
I mostly used this just for playing around with some test projects to see how it performs.