LLM Gateway
TrueFoundryReviews from AWS customer
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
51 reviews
from
External reviews are not included in the AWS star rating for the product.
TrueFoundry - Helps you quickly build, track and deploy your models.
What do you like best about the product?
TrueFoundry is easy to setup platform for all your MLOPs, LLM Model deployment and Gen AI Use cases. Our firm had partnered with TrueFoundry to enable onboarding of new team members on RAG based chatbot implementation. Every one was quickly able to set up the platform account and get started on the projects right away. the support team is also very responsive and whenever some one had a doubt they were quick to respond. The platform is also easy to integrate in our firms system and every one used it initially as the primary product. When the gen ai use cases were just starting which reflects TrueFoundry has had a head start in setting up LLM ops platform.When the it was proven that truefoundry is the go to product for onboarding new team members more people were added to it for regular use.
What do you dislike about the product?
Not much downside but one thing TrueFoundry can try in future is making no code/low code environment for LLM Ops
What problems is the product solving and how is that benefiting you?
TrueFoundry is making it very easy to start working on GenAI use cases. Even if you have low experience on GenAi but know the how data science and ML works you can quickly get started with model deployment, tracking and collaboration. The collaborative notebooks make it easy for teams to track their progress and contribute effectively. API integrations are seamless in TrueFoundry and whenever there is any issue the customer support team is always on toes to help out, which is a big plus as they provide real time support.
A user-friendly and scalable ML platform backed by a good team
What do you like best about the product?
The LLM models are easy to deploy and team is superactive in resolving queries. It is easy to use and many things are documented clearly. The dashboard is well developed making it easier to use for new and old users. I liked there fine-tuning service for LLMs which makes it easy to finetune even though you might have just started with it.
What do you dislike about the product?
We could have more options for finetuning and options to deploy in between stage models automatically.
What problems is the product solving and how is that benefiting you?
It is mainly used automated model deployment which eases the process a lot and helps us to quicken the process of releasing new version of models.
Transforming Our ML Workflow with Truefoundry
What do you like best about the product?
I have recently used Truefoundry's product, and I am thoroughly impressed. Truefoundry has significantly streamlined our machine learning(including LLM) workflow, making it easier and more efficient to deploy, and monitor models. The automated deployment features should save us countless hours, enabling us to focus more on building and refining our models rather than getting bogged down by the complexities of deployment. Pre-packaged LLM makes it easy for us to evaluate the performance on our dataset.
What do you dislike about the product?
Iteration through datasets can be improved and also versioning associated datasets.
What problems is the product solving and how is that benefiting you?
The automated deployment features have saved us countless hours, enabling us to focus more on building and refining our models rather than getting bogged down by the complexities of deployment.
Truefoundry: A User-Friendly, Scalable, and Well-Supported ML Platform
What do you like best about the product?
We evaluated truefoundry as a potential alternative to AWS Sagemaker for hosting ML models. The platform is designed with both novice and experienced users in mind. The intuitive dashboard allows for seamless navigation, and the clear, concise instructions make it easy to get started quickly. From the initial onboarding to ongoing assistance, their support team has been incredibly responsive and knowledgeable. Whenever we encountered a challenge, their team was quick to provide solutions and guide us through any technical issues. The personalized support and regular check-ins have made us feel valued as customers and ensured that we are getting the most out of the platform. I highly recommend Truefoundry to any team or organization looking to streamline their ML workflows and achieve outstanding results.
What do you dislike about the product?
Truefoundry's pricing can be a bit steep, especially for smaller teams or startups. While the platform offers a lot of value, the cost might be prohibitive for organizations with limited budgets. A more flexible pricing model or additional tier options could make it more accessible. Although Truefoundry provides a range of tools and templates, there can be limitations when it comes to deep customization. Advanced users who use Kubernetes might find that they need more control over specific features or configurations, which can be restrictive for highly specialized use cases. Overall, while these are areas for improvement, they do not significantly detract from the overall positive experience with Truefoundry. Addressing these points would make an already excellent platform even better.
What problems is the product solving and how is that benefiting you?
Simplifying model deployment and reduce overall cost as the deployment scales.
Good product. Good team.
What do you like best about the product?
Feature set, ease of use, support from the team
What do you dislike about the product?
Integration with broader toolsets, particularly with model validation and monitoring tools, are manual. Would recommend thinking of providing those or partnering with companies to simplify it
What problems is the product solving and how is that benefiting you?
Model orchestration and management with simple to use UI
Helped us get models into production FAST
What do you like best about the product?
TrueFoundry helped us test several different open source models, and even helped us find an embedding model that works much better than openAI (for our needs). They handled all the
infrastructure for it automatically.
TrueFoundry also automates Autoscaling and Infrastructure orchestration to host our model. We don't even have to think about it. There was a small hiccup when we launched last year, and they were on it and fixed it ASAP.
infrastructure for it automatically.
TrueFoundry also automates Autoscaling and Infrastructure orchestration to host our model. We don't even have to think about it. There was a small hiccup when we launched last year, and they were on it and fixed it ASAP.
What do you dislike about the product?
Honestly, haven't had any real issues. We had one hiccup soon after launch around monitoring, and they fixed it within an hour and we were good to go.
What problems is the product solving and how is that benefiting you?
just made getting a model into production easy. helped us find the right model and then took care of everything.
Easing up continuous deployment
What do you like best about the product?
It makes it extremely easy and fast to deploy new services/models to test environments and then promote them to production with just a few clicks. This is facilitated by a great UI that abstracts all the Kubernetes infrastructure, allowing us to reduce costs and move to different server providers seamlessly.
What do you dislike about the product?
Setting up the entire infrastructure and specific services can be challenging in some scenarios. However, TruFoundry's support has excelled in helping us get to where we needed to be every time, with no delays.
What problems is the product solving and how is that benefiting you?
Easing up deployment process: enabling the whole team to deploy more often and independently.
Handling Kubernetes behind de scene: taking advantage of the benefits while saving us form hiring a kubernetes specialist
Handling Kubernetes behind de scene: taking advantage of the benefits while saving us form hiring a kubernetes specialist
One stop plaform for cloud ML Deployments
What do you like best about the product?
Abstracted Kubernetes Pipeline, Cost Savings from Compute Sharing, Customer Support, Ease of Implementation
What do you dislike about the product?
Not a dislike, but they don't support edge deployment usecases currently.
What problems is the product solving and how is that benefiting you?
Because of TF we have reduced our deployement compute costs by 50%
Truefoundry is a great product with an incredible team behind it
What do you like best about the product?
- Multicloud: can easily manage multicloud deployments with a super easy to use interface. This really cut a lot of development/devops time.
- LLM use case: can easily create/manage LLM endpoints based on open source models or finetuned models with ease. Performance is top notch without much manual setup.
- Customer support: really incredible and helpful team that are willing to share insights and help us grow.
- LLM use case: can easily create/manage LLM endpoints based on open source models or finetuned models with ease. Performance is top notch without much manual setup.
- Customer support: really incredible and helpful team that are willing to share insights and help us grow.
What do you dislike about the product?
It relies heavily on k8s pods (which facilitate the multi-cloud integration) but also makes it harder to run very simple deployments in compute instances.
What problems is the product solving and how is that benefiting you?
For me TrueFoundry helped us answer our benchmarking questions around open source LLMs (vs. closed source) and helped us square the costs
Deployed a deep learning based recommendation system with TrueFoundry
What do you like best about the product?
Ease of use, ease of implementation, the support provided by the relevant team
What do you dislike about the product?
So far none or very few such as adding some more flexibility such as providing support for integrating model performance
What problems is the product solving and how is that benefiting you?
TrueFoundry helped us deploying a real-time recommendation system using ML-models.
showing 11 - 20