Portkey AI
Portkey AIReviews from AWS customer
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
17 reviews
from
External reviews are not included in the AWS star rating for the product.
Great Dashboard and Analytics, Easy Integration
What do you like best about the product?
The standout feature is the dashboard and analytics, which make observability and monitoring straightforward. Implementation is simple thanks to the available APIs, and there is a wide selection of LLM models and providers. It integrates smoothly into daily monitoring and troubleshooting routines.
What do you dislike about the product?
The documentation falls short and often requires users to figure things out on their own. Additionally, price tracking does not work universally across all models, and for air-gapped setups, pricing updates must be done manually, which can lead to delays in getting accurate information.
What problems is the product solving and how is that benefiting you?
This tool has been instrumental for my DevOps teams, providing deep observability and effective cost controls. It also strengthens reliability through features like routing, retries, and fallbacks, which together make our delivery process faster, more cost-efficient, and predictable for our product teams. Since adopting it, we have experienced quicker release cycles, a reduction in incidents, and more consistent spending across our RAG, ASR, and OCR services running on Kubernetes.
Powerful AI Platform with Easy Integration, But Needs Bug Fixes and Better Analytics
What do you like best about the product?
Portkey is a comprehensive platform for gen AI builders os its AI gateway is smooth integration with large language models and its guardrails have a proactive usage with its prompt management and resilience helps to track costs as per use case and save repeated llm calls which has minimum 3-5 usage per day and its implementation is super easy for any beguines and its customer support is too friendly and responses quickly and its integration is super easy and efficient. we usally have a AI integration in large scale and has the guardrails for a limited usage and this software helps me alot.
What do you dislike about the product?
the software has a lot of bugs and its complexcity for newcomers are too high with missing advanced analytics and its GUI documentation must be more flexible.
What problems is the product solving and how is that benefiting you?
it helps me in building and deploying generative AI applications for unified platform and managing models and security for its smooth operative performance.
I can describe Portkey as a fascinating yet slightly chaotic way to travel—efficient, but not
What do you like best about the product?
It allows you to attach metadata (key-value pairs) to each request, enabling cost breakdowns per user.
What do you dislike about the product?
Lack of control You can’t choose your destination last minute. Once it’s activated, it takes you where it’s been enchanted to.
What problems is the product solving and how is that benefiting you?
Many organisations struggle with integrating multiple large language models (LLMs), managing different APIs, failures, routing, caching, etc. Portkey provides a unified gateway across 1,600+ models and many providers.
Unified LLM Access with Strong Security, But Feature Complexity Can Be Challenging
What do you like best about the product?
Single gateway to many LLMs so less work integrating separate APIs. Guardrails + compliance features help avoid bad or undesired outputs. Good security, standards (SOC2, ISO27001 etc.). Helps reduce costs via caching, fallback, routing to cheaper providers where possible.
What do you dislike about the product?
Complex feature set. Pricing are high for smaller teams. Documentation or value for some advanced parts is still growing so a little gaps are still there in execution. Dependency on external LLM providers
What problems is the product solving and how is that benefiting you?
Portkey is made for teams building AI powered apps. It solves problems like infrastructure, governance & reliability overhead of production scale AI/LLM applications.
A Fast, Developer-Friendly Platform That Simplifies API Management and Monitoring
What do you like best about the product?
What I appreciate most about Portkey is its simplicity and performance. It brings clarity and structure to API management, making it easy to track, debug, and optimize requests without needing a complex setup. The real-time monitoring tools and intuitive dashboard help identify issues instantly, and I really like how lightweight and fast the whole platform feels compared to traditional observability tools. The integration process is smooth, and the documentation is clear, even for more technical setups. Their support team is very responsive — you get real answers from engineers who actually understand the product.
What do you dislike about the product?
Portkey is evolving quickly, so there are still a few advanced analytics and visualization options missing compared to older, enterprise-level tools. Also, some custom alert configurations could be more flexible. But the team is clearly improving things rapidly, and updates come frequently with noticeable improvements.
What problems is the product solving and how is that benefiting you?
Before using Portkey, we struggled to get visibility into our API calls and performance metrics across multiple services. With Portkey, we now have centralized monitoring and faster debugging, which has drastically reduced downtime and improved reliability. The platform also helps us optimize response times and track usage costs, allowing us to make smarter infrastructure decisions. It’s become a key part of our dev and ops workflows, used daily by developers and product teams to keep everything running smoothly.
Portkey was the missing piece for production reliability - highly recommended
What do you like best about the product?
- Onboarding implementation is straightforward and is aided by good documentation
- Its helped us maintain a high degree of reliability for production systems by features including fallbacks
- The dashboard is helpful for daily observability with custom metadata filters and cost aggregates being particularly helpful
- Helpful support and excellent community
- The pace of adding new features is great
- Its helped us maintain a high degree of reliability for production systems by features including fallbacks
- The dashboard is helpful for daily observability with custom metadata filters and cost aggregates being particularly helpful
- Helpful support and excellent community
- The pace of adding new features is great
What do you dislike about the product?
The ability to export response data from the dashboard is a missing piece. We have received data exports by interfacing with the support team in the past but the manual process adds friction.
What problems is the product solving and how is that benefiting you?
Portkey helped us increase reliability and maintain regular observability of our LLM-based features that have been deployed to production. This helps us maintain promised SLAs for customers.
The best software you can get for your LLM
What do you like best about the product?
Very easy to use, an amazing amazing support team, and a perfect product for running an LLM.
What do you dislike about the product?
Nothing - I like everything about the tool - a few bugs here and there that I've run into, but the support team helped with all of them, which I'm grateful for.
What problems is the product solving and how is that benefiting you?
- Tracks costs
- Makes the process of storing prompts easy
- I can make tweaks to the prompt much more easily, and the changes take effect on our app itself… instantly.
- Makes the process of storing prompts easy
- I can make tweaks to the prompt much more easily, and the changes take effect on our app itself… instantly.
A great tool to measure cost and debug API Request
What do you like best about the product?
IT helps me keep the logs of my usage, very easy to integrate. Gives me an estimate of my costing.
What do you dislike about the product?
None as of now. Its solving the problems i expected it to.
What problems is the product solving and how is that benefiting you?
It helps me keep track of my API usage, give me logs of the requests. It also helps me to manage my prompts.
Integrate AI into your application
What do you like best about the product?
I like that I can create custom guardrails to check for specific patterns (such as regex matches or JSON schema validation). I also like guardrails operate in real time because this allows me to enforce rules and policies as requests are processed
What do you dislike about the product?
I don't think there is anything I dislike about Portkey software. If I had to knick pick, I would say I run into a bug very very occasiaonaly.
What problems is the product solving and how is that benefiting you?
I don't have to worry about my data safety because Portkey's guardrails provide reliability. The input and output validation of AI models ensures the data is safe to use.
Portkey: A Game Changer for AI Driven Development
What do you like best about the product?
Portkey's AI Gateway makes managing and routing AI requests across multiple provides incredibly seamless, boosting efficiency and scalabillity.
What do you dislike about the product?
The platform can be overwhelming for new users due to vast array of features.
What problems is the product solving and how is that benefiting you?
I have integrated Portkey into my AI powered App.
showing 1 - 10