Listing Thumbnail

    Arize AI

     Info
    Sold by: Arize AI 
    Deployed on AWS
    Arize is the all-in-one AI Agent Engineering platform to develop, observe, evaluate, govern, and continuously improve AI agents and applications at scale. With enterprise-grade features like the Alyx AI assistant, online evaluations, automated prompt optimization, role-based access control (RBAC), and robust support, Arize AX empowers both technical and non-technical teams to build and manage self-improving agents from development through production.
    4.4

    Overview

    Play video

    Arize AX is the all-in-one AI Agent Engineering platform that powers the next generation of self-improving agents and applications - from development to live production. With tools for prompt optimization, full trace observability, agent evaluation, and live monitoring, Arize helps AI teams build generative AI systems faster, improve performance, and scale with confidence.

    Built for modern agent architectures and deployed in your AWS environment, Arize AX integrates seamlessly with Amazon Bedrock Agents and popular open-source frameworks.

    -Prompt IDE for Optimization: Design, test, compare, and evolve prompts in a powerful environment with live inputs, outputs, and integrated evaluation results.

    -Application Agent-Level Observability and Tracing: Visualize every step of agent behavior - prompts, tools, memory, routing, and LLM outputs - with minimal code using the Arize OpenInference instrumentation.

    -LLM and Agent Evaluation: Run offline and online LLM-as-a-Judge evaluations to assess accuracy, tool-calling, planning, and goal achievement.

    -Self-Improving Agent Workflows: Drive closed-loop improvement by combining trace analysis, evaluation feedback, and golden data sets into continuous iteration.

    -Datasets and Experiments: Use curated and/or human-annotated datasets to run controlled experiments across prompt strategies, agent configurations, or toolchains, and measure performance impact over time with built-in analytics

    -Copilot Assistant (Alyx): Navigate traces, surface anomalies, and ask natural-language questions about agent performance - all in-product.

    -Real-Time Monitoring & Alerts: Define custom metrics, monitor latency, token usage, or failures, and set alerts to stay ahead of production issues.

    -Agent Governance and Audit Trail: Every agent action is captured as a span-level record, the reasoning steps, tool calls and their arguments, retrieval results, model inputs and outputs, cost and latency. Replay a failed request, compare passing against failing runs, and show which version of a prompt or evaluator governed a given output. Arize authored OpenInference, the open tracing convention AWS documents as an accepted input to Amazon Bedrock AgentCore Evaluations, so the record is portable rather than locked to one vendor. For teams facing EU AI Act transparency obligations, that chain from sources consulted through reasoning applied to action taken is the technical basis of an explainability claim.

    -Machine Learning Observability and Computer Vision: Monitor, troubleshoot, and improve traditional ML and CV models alongside LLM agents - tracking drift, bias, and performance across tabular, image, and multimodal datasets.

    Highlights

    • Agent and LLM Application Observability: Gain full visibility into the behavior of your AI agents and LLM-powered applications. Arize captures and visualizes every step - user inputs, routing logic, tool calls, memory access, and model outputs - using tree-structured traces. With native support for Amazon Bedrock Agents and open frameworks, observability is seamless and code-light. That span-level record is the audit trail: what the agent did, in what order, and on what evidence.
    • Governance and Enterprise Controls: Run agents under governance you can evidence. Guardrails detect jailbreak attempts, PII leakage and unsafe tool use with configurable corrective action. Human review queues keep a specialist in the loop. SSO, RBAC, custom roles, project-level restrictions and audit logs govern the record itself. SOC 2 Type II, ISO/IEC 27001, HIPAA and GDPR, with self-hosted deployment inside your own AWS account so no trace data leaves your boundary.
    • Prompt IDE and Evaluation: Optimize prompts with Prompt IDE, purpose-built for fast iteration and testing. Compare prompt versions side by side, analyze agent responses, and apply online or offline LLM as a Judge evaluations to measure quality, correctness, and performance at scale. Evaluators run continuously against production traffic, so policy criteria are enforced on live agents rather than checked once before release.

    Details

    Sold by

    Delivery method

    Deployed on AWS

    Features and programs

    Buyer guide

    Gain valuable insights from real users who purchased this product, powered by PeerSpot.
    Buyer guide

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    12-month contract (1)

     Info
    Dimension
    Description
    Cost/12 months
    Arize Pro Edition
    Tracing, Prompt IDE, evaluations, Alyx co-pilot. Subscription based.
    $1,200.00

    AI Insights

     Info

    Dimensions summary

    This listing offers one subscription option: Arize Pro Edition, billed per unit under a contract. You buy a quantity of units rather than choosing between tiers. The subscription covers tracing, the Prompt IDE, evaluations, and the Alyx co-pilot. Tracing records each step of a request through your agent so you can find where a response went wrong. Evaluations score agent output, and the Alyx co-pilot helps you investigate traces and build evals. Pricing scales with the number of units you commit to for the contract term.

    Top-of-mind questions for buyers

    The marketplace listing bills by units but does not define what a single unit maps to, such as a user, a span, or a volume of traces. Confirm with the vendor how units are counted and how many you need before you commit to a quantity.
    You get tracing, the Prompt IDE, evaluations, and the Alyx co-pilot. Tracing records each step of an agent request. Evaluations score agent output. The Prompt IDE lets you build and test prompts. Alyx is a built-in assistant that works across your traces, datasets, experiments, and evaluators.
    This is a contract subscription priced per unit. You commit to a quantity of units for the contract term and pay for that commitment. The listing does not describe usage-based or overage charges beyond your committed units. Ask the vendor how costs behave if your usage grows past your committed quantity.
    arize.com+1
    Helpful?

    Vendor refund policy

    No returns or refunds.

    How can we make this page better?

    Tell us how we can improve this page, or report an issue with this product.
    Tell us how we can improve this page, or report an issue with this product.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Software as a Service (SaaS)

    SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.

    Support

    Vendor support

    Email: marketplace@arize.com 

    Enterprise Support: Includes onboarding, instrumentation guidance, custom evaluation setup, and prompt optimization strategies.

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Comparison

     Info
    Updated weekly

    Accolades

     Info
    Top
    25
    In Observability, Software Development
    Top
    50
    In Computer Vision
    Top
    100
    In Data Governance

    Customer reviews

     Info
    Sentiment is AI generated from actual customer reviews on AWS and G2
    Reviews
    Functionality
    Ease of use
    Customer service
    Cost effectiveness
    Positive reviews
    Mixed reviews
    Negative reviews

    Overview

     Info
    AI generated from product descriptions
    Agent and Application Observability
    Full visibility into AI agent behavior through tree-structured traces capturing user inputs, routing logic, tool calls, memory access, and model outputs with native support for Amazon Bedrock Agents and open frameworks.
    Prompt Optimization and Testing
    Prompt IDE environment for designing, testing, and comparing prompt versions side by side with live inputs, outputs, and integrated evaluation results to measure quality and performance.
    LLM and Agent Evaluation
    Offline and online LLM-as-a-Judge evaluations to assess accuracy, tool-calling, planning, and goal achievement with continuous evaluation against production traffic.
    Governance and Audit Controls
    Span-level audit trail capturing every agent action including reasoning steps, tool calls, retrieval results, model inputs and outputs, with role-based access control, SSO, custom roles, and compliance certifications including SOC 2 Type II, ISO/IEC 27001, HIPAA, and GDPR.
    Real-Time Monitoring and Alerting
    Custom metrics definition and monitoring of latency, token usage, and failures with configurable alerts and anomaly detection capabilities for production issue prevention.
    Multi-Model Type Support
    Monitoring and observability capabilities for tabular, deep learning, computer vision, natural language processing, and large language model deployments
    Performance and Drift Detection
    Identification and mitigation of model performance degradation, data drift, data integrity issues, hallucination, accuracy, safety, and security problems
    Root Cause Analysis and Diagnostics
    Advanced analytics using 3D UMAP for macro-level trend and outlier analysis, with micro-level root cause analysis and diagnostic capabilities for model issues
    Security and Access Control
    SOC2 Type 2 security compliance certification and role-based access control (RBAC) for enterprise-level permission management across protected environments
    Custom Metrics and Dashboards
    Customizable dashboards and reports with support for custom metrics to track model performance aligned with business KPIs
    Data Quality Monitoring
    Automated monitoring and alerting across data vitals with out-of-the-box anomaly detection and configurations for identifying data quality issues.
    Multi-Modal Data Support
    Capability to monitor tabular, image, and text data types across machine learning applications and data pipelines.
    Privacy-Preserving Architecture
    Platform operates on processed data summaries rather than raw data, enabling privacy preservation and no-configuration deployment at scale.
    Comprehensive ML Observability
    Unified monitoring of model inputs, outputs, performance metrics, data drift, concept drift, and upstream data quality issues in a single platform.
    Broad Integration Ecosystem
    Integration with popular ML and data tools including Pandas, Apache Spark, AWS SageMaker, MLflow, Flask, Ray, RAPIDS, and Apache Kafka.

    Security credentials

     Info
    Validated by AWS Marketplace
    FedRAMP
    GDPR
    HIPAA
    ISO/IEC 27001
    PCI DSS
    SOC 2 Type 2
    No security profile
    -
    -
    -
    -
    -
    No security profile

    Contract

     Info
    Standard contract
    No
    No
    No

    Customer reviews

    Ratings and reviews

     Info
    4.4
    86 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    50%
    49%
    1%
    0%
    0%
    6 AWS reviews
    |
    80 external reviews
    External reviews are from G2  and PeerSpot .
    Gez Tadesse

    Improved AI workload visibility has reduced manual planning and supports reliable monitoring

    Reviewed on Nov 05, 2026
    Review from a verified AWS customer

    What is our primary use case?

    My main use case for Arize AI is observability of AI workloads, specifically around agent TKI and agent monitoring, as well as tracking token usage.

    Some of our conventional observability monitoring tools, such as DynaTrace and DataDog, were not sufficient to monitor specific agent TKI workloads from an end-to-end observability perspective. We tested Arize AI in our separate POC environment, which gave us a better picture, especially of AI workloads and more particularly agent TKI workloads.

    Arize AI is getting better at giving us a clearer picture from an end-to-end observability and monitoring perspective around monitoring some of our API exposure, while also identifying where some of our gaps are in overall observability from an end-to-end perspective.

    How has it helped my organization?

    Arize AI has positively impacted my organization from a visibility perspective, and we also use it for our planning purposes, where we used to second-guess.

    Arize AI has helped with planning by reducing errors and avoiding some manual work that was usually based on assumptions. We now have data from Arize AI that has helped us scale, especially as we introduce new environments, allowing us to baseline our forecast.

    What is most valuable?

    The best features Arize AI offers include visibility, tracking of very specific metrics, and fine-grained details, which have been really helpful.

    The most helpful fine-grained metrics are very specific to availability, especially for EC2 workloads and containers. There is also usage tracking, especially of token spend, and recommendations on the overall spend from a planning perspective.

    I have found Arize AI really helpful compared to other conventional observability and monitoring tools.

    I think Arize AI's governance and security are very strong.

    I find the accuracy and reliability of Arize AI's output to be very reliable. I have found its outputs to be accurate and reliable, providing consistent and trustworthy results for my monitoring and tracking needs.

    What needs improvement?

    I believe Arize AI can be improved with integration with some of the other providers. It works really well with some of the major frontier AI models, but I think the API should be exposed as much as possible to non-frontier models as we go along.

    I think integration can be improved. It is not a major challenge, but it requires some TKI understanding along with an understanding of Arize AI from an API perspective, so it could be improved with more detailed or better user guides.

    Except for exposing some of the APIs to some non-major AI frontier models, I would say we are pretty much satisfied with Arize AI.

    For how long have I used the solution?

    I have been using Arize AI for about six to seven months.

    What do I think about the stability of the solution?

    I find Arize AI to be stable.

    What do I think about the scalability of the solution?

    Arize AI's scalability obviously depends on the cloud providers' backend scalability, but I find it to be very scalable.

    How are customer service and support?

    The customer support was top-notch. We were really supported and also had training from Arize AI for our internal team for Level 1 support, so far so good.

    I would rate the customer support a nine on a scale of 1 to 10.

    Which solution did I use previously and why did I switch?

    We haven't used any solution related to TKI, but previously, we had DynaTrace as our observability and monitoring solution, which was mainly for application performance monitoring and typically infrastructure monitoring.

    What was our ROI?

    We don't have any specific metrics to share regarding return on investment, but Arize AI has really avoided manual work and improved our outcomes in terms of visibility, while also providing continuous monitoring.

    What's my experience with pricing, setup cost, and licensing?

    I think it's reasonably priced and I don't have any major concerns.

    Which other solutions did I evaluate?

    Before choosing Arize AI, we did not evaluate other options. We reviewed some Gartner recommendations, and our team also had training on Maven.com, where they had access to some of the AI lab as part of the training. That sparked our interest and provided information.

    What other advice do I have?

    On a scale of 1 to 10, I would rate Arize AI an eight.

    I choose eight out of 10 because it satisfies most of our requirements and it's reliable. The data are consistent, and it will definitely meet our future needs as well.

    My advice to others looking into using Arize AI is to test it in a POC environment and spend some time to ensure it meets your specific use case. Just don't go by public reviews, as it's a very solid product and solution that's scalable and very secure.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Amazon Web Services (AWS)
    Marketing and Advertising

    Arize AX Streamlined Tracing, Evals, and LLM Cost Insights for AI Agents

    Reviewed on Nov 03, 2026
    Review provided by G2
    What do you like best about the product?
    Arize AX was a powerful addition for our agentic features launch across our product suite. Before we pushed to production, I sent my first trace into it, and it reviewed all the signals and clustered the most frequent problems into clear issues we could fix.

    Beyond that, its managed cost agent breaks down LLM spend and helped us reduce our overall model-routing cost by 15%. I also find the custom evaluation methods much more advanced. In particular, I use the decision judge to organize evaluations for our agentic users’ queries. There are more than enough templates to get started with evals, instead of having to build everything from scratch.
    What do you dislike about the product?
    The UI feels very minimalist and seems to lack deeper-level functionality for advanced users who need more. I also didn’t like the output from its support agent, "Alyx"—the answers didn’t feel very to the point. It also lacks direct integrations with third-party platforms, or at least I couldn’t find an easy way to set them up.
    What problems is the product solving and how is that benefiting you?
    When it comes to labeling queues, it does a good job helping our subject matter experts create a golden dataset without needing to code. For our programmers, they sometimes use custom metrics when the ready-made templates aren’t enough for what they’re trying to measure.

    The experiment features are what I like most, especially the playground. We can test everything there—user prompts, models, and agent output—before pushing to production, which helps us avoid low CSAT. Over time, the datasets created through experiments also help us compare the current version of guardrails and other agent configurations with previous ones, so we can see the progression visually as things evolve, increasing our Agent improvement performance drastically.
    Attila Kovacs

    Iterative observability has transformed agent debugging and now cuts test cycles in half

    Reviewed on Oct 09, 2026
    Review from a verified AWS customer

    What is our primary use case?

    I'm using Arize AI for AI observability and evaluation for AI agents development.

    I have it deployed in development and I need to check for specific questions what the agent was doing, what MCP tools it used, what thinking process it went through, what steps it chose to do in LangGraph, what nodes it went through, and if it had an error, what was the cause of the error. This way we can make the application better and better with iterations on the product. Arize AI, specifically the Phoenix tool, helps with developing this application.

    Arize AI has an MCP server which is built-in. I can hook that up to Claude or GitHub Copilot and it's really helpful to extract sessions and conversations. I have key users who give me feedback about how the agent performed, and I mostly care about the negative feedback. I review with the MCP server and with the help of our coding agents what the agent deployed on development did. This way I can make the experience of the users better with each iteration. The tool also helps me with testing and evaluating the AI. I have a set of questions and I use LLM as a judge inside this tool to make at each release some assessment and tests with our agents. For each iteration I do these LLM as judge tests on a set of question datasets where I have YAML files and I have specified what the agent should do for those specific scenarios. I also have a golden dataset and I'm evaluating with that one as well using this tool.

    How has it helped my organization?

    I have improvements on the speed of development because with the help of Arize AI, I was able to cut on development speeds. Mostly on feedback from the client side and also from my point of view. When I as a developer deploy the agent, I have a set of questions which I verify and I can automate this process. A lot of testing and continuous improvement processes are automated using their tool.

    Since using Arize AI, development speed improved by 50% to 60%. I saved approximately two days on each release on the testing and evaluation.

    What is most valuable?

    I think the most useful feature of Arize AI is their built-in MCP server which is providing a lot of data for our coding agents and our coding assistants in Claude or GitHub Copilot.

    I can process data in bulk with Arize AI. I have approximately ten conversations with negative feedback and then it would take manually to review them two to five hours. With a coding agent and the MCP server hooked up, I can do the same review in approximately ten to twenty minutes. This helps me a lot with time management and efficiency. Also the AI agents and the coding assistant AI agents are able to come up with steps to fix those issues which I had. They receive a lot of data through that MCP server which would be impossible to give them manually. I think it's the most useful tool they have, and that's why I chose them.

    What needs improvement?

    I think Arize AI's UI could be better because it's pretty hard to understand. Before using their tool, I was using LangFuse and the UI from LangFuse was easier to comprehend. Also, their UI does not allow filtering for specific users or filtering on feedback. I think these minor UI changes would help a lot for users and also for non-technical users because business analysts are using the tool on my side. A lot of time they want to filter by a specific user and they cannot do that. I can do it with the MCP server, but filtering in the UI would be a great addition.

    Another improvement would be some guidance on how to update your tool. If you are deploying the latest version of the tool right now, but in a month they have a new major release and then there are a lot of breaking changes, it's not easy to update it when it's deployed already. Descriptions or a guide for an AI agent or a guide for humans to deploy it would be really helpful.

    For how long have I used the solution?

    I have been using Arize AI for six months.

    What do I think about the stability of the solution?

    I think Arize AI has quite good reliability. Some things could be improved, but based on my experience, as a developer I have to do some things so it works fine. I think the overall accuracy and reliability is quite good, and they are refining it with each release. I'm thankful and fulfilled with that.

    Arize AI is very stable.

    What do I think about the scalability of the solution?

    I think Arize AI is quite easy to scale. I did not have problems with it. It was straightforward. After deploying it, I could do replicas and everything quite easily. It's straightforward and easy.

    How are customer service and support?

    I don't have experience with their customer support, but I have had a call with them. I think they are quite helpful and they provide useful insights.

    Which solution did I use previously and why did I switch?

    I used LangFuse before.

    I switched from LangFuse because it was a dependency hell. I had a lot of dependencies on LangFuse and a big percentage of them was not compatible anymore after some releases and after updates of some libraries. It was not compatible with my project. Also it could not be deployed because the deployment system was also not compatible with the new versions of LangFuse. I had to switch and I started with the team to look for a new tool and that's how I found Arize AI.

    What was our ROI?

    The return on investment is a lot of time saved. As I said before, I'm saving approximately two to three days per release, and it's a 50% to 60% reduction in time of testing after releases. It obviously has money implications because employees have to invest less time in the process of evaluation and observability. Also fewer employees are needed with the help of the MCP server because the coding agent can do what an employee should do manually. This way the employee has time to do other important things.

    What's my experience with pricing, setup cost, and licensing?

    I don't know the costs because the company did this part. Setup was not straightforward, so costs were a little high time-wise. It took a lot of time to set it up.

    Which other solutions did I evaluate?

    I evaluated the most mainstream options. Mostly LangSmith was the other candidate.

    What other advice do I have?

    I would rate Arize AI nine out of ten.

    Their tool is really helpful and the things I mentioned about improvement are just minor things. It's not a big issue and would be nice to have, but overall their tools are really helpful for me.

    They have quite good AI capabilities included in Arize AI. I appreciate the fact that I can choose any model I want and any LLM. That part is great. About security, I can't say much. I think they are doing a good job overall. It's straightforward to use any model I want. Overall, I think they are doing a good job.

    I use private cloud for Arize AI.

    As I know, I use AWS and also I use Azure from Microsoft.

    I did not purchase Arize AI through the AWS Marketplace.

    I had to see and read the setup steps or find some tutorial to set it up. If I didn't, it's not so easy to do it. I had to check on the database part. It has some environment variables which decide what database it uses. It took me a little time to find it. A good part of it is its built-in MCP server, which is a great addition to the tool.

    Which deployment model are you using for this solution?

    Private Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Amazon Web Services (AWS)
    Harsha P.

    Quick, Accurate Answers That Match the Prompt

    Reviewed on Sep 30, 2026
    Review provided by G2
    What do you like best about the product?
    it's very quick and provides the right answer as per the prompt provided. The experiments and playgrounds allow me to experiment with my data and results required
    What do you dislike about the product?
    It sometimes does not provide the expected result, hence providing multiple prompts to get the expected results and it could be time-consuming until you get the expected result.
    What problems is the product solving and how is that benefiting you?
    It provides answers to my prompts, creates functions to test summarizations all in one place, thereby increasing my productivity and helping me meet my deliverables.
    Irfaana H.

    Unmatched AI Monitoring with Valuable Insights

    Reviewed on Sep 11, 2026
    Review provided by G2
    What do you like best about the product?
    I really like how Arize AX makes it easier to understand what's happening with our AI. The tracing, monitoring, and evaluation tools are especially valuable to me. Tracing is particularly useful since it lets me look at individual AI interactions in more detail and understand what happened when a response didn't perform as expected. I also appreciate that I don't need to be extremely technical to get useful information from it, which is important for me.
    What do you dislike about the product?
    The learning curve. Arize AX has a lot of functionality, which is great, but it can sometimes feel a little overwhelming when you're first getting familiar with the platform, especially if you're not coming from a highly technical background. The onboarding could be improved by making it more guided and role-based. For example, someone using Arize AX from a product support perspective probably doesn't need the same level of technical details upfront as an engineer or data scientist.
    What problems is the product solving and how is that benefiting you?
    Arize AX helps me understand AI performance and identify issues without manual data digging. It saves time troubleshooting and provides insights to improve user experience.
    View all reviews