AWS Partner Network (APN) Blog
Unlock test intelligence with natural language: QMetry and Amazon Bedrock integration
 |
| SmartBear |
 |
By: Matt Bonner, Solutions Architect – SmartBear
By: Carl Luo, Partner Solutions Architect – AWS
By: Randy Weinstein, Sr. Solutions Architect – AWS
By: Sophia Folino, Associate Solutions Architect – AWS
Software deployment is moving from weekly to daily cycles as organizations adopt continuous integration and continuous delivery (CI/CD) techniques. With this shift, quality assurance has become central to maintaining velocity without compromising reliability. These changes have raised new challenges for trying to turn test data into actionable insight.
QMetry from SmartBear powered by Amazon Bedrock transforms how teams plan, manage, and analyze testing. In this post, you’ll learn how SmartBear AI uses Amazon Bedrock to transform natural language questions into SQL queries, delivering instant insights from your test data.
The challenge: Transforming test data into strategic insights
Across industries, software quality has become a core business driver that shapes customer experience and brand reputation. Executives and product leaders depend on accurate testing insights to make release decisions, manage risk, and maintain confidence in delivery.
According to Capgemini World Quality Report 2025-26, automation is at a crossroads with nearly 50% of organization still in the planning stage and coverage averaging only a third of test cases. That gap shows the ongoing challenge of turning test data into actionable intelligence that supports confident release decisions. Test results are often stored across multiple systems, making it difficult to understand the overall state of product readiness. Reports take time to generate, and data will lose relevance before it reaches the people who need it most.
When quality data is hard to access, the difficulty in generating insights limits visibility at critical stages of release planning, increasing the uncertainty organizations face, which can delay innovation and increase risk.
The opportunity is clear. Teams need a testing solution that moves beyond collecting data to interpreting it in real time, providing leadership with the clarity and confidence to release software at the pace of the business. QMetry uses Amazon Bedrock to combine the power of AI with modern quality management to make testing a source of strategic advantage.
Rethinking test management with AI
Traditional test management often limits how quickly teams can uncover insights. Fortune 500 firms typically rely on manual reporting, complex query building, and multiple layers of data navigation before meaningful information becomes available. These steps slow down collaboration and create unnecessary dependence on technical resources.
With SmartBear AI powered by Amazon Bedrock, teams can remove those barriers. The platform introduces smart AI search and AI-powered SQL generation. These features mean that users can interact with test data using straightforward, natural language.
Figure 1: SmartBear AI SQL generator
Instead of learning SQL query syntax or waiting for analytics support, quality assurance (QA) leaders can ask questions like, “Which test areas have the highest defect density?” or “How ready is this release?” and receive aggregate data from all integrated systems within seconds. This transforms how teams explore information, eliminating repetitive tasks and making insights accessible to everyone.
Figure 2: Custom QMetry reports and tables generated from QI
By turning natural language into real-time analytics, QMetry helps teams find information faster, shortens feedback loops, and makes confident release decisions. The result is a more intelligent and responsive approach to quality management that aligns perfectly with the pace of modern software delivery.
Accelerating insights with Amazon Bedrock
Amazon Bedrock is a fully managed service that organizations can use to build and scale generative AI applications using foundation models (FMs) from trusted providers. For QMetry, this AI platform integration makes it possible to deliver new AI capabilities quickly and securely while avoiding the complexity of maintaining model infrastructure.
Model access, governance, and data protection features available in Amazon Bedrock allow QMetry to focus on delivering intelligent quality management insights to your team. The platform uses AI to understand the connections between test cases, requirements, and quality metrics, turning large volumes of information into practical insights that guide better decisions.
Built on the foundation of Amazon Bedrock, QMetry takes advantage of AWS proven infrastructure for security, reliability, and compliance, and customers reap the benefits from this continued innovation in AI. QMetry has implemented robust security practices aligned with the AWS shared responsibility model. Together, QMetry and Amazon Bedrock create a modern testing environment where data moves securely, insights appear instantly, and organizations can release software with confidence.
Customer success
One of QMetry’s marquee customers is a Fortune 500 financial services firm with a vast portfolio of digital products, each subject to rigorous regulatory and performance standards. The company struggled to unify test data across multiple teams, applications, and development streams. Reports on coverage, defects, and release of readiness were compiled manually, with heavy reliance on SQL queries and cross-team coordination. By the time analytics reached leadership, insights were often stale and lacked the context needed for confident decisions.
Upon adopting QMetry’s platform, the customer began integrating test metrics, requirements, and defect tracking under a centralized system. With the addition of SmartBear AI built on Amazon Bedrock, the firm gained a new capability: QA leaders and stakeholders could now use natural language to interrogate their test data. Questions such as “Which modules have the most open critical defects?” or “Do we have tests covering the highest risk features in this release?” return instant, actionable reports.
The transformation yielded immediate measurable benefits:
- The time required to generate reports shrank from hours to seconds.
- Visibility into coverage and defect trends improved, giving leadership real-time decision support.
- The company accelerated its release cadence, with greater confidence in quality outcomes.
- Cross-functional teams aligned more easily, using shared insight rather than fragmented metrics
By turning testing data into accessible intelligence, this enterprise strengthened its ability to deliver mission-critical software while meeting compliance requirements, improving customer trust, and reducing time to market.
Together, QMetry and AWS empower organizations to achieve continuous quality faster and more efficiently. By using Amazon Bedrock, QMetry brings the power of generative AI directly to quality management, giving teams faster access to insights that require time, coordination, and technical expertise. Customers benefit from real-time visibility in testing progress, better alignment between QA and development, and greater confidence in release decisions. With AI simplifying data exploration and reporting, teams can focus on delivering innovation rather than managing complexity.
This combination empowers enterprises to accelerate delivery without sacrificing quality, turning testing into a strategic advantage that supports faster growth, improved customer satisfaction, and stronger business outcomes.
Looking ahead
AI is transforming how quality assurance contributes to business success. What at one time was a reactive step in the delivery process is now becoming a continuous source of insight that drives better decisions and faster innovation. With capabilities such as smart AI search and AI-powered SQL generation, QMetry gives teams the tools to shift their focus from managing data to improving outcomes.
As organizations continue to modernize their testing ecosystems, AI will play a central role in shaping how quality is measured, managed, and optimized. By using the Amazon Bedrock fully managed generative AI service, QMetry is helping enterprises move toward an era of intelligent, connected quality management where every decision is informed by data and every release builds trust with customers. The future of testing is proactive, adaptive, and immediate. QMetry and AWS are making that future real today.
Experience SmartBear AI on AWS
Empower your teams to deliver quality with confidence through the combined strength of SmartBear AI and Amazon Bedrock. Ready to transform your testing workflow? Discover how AI-powered insights can simplify test management, reduce manual effort, and accelerate release cycles while maintaining enterprise grade security and reliability.
Visit AWS Marketplace to explore SmartBear solutions including QMetry, test it out through a free trial, request a demo, and begin your journey toward a smarter, more efficient approach to quality management.
SmartBear – AWS Partner Spotlight
SmartBear is an AWS Advanced Technology Partner with DevOps Competency provides comprehensive quality management and testing solutions for modern software development, including QMetry, which leverages Amazon Bedrock to transform test data into actionable intelligence through AI-powered natural language queries.