Zebrunner Selenium Grid Agent

Zebrunner Testing Platform serves as our centralized test automation platform and reporting hub. As an SRE, I work with our QA and development teams to ensure that automated test execution is reliable, observable, and integrated into our CI/CD pipelines. Zebrunner serves as the execution infrastructure for our Selenium-based web UI tests and mobile tests, as well as the aggregation and reporting layers for test results across all frameworks, including JUnit, TestNG, and Cucumber tests running in our backend pipelines. The real-time test execution dashboard, rich reporting with screenshots and logs on failures, and the test scalability analytics are the features our team uses daily. We also leverage Zebrunner Testing Platform's integration with our Jira instance to automatically create and link defects from the failing tests.

Integrating Zebrunner Testing Platform with Jira has helped us stay on track, and the tickets were raised and proved helpful for us.

Zebrunner Testing Platform has helped our organization positively with test results. Before this, we did not have a dashboard or anything to consolidate everything in a single pane. This platform provided us that capability.

Having everything in a single dashboard has affected our team's productivity significantly. I would estimate that the team gained 50 to 60% more productivity after implementing this platform.

The most valuable feature that Zebrunner Testing Platform offers is the real-time test execution view, which shows me the live progress, pass-fail status, streaming logs during long test durations, and streaming logs during active test runs. This is the most used feature in our team's daily workflow. The test scalability tracking classifies whether tests are stable, unstable, or consistently failing based on historical run data. This helps us manage flaky test technical debt. We use this data in our weekly engineering review to prioritize test maintenance work. The AI-powered failure classification groups similar failures by root cause patterns and has reduced the manual triage effort for large test runs significantly. The multi-framework support means we do not have to standardize on a single test framework to benefit from unified reporting, which has given us an important diverse testing stack.

The AI-powered failure classification has impacted our team's efficiency significantly because it found historical data, analyzed patterns, and eliminated the manual pattern matching process we previously used to identify what was triggering failures and what factors were involved. The AI performed this task effectively and reduced our manual work considerably.

There are certain aspects of Zebrunner Testing Platform that require improvements. The initial integration with existing test frameworks, particularly for more customized TestNG configurations, requires non-trivial setup work, and the documentation does not cover all the edge cases we encountered. Zebrunner Testing Platform's own test runner, the Carina framework, is well supported by teams using other frameworks but delivers a somewhat degraded experience in terms of deep feature integration. The platform's resource provisioning for parallel test execution can occasionally result in queuing during peak periods. When running large test suites, though this has improved over the past year, the pricing model based on parallel execution slots requires careful sizing to balance cost against test execution time.

Regarding Zebrunner Testing Platform's AI capabilities, I think that governance and security could be better. After all, it is a SaaS platform, and it could be better if they provided on-premises deployment support. On a SaaS platform, you cannot fully trust it overall, but it is acceptable as long as the organization is comfortable with it.

We have been using Zebrunner Testing Platform for almost a year now.

In two years of using Zebrunner Testing Platform, we have had only two incidents of platform unavailability that impacted our pipelines, both resolved within an hour. The test execution at scale is reliable, as we run up to 200 parallel test sessions during pre-release regression cycles. The reporting platform handles large volumes of test results without performance degradation, which is important when running suites of several thousand test cases. Zebrunner Testing Platform's infrastructure transparently supports parallel execution needs, which is important during our release crunch period.

Zebrunner Testing Platform is quite stable in my experience.

Zebrunner Testing Platform's scalability has been very good for our needs. In our years of using it, there have been only a few incidents of platform availability that impacted our pipelines, both resolved within an hour. The test execution at scale allows us to run many parallel test sessions during pre-release regressions. The reporting platform handles large volumes of test results without performance degradation, which is important when running suites of several thousand test cases. Zebrunner Testing Platform's infrastructure scales transparently for parallel execution needs, which is important during our release crunch periods.

The customer support for Zebrunner Testing Platform is good because the team has been genuinely responsive and technically capable. They have a clear understanding of test automation challenges, not just their own platform, which makes conversations about integration and architecture much more productive. We had a complex integration issue with our custom test engine and listener setup earlier in our deployment period, and the Zebrunner Testing Platform team provided direct engineering support and resolved it efficiently. The product team actively solicits feedback and maintains a high release cadence, so we have seen multiple features we requested ship within one or two release cycles.

The initial integration with existing test frameworks, particularly for more customized TestNG configurations, requires non-trivial setup work, and the documentation does not cover all the edge cases we encountered.

We have seen a return on investment with Zebrunner Testing Platform, as we saved significant time during production issues. Before implementation, we did not have the test results and metrics readily available. Having them provided proved useful.

Zebrunner Testing Platform is an excellent test automation platform that solves the real prevalent problem of fragmented, difficult-to-interpret test reporting in large engineering organizations. The unified visibility, real-time execution tracking, and scalability analytics deliver genuine value. Teams running significant volumes of automated tests across multiple frameworks will find that their ability to maintain and act on their test suite sustains improvement. I would rate this solution highly overall.

Public Cloud

Amazon Web Services (AWS)

My main use case for considering Zebrunner Testing Platform is automation, quality, and the number of test use cases to speed up the process so that we can deliver the product to customers quickly, which can help with customer satisfaction and product quality.

One specific example of how I'd like Zebrunner Testing Platform to help with automation and speeding up my process is that we are currently doing manual testing and are looking for automation capabilities.

I would add that my main use case for Zebrunner Testing Platform is time saving, cost saving, and product quality.

I am not currently using Zebrunner Testing Platform, but I am exploring it and the available products. While conducting market research, I found that Zebrunner Testing Platform is a great tool.

Based on my research so far, the best features Zebrunner Testing Platform offers are that it is user-friendly and easy to use.

When I say user-friendly and easy to use, I am referring to the overall experience of the platform.

Zebrunner Testing Platform has positively impacted my organization, even if it is just from what I have seen in my research so far, as it will reduce time and cost.

I expect Zebrunner Testing Platform to reduce time and cost. For example, automation testing can save approximately fifty percent of the time, and cost saving will definitely reduce twenty to thirty percent.

I think Zebrunner Testing Platform can be improved by adding artificial intelligence features that I would appreciate being added.

I would add that artificial intelligence would help and then it will be a great value add to the product.

I do not think there are any other improvements Zebrunner Testing Platform needs besides adding artificial intelligence features.

This is the first time I am using this solution.

In my experience so far, Zebrunner Testing Platform is stable with no concerns about reliability.

I believe Zebrunner Testing Platform's scalability is good, and I think it would handle my organization's growth if my testing needs increased.

Based on my research and any interactions I have had so far, the customer support for Zebrunner Testing Platform is good.

Positive

I did not previously use a different solution for testing.

I have seen a good return on investment from Zebrunner Testing Platform. For example, I anticipate saving time and money or needing fewer employees.

While I was researching Zebrunner Testing Platform, I noticed that the pricing works clearly and straightforwardly, without any setup or licensing fees being confusing.

Before choosing Zebrunner Testing Platform, I evaluated plenty of available solutions in the market which are higher cost and difficult to use, and not user friendly.

My advice to others looking into using Zebrunner Testing Platform is that they can explore and choose this option. It can definitely be user-friendly, provide return on investment, and help people save time and do end-to-end testing to their applications. It is cloud integrated, which is a value add to the product.

I have covered everything about Zebrunner Testing Platform that I wanted to discuss.

I would add that I am exploring whether artificial intelligence can be integrated with Zebrunner Testing Platform. That would definitely be a great value add for our project and for future products.

My experience with pricing, setup cost, and licensing while researching Zebrunner Testing Platform is that I need further clarification.

I gave this review a rating of seven out of ten.

Public Cloud

Amazon Web Services (AWS)

What do you like best about the product?

It is very quick to learn and all cases can be organized and run every time the tester wants

What do you dislike about the product?

That you cannot login the program with jira for example

What problems is the product solving and how is that benefiting you?

I can do my testing reports much quicker than with other suites

What do you like best about the product?

As a QA tester, I’ve tried various testing tools over the years, but Zebrunner has truly stood out as a game changer. From the moment I integrated it into my workflow, the efficiency and accuracy of my testing processes improved significantly.

One of the most impressive features is its user-friendly interface. Even for team members who are less experienced with these kind of tools, Zebrunner is intuitive and easy to navigate. The comprehensive documentation and tutorials made onboarding a breeze.

Overall, I highly recommend Zebrunner to any QA team looking to enhance their testing capabilities. It’s a robust tool that combines power with usability, making it an invaluable asset in our software development toolkit!

What do you dislike about the product?

Even though its user interface is clear, intuitive and clean, I'd dive more into accesibility assests and probably a UI refresh in a near future.

What problems is the product solving and how is that benefiting you?

Being able to split the job and get as much as I can done in less time.

What do you like best about the product?

real-time reporting and smart test insights

What do you dislike about the product?

For new users, the interface and features can be overwhelming.

What problems is the product solving and how is that benefiting you?

test visibility

What do you like best about the product?

It's simple design and intuitive test cases management features

What do you dislike about the product?

No downsides at all. It performs perfectly everytime, with fast loading times.

What problems is the product solving and how is that benefiting you?

It's providing me an easy to use test case management tool in which I can have all my suites tidy and updated.

What do you like best about the product?

Ease to create test runs and sync automated results available on Launchs tab

What do you dislike about the product?

There's no consistency on the text format (family font, size, color, etc) when pasting text into Description/Pre-Post conditions/Steps to reproduce/Expected result fields.

What problems is the product solving and how is that benefiting you?

Seeing progress of automated results in real time

What do you like best about the product?

I think is a very intuitive tool, with a large number of features. In case that you're new to Automation testing or you have limited knowledge is a great tool.

What do you dislike about the product?

I haven't found anything that warrants a complaint so far.

What problems is the product solving and how is that benefiting you?

I had a lot of automation runs and Zebrunner helped me to have control and execute them with a friendly interface.

What do you like best about the product?

If you have used any other test cases management tool you'll notice this one is really easy to understand. Organising the tests is simple and the UI doesn't get messy as it happens in other tools. Also, the navigation is great.
You can create new test cases very quickly using the quick create button (you'll have to edit them individually after if you need more information in them). I use this very often when i need to cover multiple scenarios on the same feature.

What do you dislike about the product?

I would like a dark theme. And if there's one already, it should be easier to find

What problems is the product solving and how is that benefiting you?

Really simple regression executions. With multiple automated suites we need any qa to be able to execute them and get the results ready to export to other formats where they need them.