Reviews from AWS Marketplace
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
External reviews are not included in the AWS star rating for the product.
The best experimentation platform I've used
What do you like best about the product?
- Easy-to-use SDKs with excellent documentation
- Rich feature set for various feature gating and experimentation use cases
- Powerful metrics platform, especially the custom metrics with funnel support is super useful
- Rich feature set for various feature gating and experimentation use cases
- Powerful metrics platform, especially the custom metrics with funnel support is super useful
What do you dislike about the product?
- Too many different abstractions like Feature Gates / Experiments / Dynamic Config sometimes make it hard to decide which to use since they have overlapping features
- Running multiple sequential experiments on the same parameters requires a code changes, which can be overcome by Layers but the mutual exclusivity of experiments within Layers makes it hard for us to use.
- Running multiple sequential experiments on the same parameters requires a code changes, which can be overcome by Layers but the mutual exclusivity of experiments within Layers makes it hard for us to use.
What problems is the product solving and how is that benefiting you?
Allows measuring incremental changes to our product through A/B tests. Previously we were using firebase experiments, which had a limitation of running separate experiments for iOS and Android and required us to combine results manually. Statsig helps us run them as a single experiment and provides powerful metrics to easily measure impact.
- Leave a Comment |
- Mark review as helpful
Powerful driver of data-driven product development
What do you like best about the product?
Statsig enables our entire product development team to easily understand the results of hypothesis tests without a data scientist/analyst needing to interpret, negates the danger of peeking, and makes it easy to double click on interesting results. It makes our process faster, more trustworthy, more collaborative, and more thorough.
What do you dislike about the product?
We don't use the SDK, we ingest from our warehouse, and setting up those data pulls & associating metrics is nontrivial. Once you're up the learning curve it gets easier but the first time we were definitely glad to have access to their Slack space.
What problems is the product solving and how is that benefiting you?
Statsig enables us to run large numbers of hypothesis tests of various forms with a tiny data team. We trust our results and that lets us move quickly through the product development process.
Easy to use, fast feedback
What do you like best about the product?
Statsig is easy to use. It is also super easy to provide feedback and get in touch with their support teams to explain features to us. Compared to competitors, they have pretty much the same features (if not more)
What do you dislike about the product?
Many features are still under development, but their team is actively working on improving and pushing to deliver these features quickly. There were some features that were very limiting, that we had to ask their support team to override.
What problems is the product solving and how is that benefiting you?
We need to roll out some features to customers slowly, and we are using Statsig to test the parts first in the testing environment and then to a small percentage of the users to ensure everything is fine. Statsig is helping in controlling the rollout of the features and as a quick shut-down in case of failure.
Good tool for experiments and remote feature configs
What do you like best about the product?
A/B testing analysis are a top, multiple options to import your data from different sources making it easy and powerful tool.
What do you dislike about the product?
Not a dislike, but at first it seems complex, especially looking at the dashboard in console, and requires some effort to get into a concept which is different from other frameworks. Everything is well documented though, needs time to read through and explore it.
What problems is the product solving and how is that benefiting you?
As we're mostly running A/B tests in parallel on multiple platforms, a variaty of metrics we can use and tooling for data analyses is the most import part for us.
Very practical tool to evolve software through experiments
What do you like best about the product?
It is easy to set up experiments, collect the results and analyze the metrics. If needed, one can export their data and analyze it externally.
What do you dislike about the product?
Documentation could be improved, in particular about the APIs.
What problems is the product solving and how is that benefiting you?
Statsig ultimately helps our product design choices by making it about the data instead of personal opinions.
Growing API, wealth of features, real-time operation
What do you like best about the product?
Statsig has been a great alternative to Firebase Remote Config. We had issues with real-time access to feature gates, particularly when it came to operating at app start up, and Statsig has been much quicker and effective. I know Firebase has had some updates recently, but the wealth of features Statsig offers, as well as its intelligence and accuracy for A/B testing results, makes it well worth the switch!
What do you dislike about the product?
The learning curve is steeper than Firebase, but it's worth it due to the accuracy and broader set of features you can access.
What problems is the product solving and how is that benefiting you?
Real-time access to feature gates and accurate A/B testing. Their quick support through their Slack channel has been spot-on as well!
Good tool for A/B testing
What do you like best about the product?
Creating feature gates and implementing experiments is straightforward. It provides a large set of metrics across all of your application's events in how the feature/experiment can effect them.
What do you dislike about the product?
Creating metrics on events can be somewhat limited/unintuitive. Creating/changing metrics will not update past data even if the past events exist within the system.
What problems is the product solving and how is that benefiting you?
Feature gates and experiments are quick to set up and run. There is a lot of customization that can be done in both to be able to create any needed features/tests. We are able to set up quickly test new features and ensure we are not hurting our current app and making improvements before releasing the new feature to everyone.
A comprehensive solution to a common pain point
What do you like best about the product?
The most helpful aspect of Statsig is that rather than complicating and diluting their platform by attempting to solve every development problem, they've focused on one widespread pain point in software development and created a comprehensive, intuitive solution that simplifies the process of feature access management.
Additionally, their team is very responsive to feedback and constantly builds tools to improve the developer experience of their customers.
Additionally, their team is very responsive to feedback and constantly builds tools to improve the developer experience of their customers.
What do you dislike about the product?
There isn't a whole lot to dislike about Statsig, but I would like to be able to see more granular analytics and history on the activity of specific feature gates.
What problems is the product solving and how is that benefiting you?
The primary problem that Statsig solves in my day-to-day work is that it simplifies the process of creating and managing access to new in-development features.
Super efficient way to run A/B tests
What do you like best about the product?
My team has been using Statsig for over a year now and we find it's such an easy way to run A/B tests. It's efficient for both product and eng and super simple to ship the winning version.
What do you dislike about the product?
Nothing! I've been super happy with using Statsig and would recommend it to anyone in the industry.
What problems is the product solving and how is that benefiting you?
Efficiently running experiments and quickly shipping experiments to users to learn fast. Our team is more productive and we're able to understand analytics of experiments fast.
The all-in-one experimentation tool
What do you like best about the product?
Statsig has enabled Numan to move and test at a lightning pace. We greatly appreciate their sequential analysis engine and BigQuery ingestion that allow us to create a full view of how our new features are benefiting the lives of our patients and help us ship high impact features without waiting for full test durations.
What do you dislike about the product?
It can be complex to understand the results tab and the initial setup can be daunting without coding or statistical knowledge. But once it's setup you don't need to worry about it again.
What problems is the product solving and how is that benefiting you?
Ingestion of events and numerical data from BigQuery to run experiments that cover numerous functions within a healthcare organisation.
Running continous sequential A/B tests that require numerous metric criterias. It would be daunting to do it by hand.
Running continous sequential A/B tests that require numerous metric criterias. It would be daunting to do it by hand.
showing 21 - 30