Sign in Agent Mode
Categories
Your Saved List Become a Channel Partner Sell in AWS Marketplace Amazon Web Services Home Help

Robust and User-Friendly Tools for Experimentation Support

  • By Information Technology and Services
  • on 01/23/2024

What do you like best about the product?
Statsig is a valuable tool for conducting experiments. We utilize Statsig to perform experiments on our new features, assessing the outcomes against predefined metrics to inform sound decision-making.

One notable feature of Statsig is its user-friendly feature gate, which enables easy customization. This functionality empowers us to make various adjustments based on the feature gate.

Additionally, Statsig offers console APIs, allowing for customization and integration with existing systems. This flexibility enhances our ability to tailor the tool to specific needs, with numerous possibilities to explore through the feature gate.

The "Explore" tab in Statsig permits us to execute customized queries, facilitating a detailed breakdown based on different groups.

Moreover, Statsig maintains a dedicated Slack channel for production support and the collection of user feedback. Their responsiveness is noteworthy, providing prompt and supportive assistance. This collaborative environment contributes to continuous improvement and the development of new features within our systems.
What do you dislike about the product?
Debugging Statsig experiment results can be somewhat challenging. Exporting the entire raw data of an experiment may consume a significant amount of time and generate a large file. In many cases, a more efficient approach is to focus on specific test entities to identify any outliers.

One drawback of raw data export is the absence of group names. To associate entities with their respective groups, it's necessary to export exposures as well. Exploring additional queries in the "Explore" tab could offer a more streamlined solution, allowing for more customized queries without the need to download a sizable experiment file. This approach may enhance the efficiency of result analysis and debugging processes.
What problems is the product solving and how is that benefiting you?
Assess the recently launched features or resolved bugs.