Monte Carlo Data + AI Observability Platform

My use case for Monte Carlo is both data quality and observability. We are using it as part of robustly monitoring the jobs as well as finding out any anomalies with respect to data quality issues.

In Monte Carlo, as part of observability, we have dynamic alert systems that learn the previous patterns of data anomalies and customize the monitoring system. It does not only have static rules because it has machine learning based models that learn the patterns. For example, during Thanksgiving, more purchases are happening, so you can expect more issues. It learns those patterns and sends the alerts based on that. The system does not send false alerts.

We use anomaly detection as part of a monitoring system. For instance, I was working for an airline where daily check-ins, checkouts, and transactions happen in real time. We wanted a very robust monitoring system that could monitor the data in real time. Whenever there is an anomaly, such as some columns which are not supposed to have nulls or which are not supposed to have certain data, you can train your machine learning model to have that threshold. You cannot just keep that threshold at 10% or something. You can train that machine learning model so that whenever a null detection happens or some kind of data mismatch happens, or when there is a schema change, it detects so many anomalies. We had many anomaly detection alerts.

The customizable alerts and dashboards in Monte Carlo were very customizable because it not only gives you the option to select alert features using drop downs, it also opens up a window where you can write your own customizable queries in SQL.

Certain features of Monte Carlo have contributed to maintaining our data trust by having multiple steps where you can define the model and also specify the probability distribution for your input. You can simulate that model over the past pattern. Additionally, it will give nice dashboards which are very handy and easy to understand to check how the anomaly patterns are progressing. If there is any sudden spike on a particular day, you can easily spot that and dig deep into it.

Regarding Monte Carlo, I would say that currently we can have machine learning options. We might have to integrate MCP servers so that it can connect to multiple systems at once and we should have some kind of a placeholder for artificial intelligence integration. Artificial intelligence can access multiple systems underneath Monte Carlo, such as any kind of database or any kind of real-time source systems. Currently, I think it is lacking that capability.

I have been using the solution since 2024, which is around more than two years.

The stability was very stable. I did not see any issues with respect to stability, and I would rate it a ten.

The scalability was good because when we enrolled it, it was already scaled up. We did not require it to be scaled up again, so I cannot fully comment on that.

I rate the technical support around nine out of ten because they are pretty responsive.

Data quality monitoring throughout the data lifecycle is very important, especially in this artificial intelligence era. If you feed garbage into artificial intelligence, it will hallucinate more and will not give you accurate results. It might divert into deploying many more agents and utilizing many more tokens rather than confining to a particular set of tokens. It is not only important from your data perspective, but also very important from your revenue perspective. The lost tokens are directly impacting an increase in costs or a decrease in revenue.

Regarding the pricing, it is a bit expensive compared to traditional monitoring systems provided by other vendors. However, the extra features and the trust come with some cost, so I think it should be fine. I have worked with many customers who do not have any complaints. In fact, they migrated many other systems from traditional monitoring systems to Monte Carlo. The customers are accepting of this pricing model.

Monte Carlo has many advantages compared to other solutions. As I mentioned, it has a lot of machine learning functionality and excellent user friendliness. The interface is quite crisp and the appearance is quite good. Traditional tools require some prior knowledge, but with Monte Carlo, you can onboard any user at any time. They can easily understand how to use that tool.

The solution requires maintenance because new features get rolled out and you need to upgrade those features. During that time there is a little bit of a pain point, but that is acceptable because you will experience new functionality.

If others are looking to implement this product, my advice is to robustly monitor their system with very little human intervention. Monte Carlo has an option where it will directly allow you to dig deep into the root cause and you just need to do a few clicks and it will get you to that data issue where it is happening. Very little human intervention is required for this. I give this solution an overall rating of eight out of ten.

My main use case for Monte Carlo is data observability.

To check if the ELT job fails is a quick, specific example of how I use Monte Carlo for data observability.

I use Monte Carlo to point out anomalies in data such as spikes or sudden drops in any particular data. We use Monte Carlo to observe all those things.

In my experience, I really appreciate Monte Carlo's automated anomaly detection feature. It is very helpful.

The automated anomaly detection in Monte Carlo helps me in my day-to-day work instead of doing everything manually.

Instead of writing rules manually, Monte Carlo learns users' behaviors and then automates data based on it, which is very useful for me.

The positive impact Monte Carlo has had on my organization is that it has accelerated the development process and has reduced the testing time significantly.

I can tell you that Monte Carlo has reduced testing time. If a particular project's testing alone takes 120 hours, it is reduced by three-fourths most of the time, which is extremely useful for us. It has impacted our numbers positively.

Monte Carlo can be improved further by having much more AI integrated into it. I can see that a more sophisticated way of doing things will be very useful.

The existing UI is pretty good, but it could be much more visual. The documentation is good as it is.

I have been using Monte Carlo for about two years.

In my experience, Monte Carlo is very stable.

Monte Carlo is quite scalable, and I am impressed by its scalability.

I would rate the customer support of Monte Carlo at eight or nine out of ten. They are quite good.

Monte Carlo was my first choice, and I did not use a different solution before it.

I cannot be very sure about money saved with Monte Carlo, but regarding time saved, definitely. We have saved more than three-fourths of the time in the testing phase.

I did not evaluate other options before choosing Monte Carlo. Monte Carlo was my first choice.

Regarding Monte Carlo's security features, it has pretty good security, and they are doing a good job on the security side of things.

Regarding Monte Carlo's AI capabilities, I would say its accuracy is around eight or nine out of ten.

My advice to others looking into using Monte Carlo is to learn everything first before using it, rather than testing everything as you go. I would rate this review seven out of ten.