Prophecy Enterprise Express for Databricks

One of the main use cases for Prophecy that I use it for is to create a form that will bring business users' data into our back-end systems. I use that and I also use the workflow to catch any type of errors or any type of missteps that the business users have put into our system.

We have a CareNav program here at the company that utilizes 13 different business users that will interact with the form, entering data that's not readily available to our back-end systems. They're essentially linking that to our back-end systems. Once we have that information, it goes through the pipeline and then finally ends up in Tableau for them to see.

One of the biggest things I enjoy with Prophecy regarding my main use case is the ability to have Python scripts, allowing me to email our end users and our technical users. If any problems arise, Prophecy is pretty easy to set that up.

The best feature of Prophecy, in my opinion, is the form. It was able to give us the ability to bring in that extra data without having to go through an engineering team or any type of Cores or AWS, anything like that. It's easy for usually business analysts who are a combination of IT and business to be able to get these difficult things set up pretty easily.

The form feature of Prophecy is so valuable for our team because it saves us a lot of time. Before it was all manual email entry through Excel forms that were just emailed to a team box, and then we had to monitor that team box. With the form, it's all self-service, so if myself or my teammate that usually maintains the form are out that day, they can still enter their data in and it's still captured on the back end. This has saved us quite a bit of time and resources, so we don't have to back train anyone. It's been very invaluable.

Prophecy has positively impacted our organization overall. I know personally, the project that I'm on with CareNav and then I have a colleague that has other projects utilizing the form as well. It's really helped our business users connect with us more. Some of the forms that they used to fill out and manually pull down and fill in, doing a lot of manual entry, has been solved by Prophecy. We've been able to utilize the form to cut down a lot of legacy products and processes.

Prophecy can be improved, as right now the form is very limited. We have to do a lot of manual entry with the form to get it set up. We have a lot of things that change year over year, so I have to go in there and manually play around with it, manually changing this and that. Having dynamic forms, having the forms connect to back-end data, and basically making the forms more streamlined would be my need from Prophecy. Everything else on the back end, the pipelines, and those types of things have been pretty easy to understand. I think once you get things set up, I've been very impressed with it. The only improvement at least for my side would be the form.

I've been using Prophecy for probably about two years now.

Prophecy has been stable and reliable for me in more recent months. When we were first starting out, it was very buggy. I think that was mostly because we were trying to get it integrated within our system and a lot of our engineers didn't understand what we were doing as a business. Once our engineers learned more about what we did and once Prophecy understood the relationship there, it's been seamless. It was a little bit bumpy on the initial startup, but Prophecy was there every step of the way, and we were able to work through it and now we're pretty smooth.

Prophecy's scalability has handled my growing needs well. It seems that any type of idea that pops into my head, I'm able to talk to the Prophecy folks and they say they'll try to make it happen. As my ideas grow, Prophecy is there to at least attempt or try to help me meet that goal and idea.

The customer support for Prophecy is amazing. I've had weekly calls, and anything that comes up, we end up submitting a ticket to the technical engineering team on Prophecy's side, and they're very quick to email us back, keeping us in the loop with our tickets. I feel we're almost in a white glove type situation. It feels everything that happens that breaks after a release or a push, Prophecy's on top of it to make sure we don't lose any business or productivity.

Everyone I've interacted with at Prophecy has been wonderful. I've been very impressed with the level of professionalism and even casual conversation. I've been enjoying our weekly calls and interacting with anyone in the company. I can't say I've had a bad experience with any of my interactions.

I did previously use a different solution before Prophecy, as it was a very labor-intensive process. We were using Excel to email the users, and they would send it back to us through email. We would manually have to enter everything in. Prophecy was actually one of the solutions that I saw that could fix this, and I started running with that and being able to get through a lot of the engineering setup too that AWS requires or Cores requires or anything else like that. It set us up in a place where we could succeed.

I would say I give it an eight because of the learning curve for some people. It's gotten better with some of the AI documentation. The small frustrations of getting it integrated into the work environment might be a limitation between Prophecy and our IT department. There's a steep learning curve to get it onboard and running. Recently a lot of the bugs have been fixed, and that's been a consistent thing for us. The form needing improvement probably also keeps it from a ten. If we fix the form and the form starts blowing us out of the water, I'd definitely raise my score.

I have seen a return on investment with Prophecy. As I mentioned before, the time saved is the biggest for us. I don't see the financial side of it and I don't see the employee side of it as much because I'm not at that level of the company. It's definitely saved myself and my colleagues and even business users a lot of time because we're able to streamline a lot of their processes through Prophecy and we don't have to do as many checks or manual entries.

Before choosing Prophecy, I evaluated other options. I went to the AI conference in San Francisco and looked at other products while I was there. I had the process and the program in the back of my mind of what I wanted to improve at work. I can't tell you what those competitors were or what those other companies were. Prophecy kind of stuck in my brain, and it became the number one software or project partner that I wanted to work with once I got back and told my colleagues.

I can share specific numbers that show how much time Prophecy has saved my team or organization. For the project I work on, I turned 20 hours of collecting data and entering data down to four or five at most. Most of the time it's even an hour of work, just double-checking to make sure everything looks good. That's been a huge win for us. On the other side, some of the other projects, I know colleagues have saved probably the same amount, gone from around 20 to 30 hours a month down to five or ten. It's been a significant increase.

Regarding Prophecy's AI capabilities, I think its governance and security are fine. From what I know about what IT is doing with it, it sounds fine too. Being on the more front end of Prophecy, I believe everything looks fine to me.

Regarding Prophecy's AI capabilities and its accuracy and reliability of output, everything looks good so far. From what I've seen, especially with the descriptions of the projects that we work on, it's been pretty spot on with that. I haven't run into any issues with Prophecy AI. I would put it miles above what Copilot does.

I would advise others looking into using Prophecy to schedule a demo. The demo was very eye-opening for me. Once I saw what Prophecy could do, my mind started shooting off ideas. It was amazing to see that one can do it this way, one can do it that way, and that this whole process is now one gem in Prophecy. As you dip your toes into it, keep an open mind and think of what projects you might have. I would think of not how Prophecy can fit into my current project, but rather how my project and what I have in mind can be molded by Prophecy. Once I switched my mindset to that, it was very interesting what we could accomplish. I give this product an overall rating of eight out of ten.

I have been using Prophecy for the last year and a half. My main use case for Prophecy is to perform data transformations in Snowflake. A quick specific example of a data transformation I use Prophecy for is loading data from raw zone tables into the enterprise data warehouse. Regarding my use case, I find it is a great tool that has improved the deployment and development time by 20% when you have the experience and knowledge about how to use the tool.

Prophecy offers many best features, especially now with AI, including many capabilities that have not been available before. The agents help to build models and pipelines, while the documentation of the models is very good. Prophecy agents help me build models and pipelines by providing a very nice tool to expedite things, although we still don't get too much exposure with agents because we're still using models where the agents are not available.

Prophecy has positively impacted my organization by greatly speeding up development time and providing capabilities of using DBT alongside functionalities associated with that, making it a very good tool to avoid coding much and utilize AI with the graphical tools available without needing to code.

There are a few things to improve in Prophecy, such as scheduling the models and jobs; with the introduction of Prophecy Automate, I think that will improve that. I also see that there are some missing options for getting external data, not only from Snowflake but also from Synapse or Azure Blob storage, which would improve outside communication.

I only see incremental improvements over time, and the AI utilization is particularly strong. On a scale of one to ten, I would rate Prophecy an eight because it is a great tool, but there is a question of how it can compete with other tools like Snowflake, DBT, and a few others. Prophecy provides more capabilities, but those products are still quite competitive.

Regarding Prophecy's AI capabilities, I think its governance and security are good. One of the problems with Prophecy's governance and security, especially around its AI features, is that while the connection is a single sign-on which is excellent, there are not too many features applied for governance, making this one of the drawbacks. There are several areas for improvement in Prophecy, particularly with CI/CD functionality and GitHub branching. Currently, the support for CI/CD during transitions from development to production is not optimal, requiring too many steps which is a drawback.

I have been working in my current field for more than 20 years.

Prophecy is pretty stable, but there are often some unexpected issues that arise, especially performance issues or problems with Airflow on deployments. In the past, it wasn't stable at all, and we had to open many tickets to apply changes.

Prophecy's scalability is good, with stability being a key factor as it supports additional models and overall performance.

The customer support for simple requests is very quick; however, for more difficult and challenging issues, it can take a week or two until they are addressed and resolved. I would rate the customer support a nine out of ten.

Before Prophecy, I used Snowflake stored procedures to accomplish what we do now, and switching to Prophecy has reduced the time significantly as developing stored procedures involved much more coding.

My experience with Prophecy's pricing, setup cost, and licensing is that the tool can be expensive, and the licensing adds more to that. We try to add the licensing and increase the number only when we have a real need for it.

I did evaluate the other option, which was DBT Labs, before choosing Prophecy.

I have seen a return on investment mainly in time savings; it takes less time to develop models and the transformation logic.

My experience with Prophecy's pricing, setup cost, and licensing is that the tool can be expensive, and the licensing adds more to that. We try to add the licensing and increase the number only when we have a real need for it.

I did evaluate the other option, which was DBT Labs, before choosing Prophecy.

Every developer saves a significant amount of time, approximately 15-20%, when making developments through Prophecy instead of using the stored procedures on the Snowflake side, which we used before Prophecy utilization, and that is great for the team.

For the accuracy and reliability of Prophecy's AI capabilities, we are not using AI very much. So far, AI looks good, but we need more time to explore. My advice to others looking into using Prophecy is to check if the tool will provide what they need, especially regarding sourcing data from their environment. If they rely on Prophecy local SQL, they should study limitations because they cannot access data from some servers if they are using, for instance, Snowflake. I would rate Prophecy an eight out of ten overall.