
Databricks Data Intelligence Platform
Data workflows have become faster and now integrate diverse sources for timely analytics
What is our primary use case?
Databricks was utilized by our team when we needed to undergo a comprehensive change in the data area and structure the architecture. Day to day, I run queries on the database, fetching data and information using SQL, so that in the end we have what the stakeholders asked us for, and then we productize that, pushing it to Looker or a data visualization tool that the company wants or needs.
The whole change of platforms within a company is quite challenging, and when we made the switch to Databricks, the difference was huge.
How has it helped my organization?
Databricks helps the company as a whole integrate data from different sources, automate processes, and make up-to-date information available for analysis.
The reduction of rework is a huge gain, and data refresh now takes one hour or less with Databricks, representing a reduction of almost seventy-five percent or more in time.
What is most valuable?
The best features that Databricks offers are data integration and transformation, running analyses with SQL and Python, processing large volumes of data with Spark, automating pipelines, collaborating in notebooks, and developing AI and Machine Learning solutions with centralized governance and access control.
Pipeline automation in my day-to-day makes things easier by scheduling and running data tasks, like collecting information, transforming datasets, and updating tables, which greatly reduces manual work.
Databricks' Artificial Intelligence features are useful, helping in areas such as assisting with code creation and speeding up queries, and in terms of governance and security, access control and traceability help a lot.
The AI features are useful for gaining productivity, but the reliability of results depends on data quality, so it is very important to review the generated code and validate the results before using them in company decisions.
What needs improvement?
Databricks could be improved with a more intuitive interface, clearer error messages, and practical guidance that also helps a lot when configuring pipelines.
For how long have I used the solution?
I have been using Databricks for three years.
What do I think about the stability of the solution?
Databricks is stable.
What do I think about the scalability of the solution?
Databricks offers very good scalability, allowing you to increase or reduce processing resources according to the volume of data and demand.
How are customer service and support?
I have not had any problems with customer support, as the few times we needed it, it was resolved in a timely manner.
I would rate customer support a nine.
Which solution did I use previously and why did I switch?
Before, I used Snowflake, and we switched mainly due to costs.
What was our ROI?
While I do not have much information, I can see that the data team has improved significantly with Databricks.
What's my experience with pricing, setup cost, and licensing?
I have had a very good experience with pricing, as there was a drop in costs compared to the previous tool.
Which other solutions did I evaluate?
The idea was only Databricks, already due to the partnership.
What other advice do I have?
I would rate Databricks a nine because it makes integration easier and brings agility and productivity; to reach ten, I see room to make the experience more intuitive.
I would advise others to run a trial first and use the tool because it is reliable, good, scalable, works very well, and has many features built in.