Databricks is used for transformations and streaming data processing. We utilize it primarily for data analytics, including the use of Delta Lake and Delta Life tables for ETL processes, dashboards for analysis, and the Unity catalog for role management.
Databricks Data Intelligence Platform
Databricks, Inc.External reviews
External reviews are not included in the AWS star rating for the product.
The best Data-intelligence platform
Databricks Data Intelligence Platform Review from Zoho
"A Game Changer For DDO"
Transformative data analytics with enhanced AI functionalities and good value for money
What is our primary use case?
How has it helped my organization?
Databricks improves our data analysis tasks with its powerful functionality, offering real-time analytics and machine learning features that help improve model accuracy. It is easy to use, which helps in saving time and, ultimately, costs.
What is most valuable?
The most valuable features of Databricks include the Delta Lake, a user-friendly interface, Delta Life tables for ETL, dashboard features for analysis, and the Unity catalog for role management. It also offers AI functionalities that assist with code management and machine learning processes.
What needs improvement?
While Databricks is generally a robust solution, I have noticed a limitation with debugging in the Delta Live Table, which could be improved. The issue with Delta type tables not loading into multiple places in a single pipeline has been fixed recently.
For how long have I used the solution?
I have been working with Databricks for four years.
How are customer service and support?
We regularly contact Databricks support and are satisfied with their service. I would rate them eight out of ten.
How would you rate customer service and support?
Positive
How was the initial setup?
The initial setup was straightforward after the first week. Deployment processes became quick and efficient using Git.
What's my experience with pricing, setup cost, and licensing?
In terms of cost-effectiveness, Databricks is worth the money.
What other advice do I have?
I'd rate the solution nine out of ten.
Scalability of data bricks helped me a lot in enhancing my work quality
-Cost Management Complexity:
Scaling can lead to unexpected costs if not monitored closely.
- Management Overhead:
Large clusters increase complexity in management and configuration.
- Performance Variability:
Improper configurations may lead to inefficiencies and longer runtimes.
Enhancing data integration and processing across cloud services with seamless transformations
What is our primary use case?
I work in a project where I build data pipelines using Azure Data Factory. I ingest data from on-premises to Azure Data Lake. After that, I perform transformations using Databricks notebooks and Spark, building the Databricks bronze, silver, and gold layers. We export reports from the gold layer.
How has it helped my organization?
Recently, we started using Databricks in our organization. It helps integrate data science and machine learning capabilities.
What is most valuable?
The Unity Catalog is a central governance for all data around the workspaces, and also Databricks' integration capabilities with cloud services like Azure Event Hub and Azure Data Factory. It is user-friendly for data processing, and Spark is a strong language for big data processing.
What needs improvement?
Performance could be improved. It is crucial to check coding, configure Spark correctly, implement caching, and monitor performance metrics to enhance performance.
For how long have I used the solution?
I have used Databricks for over two years.
What do I think about the stability of the solution?
I would rate stability as eight out of ten. It is quite stable.
What do I think about the scalability of the solution?
Databricks is perfect for scalability. It is easy to scale clusters.
How are customer service and support?
I haven't faced any issues requiring customer support, so I don't have experience with their customer support.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
We used Informatica before, which is perfect for data management solutions. We started using Databricks for its capabilities in data science and machine learning.
How was the initial setup?
I would rate the initial setup as nine out of ten. It is quite easy for someone experienced with Spark.
What's my experience with pricing, setup cost, and licensing?
For my company, it's okay to upgrade to Databricks because it's comparable in price to Informatica. It is not considered expensive for the company.
Which other solutions did I evaluate?
For machine learning, I used Python and its libraries manually. Prior to Databricks, there was no special tool used for these purposes.
What other advice do I have?
If a company focuses on data science and machine learning, I recommend using Databricks. It's a great solution in this field. For data management needs, Informatica is advantageous due to its comprehensive tools.
Which deployment model are you using for this solution?
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Ai driven big data and Ml in one place !
Powerful Analytics Platform
Best platform for data engineers !
Unified environment for data engineering, ML and analytics
- using apache spark for efficient processing
- cost is an additional factor
- solving data science business problems
- helps in customer report generation and dashboarding
- building pipelines for ETL