Databricks as a Product
What do you like best about the product?
I have been using Databricks service on Azure platform from the past 3.5 years and have liked the product features and its updates that are rolled out frequently. The updates are also documented well with complete details on the Documentation page.
What do you dislike about the product?
There are few features in Databricks service which will not be available to the users directly. We will have to reach out to the Product team to get this enabled.
What problems is the product solving and how is that benefiting you?
With using Databricks and the workflows feature, we can create pipelines in the workspace itself and with UC catalogs, it is much easier to access the storage account to load the data.
Single Source for my Data Engineering work
What do you like best about the product?
I am excited about the Data Intelligence platform where everything can be accessed at fingertips with ease of integration and there is no need to spent lot of time on integrations, ease of use with multiple technologies and data sources.
with data Intelligence platform databricks made data pipelines and ETL process easier implementation than ever, now pipelines became more simpiler can build pipelines quick and easy.
with Data Intelligence platform delivery of project improved with frequency of pipeline builds increased.
Now its been easier to trobulshoot pipelines and spark jobs, which reduces heavy load team and customer support
What do you dislike about the product?
I don't see some downsides at the moment but I would like to more data source integrations to data intelligence platform.
What problems is the product solving and how is that benefiting you?
Our teams are now able to utilize full potential of Databricks from analysts to Data Engineer in their daily activities. where Data Intelligence platform made data analyst work easier with integrating with AI assitance by data semantics to build queries.
Helps users with data processing and analytics
What is our primary use case?
I use Databricks to manage the setting up of data lakes for SaaS.
What needs improvement?
The biggest problem associated with the product is that it is quite pricey. We cannot find a better solution than Databricks in the market currently.
For how long have I used the solution?
I have been using Databricks for a year.
What's my experience with pricing, setup cost, and licensing?
It is an expensive tool. The licensing model is a pay-as-you-go one.
What other advice do I have?
The tool helps with data processing and analytics with large-scale data or big data since it is associated with managing data at a large scale.
For my general use cases, I would say that I am not a technical person, so I cannot explain to you how the tool helps with the area of data engineering tasks.
There is another team in my company that is involved in the use of machine learning and AI features in Databricks. My team is mostly into operations. The tool is used in a multi-country project.
For example, in my company, they make some shopping decisions related to solutions based on what is the product chosen by the whole company.
I rate the tool an eight out of ten.
Feature-Rich, Reliable, but Browser Coding Needs Improvement
What do you like best about the product?
I use Databricks for Data Engineering and Data Science, and it gives me access to data and powerful compute to answer analysis quickly and build pipelines for continuous tracking. I like that Databricks is always improving and it's a feature-packed enriched platform. It helps lower my time to insight, and I never worry about lagging or doubting that the tools I need to succeed aren't available.
What do you dislike about the product?
Coding in a web browser is difficult, slow, lags, and it's a memory hog.
What problems is the product solving and how is that benefiting you?
I use Databricks to access data effortlessly and utilize powerful compute for quick analysis and pipeline building, which lowers my time to insight without doubting tool availability.
Manager Data Science
What do you like best about the product?
Unified platform with lots of capabilities, open source based. No vendor locked.
What do you dislike about the product?
Appears to have a learning curve. Not now-no code environment on par with PowerBI.
What problems is the product solving and how is that benefiting you?
Able to manage large-scale data and easily upkeep the pipelines for it.
Slice through billions of records like butter
What do you like best about the product?
As a data scientist I'm able to analyze billions of records from my web browser without having to worry about memory or CPU limitations on my laptop.
What do you dislike about the product?
There are a lot of ways to configure the platform which can be intimidating for new users.
What problems is the product solving and how is that benefiting you?
Enable analysis of large datasets that was not possible with legacy tools.
Recommend Databricks as the Data Platform for Most use cases
What do you like best about the product?
Ease of Implementation, Prompt Customer Support, Ease of Use
What do you dislike about the product?
Too much focus on exciting user to ramp up DBUs (Cost), Over communicating capabilities even as they are not matured enough
What problems is the product solving and how is that benefiting you?
Capability to bring diverse data together, and capability to process same at scale
It provides unified solutions for end-to-end Data Science project.
What do you like best about the product?
Data processing, scheduling and management, in particular ETL. Big data democratization and collaboration opportunities, the Databricks team aims to make big data analytics easier for enterprises.
What do you dislike about the product?
File management on DBFS can be improved.
Visualization in MLFLOW experiment can be enhanced.
What problems is the product solving and how is that benefiting you?
By providing unified intelligence Data Platform to handle messy, siloed and slow data.
"Unlocking Data Potential: A Comprehensive Review of Databricks"
What do you like best about the product?
Interactive user interface.
A powerful tool that contains Computer power, integration with different sources of data, integrated Machine Learning, and collaboration with team using the workspace.
Provide workflow and Delta live Table pipeline which makes this fantastic.
What do you dislike about the product?
I am not able to migrate Dlt pipelines from the dev workspace to the prod workspace using Azure DevOps, if there is any way please let me know.
What problems is the product solving and how is that benefiting you?
it provides workspace, notebook, Apache spark, Delta Lake, and Scalability which processes large amounts of data easily.
It has a centralized environment by which team can work collaboratively.
Its integration power can integrate with ADF, SYNAPSE and Data warehouse easily.
Cloud resources limit 11
Hi Databricks team
I want to increase AWS Databricks Cloud resources limit. We have limit Cloud resources 11 and VPC limit 5.
Databricks Plan Premium.
1. Storage configuration
2. Credential configuration.
Kindly share the process to increase.
If anything, you need from my side please let me know.