Kpow for Apache Kafka (Annual)
Message processing has become cheaper and supports flexible, persistent payment workflows
What is our primary use case?
Kpow for Apache Kafka is used for persistent messages, payment-type messages, processing log-type messages, consuming data in general from different systems, part of an information infrastructure or an information architecture, consuming information from various sources, then storing that information in a database and processing that information. Processing payment messages is a big application, also for integration and storing the messages persistently, and processing them concurrently.
I have used Kpow for Apache Kafka in partition mode where someone else has set it up with message partitions or topic partitions, and I then consume messages from specific partitions; however, I haven't set it up myself in that mode.
I have not used Kpow for Apache Kafka consumer lag insights; I've seen it and heard about it, but I haven't used that so far. I've only used it where the messages are consumed into some other system that does something with the messages.
What is most valuable?
I see benefits from the product in terms of cost; replacing IBM MQ with Kpow for Apache Kafka is much cheaper. Using Kafka instead of something such as IBM MQ is much cheaper, offering scalability and processing messages in parallel, which Kafka helps manage quite a lot, though you can have issues with duplicate processing. Cost-wise and in terms of simplicity in setup versus something such as IBM MQ, that tends to be a bit more complicated to set up.
The product's adaptability is quite important for my organization as that's the central part of how the information from external systems are processed.
What needs improvement?
I think Kpow for Apache Kafka could improve in the area of monitoring; you can change many parts of it, and it can run out of storage if you don't monitor it, which could cause issues. Having the monitoring perhaps on by default would be good, but besides space issues, I don't see anything else that could be improved.
For how long have I used the solution?
I have been working with Kpow for Apache Kafka for around ten years, on and off, as I worked extensively on it about ten years ago and then again in the meantime.
What do I think about the stability of the solution?
I have not used Kpow for Apache Kafka consumer lag insights; I've seen it and heard about it, but I haven't used that so far. I've only used it where the messages are consumed into some other system that does something with the messages.
What do I think about the scalability of the solution?
I can't really assess the product's ability to identify performance bottlenecks in Kafka clusters because I haven't managed the clusters myself too much. I would think it would be similar to how you scale and manage a Kubernetes cluster, launching more pods or scaling out the cluster if the throughput is not high enough.
How are customer service and support?
My thoughts on technical support involve finding a lot of information more from open-source forums and the internet; I think there is a company that does support, specifically Confluent, as a commercial provider for Kafka that could be used for support, but I haven't worked on any support issues. Most of the issues are what people find online regarding managing Kafka.
I would rate the work of support as typically a six or a seven based on open-source information.
How was the initial setup?
The deployment for Kpow for Apache Kafka can take just minutes for local setup; setting it up in a clustered environment might take a couple of hours, but for anyone knowing how to do that, once you know how to set it up in a Kubernetes cluster or just with a Kafka cluster, then that should take minutes.
One person can do it; it should be quite simple for one person to set up.
What's my experience with pricing, setup cost, and licensing?
I am saying that the cloud version is quite expensive, and there's room for improvement since I've set up a test cluster on my own AWS account, and within the first couple of days, it already accumulated a bill close to $200-$300 with no activity on the cluster. If I didn't stop it that month, I would have gotten a bill close to $1,000 and it wasn't doing much.
I am talking about the public cloud, AWS, which is quite expensive even if you don't run much on the topics or so, and so I shut it down there.
I understand it was not purchased through AWS Marketplace; I just set up via the console, a test cluster, you set up a Kafka test cluster as you would set up an instance, and they bill you for that, which turned out to be quite expensive, as many of the latest services on AWS, especially database services also, RDS or so.
Which other solutions did I evaluate?
I have thought of typical alternatives to Kpow for Apache Kafka, including RabbitMQ or IBM MQ depending on whether an organization is using IBM MQ; ActiveMQ is also a popular alternative, and AWS has Kinesis that can be used for streaming of messages.
What other advice do I have?
I did not face any challenges during deployment with Apache SkyWalking; it was quite straightforward. I haven't worked with that.
I have not worked with telemetry tools, and I haven't used those.
The product's adaptability is quite important for my organization as that's the central part of how the information from external systems are processed.
I would rate this product nine out of ten overall.
Which deployment model are you using for this solution?
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Unified monitoring has improved real-time visibility and simplified secure data diagnostics
What is our primary use case?
My main use case for Kpow for Apache Kafka is that it functions as a monitoring tool. It was developed by Factor House and is used to observe, inspect, manage, and grow Kafka clusters. These are the capabilities you can view through a basic UI at an enterprise level where you can see your Apache Kafka infrastructure.
A specific example of how I use Kpow for Apache Kafka to monitor or manage my Kafka clusters includes real-time visibility for healthcare, broken state, consumer logs, under-replicated partitions, and Kafka stream topology. It also supports Prometheus metrics for integration and Grafana data logs. These are the aspects I have checked in terms of observability and monitoring. Apart from that, I also use it for some inspection and debugging.
I generally use Kpow for Apache Kafka to inspect, debug, and automate some processes for security purposes as well. The underlying single UI is also very good. Because of these capabilities, it is very feasible to use.
What is most valuable?
The best features Kpow for Apache Kafka offers that I have checked include a single UI, no extra infrastructure, powerful message search, security and compliance, multi-cluster operations, and operation efficiency. The handling of queues is very critical for my day-to-day work. With Kpow for Apache Kafka, you can monitor your Apache Kafka infrastructure and add some integration. The UI is very good. These are the capabilities that I use day by day.
Kpow for Apache Kafka has positively impacted my organization by being easy to manage. The development capabilities are very good, making it easy to integrate. You can also monitor data diagnostics. These aspects are beneficial to my organization. It makes development faster for this purpose.
What needs improvement?
I believe Kpow for Apache Kafka is already in a pretty good state. However, the default resource allocation is very limited. I would suggest they increase the best resource requirements. The default requires around 2 GB to 8 GB, which is relatively high for a UI tool that could be scaled through one CPU to 2 GB for a single cluster.
I chose the number eight because it has a very good GUI for handling Apache Kafka. However, there are some improvements that should be made. Since it is not a free tool and you have to pay for it, there is no testing possible without paying something. This is not ideal for those who want to try the free version.
There are no other improvements needed for Kpow for Apache Kafka that I haven't mentioned.
For how long have I used the solution?
I have been using Kpow for Apache Kafka for the last eight months since I started using Apache Kafka. I have used Kafka before.
What do I think about the stability of the solution?
Kpow for Apache Kafka is stable.
What do I think about the scalability of the solution?
Kpow for Apache Kafka's scalability is quite good.
How are customer service and support?
I have not received customer support for Kpow for Apache Kafka. However, I believe there is a very good UI available to ask for help with customer support.
Which solution did I use previously and why did I switch?
I did not previously use a different solution.
What's my experience with pricing, setup cost, and licensing?
My experience with pricing, setup cost, and licensing for Kpow for Apache Kafka is that pricing is quite reasonable. However, it should be open source so that everybody can at least use a free trial. Running the enterprise edition requires managing license details, some ID code, and structure signature, which involve administrative setup compared to open source utilities. Because of this, I believe it is both good and challenging in different ways.
Which other solutions did I evaluate?
Before choosing Kpow for Apache Kafka, I did not evaluate other options.
What other advice do I have?
Regarding governance and security features, Kpow for Apache Kafka provides very good capabilities. I have not used all of them extensively, but the features I have used are very good. However, I am not completely sure about all the security features because we have not yet integrated them with our main systems.
Regarding Kpow for Apache Kafka's security capabilities, I would say the security features are quite good. They have included RBAC and multi-tenancy, data masking, audit logging, and SSO integration. These features make the security purpose very adequate for my needs.
The accuracy and reliability of Kpow for Apache Kafka's output is very good.
Kpow for Apache Kafka makes development faster because integration with Kafka can be quite complex and requires significant research and development effort. However, with Kpow for Apache Kafka, you can use a simple integration process to handle all of these aspects. It is very good for easy development.
My advice to others looking into using Kpow for Apache Kafka is that it is a paid tool, so you will need to purchase it. If your infrastructure is very good and there are multiple queues and multiple things to manage, Kpow for Apache Kafka is very effective for handling and maintaining the infrastructure. The UI is very good. These aspects make it a very good tool for this purpose. I would rate this product an eight out of ten.
Which deployment model are you using for this solution?
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
The best choice for managing our Apache Kafka environments
Another plus is the free community edition version to use on the local environments for testing/debugging.
Best choice for startup and middle size companies
- Beautiful UI/UX like Kowl
- Efficient topic message searching like Kafka UI
- Excellent to watch and edit topics configuration, even better than Kafka UI
- Able to browse and edit schema registry efficiently like Kafka UI
And in addition, you got multiple bonus features :
- Useful and beautiful monitoring of cluster, connectors, consumers, etc...
- Better consumer offset reset management
- Fully customizable auth mechanism from very simple to very complex
- Fully integrated Kafka Stream topology display and monitoring using kpow-streams-agent
- Human support with excellent technical understanding
- Open about feature requests that can bring value to the product, with a good following after suggestion is made
- Open-minded about license pricing for a small-sized company
- And so on...
I would love to have managed cloud offer where you give a way to connect to your Kafka Cluster (through VPC Peering for example) and everything is handled on kPow side :
- Create a custom VPC for the customer
- Mount a kPow instance on the VPC
- Create the peering between this VPC managed by kPow and your VPC
- Manage authentication/authorization using kPow online dashboard
Such offer could open great opportunities with, for example, a free community version (run on your own) and a priced cloud managed version.
- Monitor our Kafka brokers' state
- Browse our current topics and their contents
- Follow the state of our consumers and manage their offsets
All these in an easy-to-use HMI without learning how to do it through complex Kafka command lines.
Swiss army knife for Kafka Custodianship
The development team really engage their customers and build new features in colloboration with them. Quick to respond to feedback.
Ops: Can securely access our production cluster, and can make maintenance of topics and the cluster in general far easier.
Wider business: Letting users conduct UAT by placing messages onto topics with a friendly UI
The upcoming visualisations around kafka streams are really awesome and we look forward to adopting those when time.
kPow is the missing link in our operations toolkit for supporting a Kafka powered system.
Topic & broker config inspect.
Consumer group monitoring including offset lag. (can also export their metrics via prometheus!)
The development team are active in the Kafka community and are extremely responsive to feedback on how kPow could be improved. We have benefited from several usbility enhancements & features that were initated on the back of our feedback.