Sold by: AutoMQ
Deployed on AWS
AutoMQ is the industry's only low-latency, diskless Kafka® running natively on Amazon S3. By completely re-architecting the storage layer for the cloud, AutoMQ solves the critical challenges of legacy Kafka: huge costs, static scalability, and operational burden.
5
Overview
AutoMQ for Kafka, while maintaining 100% compatibility with Apache Kafka, offers users over 50% cost savings and a hundredfold increase in elasticity. It also supports partition reassignment in seconds and auto balancing.
AutoMQ redefines Kafka for the cloud era with a stateless, shared-storage architecture. By offloading storage to S3, it delivers the following key value propositions:
-
100% Kafka Compatible: Not Just the API AutoMQ delivers end-to-end compatibility with Apache Kafka®, from the wire protocol to the ecosystem behavior. This ensures you can seamlessly migrate without lock-in risks, while keeping your existing producers, consumers, and ecosystem tools (like Strimzi, Kafka Connect, and Schema Registry) working perfectly.
-
Low Latency on S3 Despite being diskless, AutoMQ delivers low-latency performance comparable to local disks. Its innovative WAL (Write-Ahead Log) based read/write path preserves the cost and durability benefits of object storage while meeting the strict sub-millisecond latency requirements of critical real-time applications.
-
Zero Interzone Cost Legacy Kafka incurs massive Cross-AZ data transfer fees due to replica synchronization. AutoMQ eliminates this by writing directly to S3 (which is available across AZs). This architecture removes the need for cross-AZ replication traffic, potentially saving thousands of dollars per month on networking fees.
-
Scaling in Seconds With stateless brokers, scaling no longer requires copying data between disks. AutoMQ enables cluster expansion or shrinkage in seconds rather than hours. This allows true on-demand scaling, eliminating the need for over-provisioning and wasted idle resources.
-
Zero Data Skew AutoMQ features a self-developed Self-Balancing mechanism that continuously monitors partitions and automatically reassigns them in seconds. This proactively eliminates hotspots and data skew without manual intervention, significantly reducing operational complexity.
Experience AutoMQ: Interactive Demo: Try our interactive deployment demo here: https://app.arcade.software/share/Gi4OkCY782WG8mDnQkcy
Deployment Guide: If you need to understand the specific deployment steps, please refer to the official documentation: https://www.automq.com/docs/automq-cloud/getting-started/install-byoc-environment/aws/install-automq-on-aws
Highlights
- Saving your Kafka cost: AutoMQ redefines cost efficiency with a cloud-native shared-storage architecture that leverages affordable S3 to replace expensive disks. Our design completely eradicates massive cross-AZ traffic fees and enables rapid elasticity, eliminating the need for wasteful resource over-provisioning. Read on to discover exactly how AutoMQ beats other Kafka solutions on price.
- Scaling in Seconds With stateless brokers, scaling no longer requires copying data between disks. AutoMQ enables cluster expansion or shrinkage in seconds rather than hours. This allows true on-demand scaling, eliminating the need for over-provisioning and wasted idle resources.
- 100% Kafka Compatible: Not Just the API AutoMQ delivers end-to-end compatibility with Apache Kafka®, from the wire protocol to the ecosystem behavior. This ensures you can seamlessly migrate without lock-in risks, while keeping your existing producers, consumers, and ecosystem tools (like Strimzi, Kafka Connect, and Schema Registry) working perfectly.
Details
Sold by
Categories
Delivery method
Delivery option
AutoMQ for Kafka BYOC Deployment
Latest version
Operating system
AmazonLinux 5.10
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
This product is available free of charge. Free subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Vendor refund policy
All fees are non-cancellable and non-refundable except as required by law.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
AutoMQ for Kafka BYOC Deployment
The AutoMQ for Kafka (BYOC Deployment) mainly consists of a WebConsole and several AutoMQ clusters. The WebConsole is deployed in an availability zone and subnet that support public network transmission, providing WebUI services to customers. The WebConsole deploys AutoMQ clusters through the ASG API. Each AutoMQ cluster can be deployed in either one availability zone or three availability zones, depending on the customer's choice. By default, AutoMQ clusters are deployed in private subnets, offering data services only within the VPC. AutoMQ clusters access S3 services and EC2 API services through the S3 Gateway Endpoint.
CloudFormation Template (CFT)
AWS CloudFormation templates are JSON or YAML-formatted text files that simplify provisioning and management on AWS. The templates describe the service or application architecture you want to deploy, and AWS CloudFormation uses those templates to provision and configure the required services (such as Amazon EC2 instances or Amazon RDS DB instances). The deployed application and associated resources are called a "stack."
Version release notes
AutoMQ Cloud BYOC v7.8.10 is now available on AWS Marketplace.
- Kernel updated to version 5.3.3 with several known issues resolved.
Additional details
Usage instructions
Installing AutoMQ: Follow These Steps
-
Check or Create VPC:
- Verify if your existing VPC meets the requirements by referring to the documentation: [Prepare VPC] (https://docs.automq.com/automq-cloud/getting-started/install-byoc-environment/aws/prepare-vpc ).
- Alternatively, create a new VPC using CloudFormation as described in the same documentation.
-
Subscribe and Install AutoMQ for Kafka (BYOC):
- Follow the instructions provided in the documentation to subscribe to and install AutoMQ for Kafka (BYOC) from AWS Marketplace: [Install Environment from Marketplace] (https://docs.automq.com/automq-cloud/getting-started/install-byoc-environment/aws/install-env-from-marketplace ).
-
Experience AutoMQ for Kafka:
- Once the environment is successfully installed, refer to the documentation to start using AutoMQ for Kafka: Experience AutoMQ for Kafka .
-
Delete CloudFormation Stack After POC Testing:
- If you are using AutoMQ for a proof of concept (POC) test, remember to delete the CloudFormation Stack after completing your tests to avoid incurring ongoing cloud resource costs.
Resources
Vendor resources
Support
Vendor support
Please contact us at aws-marketplace@automq.com for more information. Join our slack at AutoMQ Slack Channel.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
The product is only used for purchasing AutoMQ subscriptions and license permits. For installing AutoMQ, please refer to the official deployment documentation: https://www.automq.com/docs/automq-cloud/getting-started/install-byoc-environment/aws/install-automq-on-aws
Redpanda is the event streaming platform that simplifies how you engineer and operate real-time and AI applications. Built for the modern enterprise using open standards, Redpanda delivers a simple, efficient, and safe way to develop streaming, analytics, and agentic AI apps without the operational burden or cost of traditional Kafka systems. It features full Kafka API compatibility, 300+ managed connectors, enterprise-grade security, and fully managed cloud service that's deployable in your own VPC.
Redpanda is the event streaming platform that simplifies how you engineer and operate real-time and AI applications. Built for the modern enterprise using open standards, Redpanda delivers a simple, efficient, and safe way to develop streaming, analytics, and agentic AI apps without the operational burden or cost of traditional Kafka systems. It features full Kafka API compatibility, 300+ managed connectors, enterprise-grade security, and fully managed cloud service.
Customer reviews
kkdev
AutoMQ is a great alternative to Kafka.
Reviewed on Sep 04, 2024
Review from a verified AWS customer
AutoMQ's architecture is quite innovative. It has modified Kafka based on object storage, resulting in lower costs. It also supports fast partition migration and scaling. It's an excellent alternative to Kafka.