Lenses Stream Reactor: S3 Source & Sink Kafka Connectors
By:
Lenses
An Apache Kafka Connect plugin for Amazon S3. As both a source and sink, it holds powerful enterprise features to support many data integration use cases including backup/restore of Kafka topics, data replication across Kafka clusters, sourcing multi-line events/XML and hydrating a data warehouse with optimized object partitioning. It works on any Kafka Connect cluster including AWS MSK Connect. The plugin is licensed under Apache 2.0, open source and available with optional enterprise support via a subscription with Lenses.io.
Overview
An enterprise-grade Apache Kafka Connect Source & Sink plugin for Amazon S3 designed to support critical business flows.
The connectors hold powerful enterprise features.
For sourcing: Collecting unstructured data including multi-line events & XML Task parallelization for optimal throughput Dynamic S3 partition discovery
For sinking: Support for writing to AVRO, Parquet, JSON, Bytes and Text Full object export (key, value, metadata and headers) Object partitioning by key, value, headers and time window Exactly-once semantics Hive-style (eg. key=value) object partitioning
This widely used connector integrates Kafka and S3 to support a number of use cases including hydrating a lakehouse, cost-efficient Kafka topic backup/restore, and data replication to another Kafka cluster.
It can be deployed as a standalone plugin for any Apache Kafka Connect cluster (including MSK Connect) or deployed via Lenses for a simplified single click management with role-based security, auditing, monitoring, and governance.
The plugin is licensed under Apache 2.0, open-source and available with enterprise support from Lenses.io.
Contact info@lenses.io for details about enterprise support offerings.
| Sold by | Lenses |
| Categories | |
| Fulfillment method | Professional Services |
Pricing Information
This service is priced based on the scope of your request. Please contact seller for pricing details.
Support
The Connector is open source under an Apache 2.0 license.
Full enterprise support is offered for subscribed Lenses.io customers (see SLAs). See full product description. Contact info@lenses.io for information on enterprise support offerings.
Engage with the Lenses community via the Community Slack or ask technical questions via Ask Marios.