Overview
SparkPipe is a cutting-edge connectivity solution designed for IIoT and DataOps. It is compatible with any Sparkplug-enabled client and seamlessly bridges operational data at the edge with advanced data processing in the cloud. This service integrates operational data into various data-driven applications, such as stream processing, advanced analytics, machine learning, and predictive maintenance. By leveraging open protocols and standardized data models, SparkPipe ensures the efficient and effective use of data from industrial assets and systems.
SparkPipe is a cloud-native service that utilizes the MQTT Sparkplug specification to securely connect to any MQTT 3.1 compatible broker, capturing all the events published by any Sparkplug-enabled edge node, and routing this data to cloud-based services and applications.
Designed to be highly reliable, secure by default, easy to configure and simple to operate, SparkPipe integrates natively with AWS deployment systems, security features, and access mechanisms.
SparkPipe empowers you to transform your raw OT data into actionable insights, driving operational efficiency and unlocking the full potential of your Industrial IoT and DataOps initiatives.
Connectors:
-
Kafka: Simplifies the use of Kafka for IIoT by integrating MQTT Sparkplug messages into the Kafka messaging flow. It publishes all events to Kafka clusters, such as Amazon MSK or Confluent Cloud, using an easy-to-parse JSON representation of the Sparkplug payload. It supports various authentication methods including SASL/PLAIN, SASL/SCRAM, mTLS, and AWS IAM. Additionally, it offers data compression to reduce bandwidth and disk usage, and topic partitioning to scale throughput.
-
Stdout: Provided for testing purposes, it logs the Sparkplug metrics to the console standard output using an easy-to-read JSON format that represents the Sparkplug payload.
Highlights
- Plug-and-Play Solution: Utilizes the widely adopted MQTT Sparkplug open standard to ensure swift and seamless connectivity between your OT data and cloud services without complex ETL and data transformation processes. SparkPipe eliminates the need for custom coding by automatically converting raw data from industrial assets into a format that cloud platforms can understand.
- Easily set up no-code, zero-ETL, low-latency and cost-effective data ingestion and stream processing pipelines in the cloud.
- Highly Reliable and Secure: Sparkpipe is delivered in a hardened AMI, it runs in a highly restricted execution environment to ensure maximum security and reliability.
Details
Typical total price
$0.988/hour
Pricing
Free trial
Instance type | Product cost/hour | EC2 cost/hour | Total/hour |
---|---|---|---|
m6g.medium Recommended | $0.95 | $0.038 | $0.988 |
m6g.large | $1.05 | $0.077 | $1.127 |
m6g.xlarge | $1.15 | $0.154 | $1.304 |
m6g.2xlarge | $1.25 | $0.308 | $1.558 |
Additional AWS infrastructure costs
Type | Cost |
---|---|
EBS General Purpose SSD (gp3) volumes | $0.08/per GB/month of provisioned storage |
Vendor refund policy
We do not currently support refunds. The instance can be terminated at anytime to stop incurring charges.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (Arm) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Kafka Connector
- Added a configuration option to select the desired JSON format (simple, original).
Additional details
Usage instructions
See our step-by-step deployment guide at https://docs.n3uron.com/docs/sparkpipe-deployment
Resources
Vendor resources
Support
Vendor support
If you have any questions, please contact our Support Team at support@n3uron.com or visit our support portal
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.