Overview
Visual Flow, powered by Apache Spark is a cloud-native open-source ETL tool based on Apache Spark unified analytics engine with a Graphical User Interface. It combines the best attributes of Kubernetes, Spark, and Argo into a single system with the following features:
Portability, flexibility and multi-cloud compatibility Increased developer productivity High availability, performance and fault tolerance Cost-effective Open-source
Visual Flow provides a Graphical User Interface to create ETL jobs and combine them in Data Processing Pipelines, run/schedule them, and monitor execution. It is a multi-tenant system. You can create multiple projects in a single cluster. Each project is represented as a namespace, which allows allocating resources and providing access to the users in different roles.
Visual Flow does not require a database. It is possible to create all objects as native Kubernetes resources. Our tool leverages Kubernetes authorization to manage users and their roles within a project.
Visual Flow provides the ability to create parameters (e.g., connection info) and reuse them in Jobs.
Why Visual Flow?
Graphical User Interface speeds up learning and jobs development Good monitoring and alerting capabilities out of the box Error Handling out of the box Organizing jobs into Data pipelines Unlimited parallelism Unlimited scalability Easy to customize and extend Easy to test automatically Can be installed on-premise as well as on cloud provider of your choice Can be packaged and provided as SaaS solution on your own Cloud platform
Highlights
- Unique open-source ETL tool with a Graphical User Interface Leverages the best features of Apache Spark, Kubernetes and Argo. Unlimited parallelism and scalability
- Visual Flow landing page https://visual-flow.com/
- Visual Flow on YouTube https://tinyurl.com/VisualFlow-playlistst
Details
Pricing
Vendor refund policy
Open source software is freely available to use and made by the people, for the people.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Deployment into EKS
- Amazon EKS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
1.4.1a (2024-04-10)
minor product description updates
Additional details
Usage instructions
Use provided Helm chart to deploy Visual Flow containers into EKS
Resources
Support
Vendor support
Support options:
Essential support - EU Business hours Advanced support - 24x5 Premium support - 24x7 + Technical Account Manager
Additionally on demand:
Professional Services Architect's consult Initial installation Feature requests
Contact details for pre-purchase support: info@visual-flow.com Contact details for post-purchase support: info@visual-flow.com
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.