StreamSets provides a platform for modern data integration. Build, test, run and maintain data flow pipelines connecting a variety of batch and streaming data sources. Data Collector provides an execution engine to visually build and run continuous data flow pipelines from a wide variety of sources. StreamSets Transformer is an execution engine within the StreamSets DataOps platform that allows any user to create data processing pipelines that execute on Spark. Transformer allows users to easily ingest data into Delta Lake with no code and automatically leverage Databricks to execute and auto-scale Spark workloads.