GlobalLogic offers a trial service with focus on performing data quality & validation of data on AWS cloud based Data Platform.

The Data Quality and Validation Accelerator is a module under GL Data Platform which provides the component library required to perform different validation and quality checks. The components in the library are PySpark code that can be deployed and executed in any Spark environment like AWS Glue.

The accelerator allows the user to provide the required source, sink, transformations and validations on a source & target datasource through a simple YAML based configuration file. This module can help considerably reduce the effort required in developing custom integration and validation solutions.

The free trial includes:

• Setup an AWS Glue environment by following the instructions as documented in the GitHub.
• Running a bunch of pre-defined validation rules across a CSV and Parquet data stored in AWS S3 storage
• Review the validation output for the returned results

The GL Data Quality and Validation accelerator provides a modular and scalable framework that can be deployed on cloud serverless Spark environments to validate a variety of sources. Reach out to us at dpa@globallogic.com on your needs and we would be happy to discuss with you on the next steps.