Matillion One Click Deployment

Matillion is a very powerful tool out of the box and ensuring your organization is getting the most out of it can sometimes be a challenge, especially for those that are new to the cloud or new to Matillion. One of the challenges with ETL tools is that line-of-business leaders may not understand the complexity of acquiring data, bringing it into a data warehouse and making it accessible. It’s an onerous process that can take a company months to achieve. With AllCloud’s Matillion One Click solution, companies can accomplish this goal in a matter of weeks, showing value to the business faster.

What are the solution benefits?

AllCloud’s Matillion One Click Deployment provides key business outcomes:

• Accelerates the time it takes to set up and maintain extract and load data pipelines, allowing analytics teams and power users to get data business-ready even quicker.
• Allows for scaling of not only workloads but also team size as the Git integration and CI/CD process allow teams to work much more seamlessly together than they otherwise would be able to do.
• Provides alerting and failure monitoring to relevant parties if there is ever an instance outage, an issue with a data pipeline, cost irregularities, quality issues, or other errors in a QA or production environment.
• Saves development hours on a consistent basis with readily available infrastructure as code to perform upgrades. Upgrades can save developers up to a week of time, as frequently as once a quarter. This allows data engineers to be data engineers and focus on more value producing activities.
• Extends the ability to future-proof against enhancements to Matillion features such as Unlimited Scale and the underlying AWS infrastructure and services.
• Improves Disaster Recovery (DR) with daily automated snapshots of EC2 and RDS instances, negating any risk of information loss due to instance failure or corruption.

What are the solution components?

AllCloud’s Matillion One Click Deployment consists of 6 main components:

• Initial Deployment and Configuration: The initial creation of all AWS services, Matillion configurations, and Cloud Data Warehouse data structures needed to support the full environment.
• Data Pipeline Setup Process and Quality Checks: Metadata driven pipeline setup to begin loading large numbers of tables faster, paired with components to send alerts whenever failures occur.
• Promotion and Development Automation: Test and promote Matillion components from lower level environments automatically via API calls between Matillion and AWS.
• Job, Server, Cost, and Performance Monitoring: A full set of metrics loaded into your Cloud Data Warehouse automatically and ready to be visualized in your BI tool of choice.
• Upgrades and Maintenance Management: Due to your complete environment being infrastructure as code, any upgrades or maintenance have manual efforts greatly reduced.
• Team Productivity Improvement: With completely isolated developer environments, onboarding new developers and having developers work in parallel becomes seamless.