A Fully-Featured ETL Tool
I have been building out a new data environment for my company and I was having a lot of trouble with the ETL layer - the previous vendor I was using did not allow for anything more complex than "move data from point A to point B on a fixed schedule". It was incredibly limiting and was causing me plenty of issues.
Enter Matillion, a tool that truly allows you fine-tuned control over the entire ETL process from start to finish. Matillion is incredibly flexible in how it allows you to build your ETL jobs. For instance, I have a data generation job in my source database that must complete before I can pick up the data. In my old ETL system, I had to hardcode the schedule based on my best guess as to when the job completion time would be. But within Matillion, I can query the source database to see if the job has completed before running the data extraction portion. This not only makes the data available sooner, it also means that I don't run the risk of missing a data load.
In addition Matillion has integration with AWS functionality, meaning I can use SQS for job triggers and SNS for e-mails about job successes and failures. Matillion also has native integration with Snowflake features, like ALTER WAREHOUSE which we now run on a schedule. Finally, Matillion has become our centralized Python script environment - before Matillion, we were using Windows Task Scheduler which is obviously not ideal.
Lastly, Matillion has excellent support and documentation - most answers to questions I have exist in some documentation online, or if not, their support has never taken more than an hour to get back to me during business hours.
I've had an extremely positive experience with the tool and I cannot recommend it enough!
There are no comments to display