I am currently working as a Data Engineer at Cognizant. I have been using Control-M for the past eight months since I joined Cognizant as a Data Engineer. As a Data Engineer, my job is to monitor jobs and maintain pipelines, and Control-M is a scheduler tool which we use to schedule jobs by linking the jobs as predecessors and successors so that the flow of the data pipelines continues without human interference.
The daily important task which we are monitoring is the SaleRPT report, which gives business users the sales that happened the previous day in a restaurant at our project in Cognizant. The jobs are connected in such a way that starting, there are replication jobs, and then they are connected to SQL Server to transform the data and load it into Oracle SQL. From there, again, the data is loaded into our data warehouse tables, and the final target tables are Essbase. So this total flow has around 17 to 18 jobs which are scheduled to run twice a day when we get EOD clearance for each site. So these are the latest tasks for which I used Control-M to schedule jobs in a sequential manner.
In our legacy system, there are some Informatica jobs and some SnapLogic jobs. For example, there are three sets of jobs which are from Informatica, and the next successor jobs are from SnapLogic. Control-M allows us to link these Informatica jobs to SnapLogic. If the Informatica job is completed, it would automatically trigger the SnapLogic pipeline. So it allows the usage of multiple tools. For DataOps and DevOps, it is quite important to use Control-M, as it is a scheduler which schedules multiple jobs based on our requirement. We can easily change the schedule for a particular day if we have a lesser number of data. And if there is any data miss, we can also easily reprocess using Control-M by putting a few jobs on hold and running the jobs manually. So I think it is quite extensively important to use Control-M for a Data Engineer at any level.
There are multiple teams which are using Control-M. I think there are nearly 80 to 90 employees who are using Control-M tool in my organization in my current project at Cognizant. Mostly, 60 to 70 percent of them are Data Engineers. Some are from the BI ETL, Business Intelligence ETL team, and some are from the DevOps team, and some are part of the development team also. And some are part of the Aloha Insight team. These are the teams which I know which are currently using Control-M.