AWS DataSync enhances monitoring capabilities with file-level logging
When using AWS DataSync, you can now enable detailed logging for files and objects copied between your NFS servers, SMB servers, Amazon S3 buckets, Amazon Elastic File System (EFS) file systems, and Amazon FSx for Windows File Server file systems. Logging of individual files enables you to identify what was transferred at a given time, as well as the results of the content integrity verification performed by DataSync. This simplifies monitoring, reporting, and troubleshooting, and enables you to provide timely updates to stakeholders.
When creating or editing a DataSync task, you can specify an Amazon CloudWatch log group, and choose detailed logging. DataSync will log the name, size, and timestamp for each transferred file or object. A second log entry will be published for each file or object when its content is verified against the source storage. The combination of these new CloudWatch Logs, alongside the existing CloudWatch graphs embedded in the DataSync console, and CloudWatch metrics published by DataSync, provides you with end-to-end monitoring of your data transfers, including throughput and file-level transfer status. DataSync also publishes CloudWatch events that you can use to trigger notifications or automate post-processing at the end of your task.
This new logging option is available in all regions where AWS DataSync is available. Charges for CloudWatch Logs apply when you enable logging. You can learn more in the DataSync documentation, or log in to the AWS DataSync console to get started.