How can I use DataSync to transfer data from an Amazon EFS file system to an Amazon S3 bucket?

Last updated: 2020-12-18

I want to use AWS DataSync to transfer data from Amazon Elastic File System (Amazon EFS) to Amazon Simple Storage Service (Amazon S3). How can I use DataSync to set up this data transfer?

Resolution

Create a DataSync task with the EFS file system as the source location and the S3 bucket as the destination location. Follow these steps:

  1. In the same AWS Region as the EFS file system, deploy a DataSync agent as an Amazon Elastic Compute Cloud (Amazon EC2) instance. The instance type that you select must follow the requirements for deploying DataSync on Amazon EC2.
  2. Activate the DataSync agent.
  3. From the DataSync console navigation pane, choose Tasks.
  4. Choose Create task.
  5. For Configure source location, select Create a new location.
  6. Under Configuration, for Location type, select Network File System (NFS).
  7. For Agents, select the agent that you want to use.
  8. For NFS Server, enter the DNS name or IP address of the EFS file system. By default, DataSync chooses the NFS version that it uses to read from an NFS location. To specify an NFS version that is different from the default selection, include the Version parameter in the NfsMountOptions API operation.
  9. For Mount path, enter the mount path for your EFS file system. By default, DataSync uses the root directory ("/"). The path can include a subdirectory in the EFS file system. DataSync uses the subdirectory to read data from the EFS source or write data to the EFS destination.
  10. Choose Next.
  11. For Destination location options, select Create a new location.
  12. Under Configuration, for Location type, select Amazon S3 bucket.
  13. For S3 bucket, select the bucket that you want to use as an endpoint.
  14. For S3 storage class, choose the storage class to use for the transferred files.
  15. For Folder, you can enter a specific S3 folder or prefix for the data transfer. Or, leave this field blank.
  16. For IAM role, select a role that has permissions to access the S3 bucket. Or, choose Autogenerate to create a new IAM role.
  17. Choose Next.
  18. For Configure settings, configure the task settings for your use case.
  19. Choose Next.
  20. Review the task settings. Then, choose Create task.

After the task status becomes Available, you can start the task to transfer files from the EFS file system to the S3 bucket.


Did this article help?


Do you need billing or technical support?