AWS Storage Blog

Tag: AWS DataSync

AWS DataSync Featured Image 2020

Replicate objects Using AWS DataSync with Amazon S3 compatible storage on Snowball Edge

Users have successfully leveraged Amazon Web Services (AWS) Snow Family to transfer petabytes of data between on premises and AWS Regions since its launch in 2015 with the AWS Snowball device. Increasingly, users are not just migrating data with the AWS Snow Family but now are using AWS Snowball Edge Compute Optimized devices to host […]

AWS DataSync Featured Image 2020

Migrating Oracle Cloud Infrastructure Object Storage to Amazon S3 using AWS DataSync

Users face challenges in their digital transformation journey involving the migration of data across various platforms, on-premises file systems, and other cloud services. When using other cloud providers, scenarios arise where the seamless transfer of data becomes essential. Whether executing a one-time data transfer or integrating it into a scheduled workflow, minimizing business downtime is […]

AWS DataSync Featured Image 2020

Implementing AWS DataSync with hundreds of millions of objects

Moving large volumes of data across your hybrid cloud environments can seem like a daunting task, especially when dealing with a litany of requirements that arise when working within the technical limits of network, storage, compute, and operating system layers, both on-premises and in the cloud. Users face additional challenges when balancing their Recovery Time […]

AWS DataSync Featured Image 2020

Automate data synchronization between AWS Outposts racks and Amazon S3 with AWS DataSync

Many organizations generate large quantities of data locally, including digital imagery, sensor data, and more. Customers require local compute and storage to ingest and enable real-time predications based on their data, and often preprocess this data locally before transferring to the cloud to unlock additional business value such analysis, reporting, and archiving. Automating transfers to […]

AWS DataSync Featured Image 2020

Migrating Wasabi Object Storage to Amazon S3 using AWS DataSync

Many organizations find themselves faced with the task of transferring a substantial amount of object data between cloud service providers, there are various scenarios behind such transfers. These scenarios include data consolidation, workload migration, acquisition, and cost optimization efforts. Achieving a successful migration involves several crucial components, including comprehensive data encryption during transfer, the ability […]

AWS DataSync Featured Image 2020

Transferring data from Google Cloud Filestore to Amazon EFS using AWS DataSync

Organizations may need to transfer large numbers of files from one cloud provider to another for a variety of reasons like workload migration, disaster recovery, or a requirement to process data in other clouds. Data transfers typically require end-to-end encryption, the ability to detect changes, object validation, network throttling, monitoring, and cost optimization. Building a […]

AWS DataSync Featured Image 2020

Derive insights from AWS DataSync task reports using AWS Glue, Amazon Athena, and Amazon QuickSight

Update (9/22/2023): Step 6b updated to automatically detect and update the Amazon Athena table schema when crawler detects large data transfer values reported in bytes that would consume the table’s maximum integer value while storing data. As customers scale their migration of large datasets with millions of files across multiple data transfers, they are faced […]

AWS DataSync Featured Image 2020

Migrating DigitalOcean Spaces to Amazon S3 using AWS DataSync

Organizations may at times have to transfer large amounts of object data from one cloud service provider to another. There can be several reasons for this, including data consolidation, moving workloads, disaster recovery planning, or cost optimization efforts. Completing a successful migration requires several key elements, including full encryption of the data being transferred, the […]

AWS DataSync Featured Image 2020

Simplify multicloud data movement wherever data is stored with AWS DataSync

At AWS, we believe that customers get the best experience, performance, and cost when they choose to run their IT operations in the cloud. However, for a variety of reasons, some customers end up in a situation where they’re running their IT operations in a multicloud environment. For example, a customer might have acquired a […]

AWS DataSync Featured Image 2020

Migrate on-premises data to AWS for insightful visualizations

When migrating data from on premises, customers seek a data store that is scalable, durable, and cost effective. Equally as important, BI must support modern, interactive, and fast dashboards that can scale to tens of thousands of users seamlessly while providing the ability to create meaningful data visualizations for analysis. Visualization of on-premises business analytics […]