AWS Database Blog

Category: AWS Database Migration Service

Back up an AWS DMS task using the AWS CLI and a JSON processor

In this post, we demonstrate how to use the AWS Command Line Interface (AWS CLI) and jq (a JSON processor) to back up AWS Database Migration Service (AWS DMS) task settings and other artifacts to a file. This backup file could be modified (if required) and reused to setup a new AWS DMS task. One […]

Deploy AWS DMS in a multi-tiered secure network using an Nginx proxy server

This is a guest post by Hemalatha Katari, Solution Architect at Accenture, in partnership with AWS Partner Solutions Architect Rohit Satyanarayana. In this post, we discuss how to use AWS Data Migration Service (AWS DMS) to migrate your database while maintaining strict network segregation and network security requirements. We recently used this solution with a […]

Dynamically modify AWS DMS endpoints for flexible intermittent data migrations to AWS

AWS Database Migration Service (AWS DMS) is a cloud service that makes it easy to migrate relational databases, data warehouses, NoSQL databases, and other types of data stores. You can use AWS DMS to migrate your data to the AWS Cloud or between combinations of cloud and on-premises setups. With AWS DMS, you can perform […]

Build a solution for data migration between on-premises and Amazon Aurora databases hosted in isolated VPCs using AWS DMS

Many customers migrating their on-premises database workloads to the AWS Cloud select AWS Database Migration Service (AWS DMS) as their tool of choice to quickly migrate databases. AWS DMS is a service that supports homogeneous and heterogeneous migrations between different database platforms. Although setup and configuration of AWS DMS is very straightforward, selecting the right […]

AWS named a Leader in new 2020 Gartner Magic Quadrant for Cloud Database Management Systems

Industry analyst firm Gartner has published a new report, the Magic Quadrant for Cloud Database Management Systems, naming AWS as a Leader and placing AWS highest among the 16 vendors evaluated for “Ability to Execute.” We’re proud to be recognized by Gartner as a Leader for several consecutive years in both the database and analytics […]

Streaming data to Amazon Managed Streaming for Apache Kafka using AWS DMS

AWS Database Migration Service (DMS) announced support of Amazon Managed Streaming for Apache Kafka (Amazon MSK) and self-managed Apache Kafka clusters as target. With AWS DMS you can replicate ongoing changes from any DMS supported sources such as Amazon Aurora (MySQL and PostgreSQL-compatible), Oracle, and SQL Server to Amazon Managed Streaming for Apache Kafka (Amazon MSK) and self-managed Apache Kafka clusters.
In this post, we use an e-commerce use case and set up the entire pipeline with the order data being persisted in an Aurora MySQL database. We use AWS DMS to load and replicate this data to Amazon MSK. We then use the data to generate a live graph on our dashboard application.

Rolling back from a migration with AWS DMS

When migrating a database to a new system using AWS Database Migration Service (DMS), it is prudent to have a fallback strategy if the new system doesn’t work as expected. At a high level, there are four basic strategies for rolling back from a migration: basic fallback, fall forward, dual write, and bidirectional replication. Depending […]

Automate AWS CloudFormation template creation for AWS DMS tasks

Expanding on the earlier post, Create AWS CloudFormation templates for AWS DMS tasks using Microsoft Excel, this post highlights an enhanced feature of the same tool that can speed database migration. To demonstrate this feature, we present a small command line tool written in Python. The tool takes a CSV file containing the names of […]

Transform data with AWS DMS version 3.1.3

AWS now supports new data transformation capabilities in the latest AWS Database Migration Service (AWS DMS) version 3.1.3. You can change schema, table, and column names; specify individual tablespace names for Oracle targets; and update a table’s primary and unique key on any target. DMS version 3.1.3 supports the following new data transformation capabilities: Explicit table […]

Scale Amazon OpenSearch Service for AWS Database Migration Service migrations

September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. A common pattern for web application architecture includes a database for application data coupled with a search engine for searching that data. Many relational and even nonrelational databases offer rudimentary search capabilities. However, search engines add true, complex, natural-language search […]