AWS Database Blog

Category: AWS Database Migration Service

AWS named a Leader in new 2020 Gartner Magic Quadrant for Cloud Database Management Systems

Industry analyst firm Gartner has published a new report, the Magic Quadrant for Cloud Database Management Systems, naming AWS as a Leader and placing AWS highest among the 16 vendors evaluated for “Ability to Execute.” We’re proud to be recognized by Gartner as a Leader for several consecutive years in both the database and analytics […]

Read More

Streaming data to Amazon Managed Streaming for Apache Kafka using AWS DMS

AWS Database Migration Service (DMS) announced support of Amazon Managed Streaming for Apache Kafka (Amazon MSK) and self-managed Apache Kafka clusters as target. With AWS DMS you can replicate ongoing changes from any DMS supported sources such as Amazon Aurora (MySQL and PostgreSQL-compatible), Oracle, and SQL Server to Amazon Managed Streaming for Apache Kafka (Amazon MSK) and self-managed Apache Kafka clusters.
In this post, we use an e-commerce use case and set up the entire pipeline with the order data being persisted in an Aurora MySQL database. We use AWS DMS to load and replicate this data to Amazon MSK. We then use the data to generate a live graph on our dashboard application.

Read More

Automate AWS CloudFormation template creation for AWS DMS tasks

Expanding on the earlier post, Create AWS CloudFormation templates for AWS DMS tasks using Microsoft Excel, this post highlights an enhanced feature of the same tool that can speed database migration. To demonstrate this feature, we present a small command line tool written in Python. The tool takes a CSV file containing the names of […]

Read More

Transform data with AWS DMS version 3.1.3

AWS now supports new data transformation capabilities in the latest AWS Database Migration Service (AWS DMS) version 3.1.3. You can change schema, table, and column names; specify individual tablespace names for Oracle targets; and update a table’s primary and unique key on any target. DMS version 3.1.3 supports the following new data transformation capabilities: Explicit table […]

Read More

Scale Amazon Elasticsearch Service for AWS Database Migration Service migrations

A common pattern for web application architecture includes a database for application data coupled with a search engine for searching that data. Many relational and even nonrelational databases offer rudimentary search capabilities. However, search engines add true, complex, natural-language search with relevance and Boolean expressions to other database offerings. As Werner Vogels pointed out recently, […]

Read More

Classify OLTP and OLAP workloads using AWS SCT with Workload Qualification Framework (WQF)

Migration is a multiphase process, and different steps are involved based on the type of migration you’re doing. With the help of AWS Schema Conversion Tool (AWS SCT) reports and involvement of partners, you can automate more than 50 percent of the work. However, another large percentage of work still is required. This is where […]

Read More

AWS Database Migration Service improves migration speeds by adding support for parallel full load and new LOB migration mechanisms

We’re happy to introduce AWS DMS replication engine version 3.1.2. The new version includes a better UX and performance improvements that were requested by many customers. We listened and delivered on our promise to make DMS better. In this blog post, I’ll cover few key new features. For the entire list, see the AWS DMS […]

Read More

Introducing Amazon Elasticsearch Service as a target in AWS Database Migration Service

We’re excited to announce the addition of a new target in AWS Database Migration Service (AWS DMS)—Amazon Elasticsearch Service. You can now migrate data to Amazon Elasticsearch Service from all AWS DMS–supported sources. With support for this new target, you can use DMS in your data integration pipelines to replicate data in near-real time into […]

Read More

Best practices for migrating an Oracle database to Amazon RDS PostgreSQL or Amazon Aurora PostgreSQL: Target database considerations for the PostgreSQL environment

An Oracle to PostgreSQL migration in the AWS Cloud can be a complex multistage process with different technologies and skills involved, starting from the assessment stage to the cutover stage. This blog post is the third in a series that discusses high-level aspects about the components to consider for a database migration. The series doesn’t […]

Read More