AWS Database Blog

Tag: Amazon S3

Effectively migrating LOB data to Amazon S3 from Amazon RDS for Oracle with AWS DMS

In this post, I walk through an effective way to migrate and continuously replicate tables with LOB columns from Amazon RDS for Oracle to Amazon S3 using AWS Database Migration Service (AWS DMS). This service helps you migrate on-premises databases to AWS quickly and securely. In this post, we explore its heterogeneous replication feature.

Best practices for exporting and importing data from Amazon Aurora MySQL to Amazon S3

You can build highly distributed applications using a multitude of purpose-built databases by decoupling complex applications into smaller pieces, which allows you to choose the right database for the right job. Amazon Aurora is the preferred choice for OLTP workloads. Aurora makes it easy to set up, operate, and scale a relational database in the […]

Building data lakes and implementing data retention policies with Amazon RDS snapshot export to Amazon S3

Amazon Relational Database Service (RDS) helps you easily create, operate, and scale a relational database in the cloud. In January 2020, AWS announced the ability to export snapshots from Amazon RDS for MySQL, Amazon RDS for PostgreSQL, Amazon RDS for MariaDB, Amazon Aurora PostgreSQL, and Amazon Aurora MySQL into Amazon S3 in Apache Parquet format. […]

Integrating Amazon RDS for Oracle with Amazon S3 using S3_integration

Amazon RDS for Oracle gives you the full benefits of a managed service solution. You can use the lift-and-shift approach to migrate your legacy Oracle database to Amazon RDS for Oracle and, as a result, reduce the need to refactor and change existing application components. Data warehouse (DW) extraction is an integral part of most […]

Replicate data from Amazon Aurora to Amazon S3 with AWS Database Migration Service

In this blog post, I’ll cover how to use an AWS CloudFormation template to automate the configuration that allows you to replicate data between a relational database like Amazon Aurora to Amazon Simple Storage Service (Amazon S3). I’ll walk you through a sample CloudFormation template so that you can customize for your needs. The AWS […]

Introducing Amazon S3 and Microsoft Azure SQL Database Connectors in AWS Database Migration Service

We are excited to announce the addition of two new database connectors in AWS Database Migration Service (AWS DMS)—Amazon S3 as a source and Microsoft Azure SQL Database as a source. You can now migrate data from these two new sources to all AWS DMS supported targets. Amazon S3 as a source You can now […]

Reading Amazon S3 Data from Oracle on Amazon EC2

When you’re working with AWS services, Amazon S3 is the first choice to store text data files. In the past, to access S3 data, first you’d download the files and then perform extract, transform, and load (ETL) to load the data into Oracle. This approach has two drawbacks. It takes time to download and perform […]

Use Amazon S3 to Store a Single Amazon Elasticsearch Service Index

September 8, 2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. As detailed in our documentation, you can use the Elasticsearch API actions in Amazon Elasticsearch Service to take manual snapshots of your domain. You can easily back up your entire domain this way. However, did you know you can also […]

Using the AWS Database Migration Service, Amazon S3, and AWS Lambda for Database Analytics

Jeff Levine is a solutions architect for Amazon Web Services. The AWS Database Migration Service (AWS DMS) supports Amazon S3 as a migration target. The services enable you to extract information from any database supported by DMS and write it to Amazon S3 in a format that can be used by almost any application. You can extract the entire […]

Automatically Archive Items to S3 Using DynamoDB Time to Live (TTL) with AWS Lambda and Amazon Kinesis Firehose

February 9, 2024: Amazon Kinesis Data Firehose has been renamed to Amazon Data Firehose. Read the AWS What’s New post to learn more. Adam Wagner is a solutions architect at Amazon Web Services. Earlier this year, Amazon DynamoDB released Time to Live (TTL) functionality, which automatically deletes expired items from your tables, at no additional […]