AWS Database Blog

Category: Amazon Simple Storage Service (S3)

Automate Amazon RDS backups using the Oracle RMAN utility and upload backup files to Amazon S3

Amazon Relational Database Service (Amazon RDS) for Oracle creates automated snapshots and allows creation of user-initiated manual snapshots in a Region. In addition, Amazon RDS for Oracle supports Oracle native backup tools like Oracle Recovery Manager (RMAN) and Oracle Data Pump. Many organizations spend considerable time and resources to manage and maintain database backups to […]

Capture key source table headers data using AWS DMS and use it for Amazon S3 data lake operations

Migrating the raw data from source systems into a central repository is usually the first step in establishing a data lake. Many systems store source data in relational database tables, therefore a mechanism is required to ingest this data in the data lake and also get some relevant metadata about these tables so that data […]

How Liberty Mutual built a highly scalable and cost-effective document management solution

With more than 45,000 employees in 29 countries, Liberty Mutual is the sixth largest global property and casualty insurer, and currently ranks 71st on the Fortune 100 list of largest corporations in the US. The expectations of customers continue to increase as the pace of change accelerates, the nature and magnitude of risk change, and […]

Verify delivery conditions with the Accord Project and Amazon Quantum Ledger Database – Part 2

This is part two of the two-part series of blog posts discussing how to apply smart legal contracts technology to verify delivery conditions with open-source Accord Project and Amazon Quantum Ledger Database service. In the first part we introduced the smart legal contract technology, a sample delivery process, and reviewed the solution to run smart legal contracts on AWS with Accord Project. […]

Verify delivery conditions with the Accord Project and Amazon Quantum Ledger Database – Part 1

Smart legal contracts are an emerging technology in the legal tech domain. Their main goal is to make the verification of terms and conditions in legal contracts more efficient. Unlike smart contracts, which are self-running programs in distributed ledger databases (usually in blockchain-based systems), smart legal contracts represent an entire legal contract. They combine a […]

Use Amazon ElastiCache for Redis as a near-real-time feature store

Customers often use Amazon ElastiCache for real-time transactional and analytical use cases. It provides high throughout and low latencies, while meeting a variety of business needs. Because it uses in-memory data structures, typical use cases include database and session caching, as well as leaderboards, gaming and financial trading platforms, social media, and sharing economy apps. […]

Migrate an application from using GridFS to using Amazon S3 and Amazon DocumentDB (with MongoDB compatibility)

In many database applications there arises a need to store large objects, such as files, along with application data. A common approach is to store these files inside the database itself, despite the fact that a database isn’t the architecturally best choice for storing large objects. Primarily, because file system APIs are relatively basic (such […]

Export and import data from Amazon S3 to Amazon Aurora PostgreSQL

You can build highly distributed applications using a multitude of purpose-built databases by decoupling complex applications into smaller pieces, which allows you to choose the right database for the right job. Amazon Aurora is the preferred choice for OLTP workloads. Aurora makes it easy to set up, operate, and scale a relational database in the […]

Export and analyze Amazon DynamoDB data in an Amazon S3 data lake in Apache Parquet format

January 2023: Please refer to Accelerate Amazon DynamoDB data access in AWS Glue jobs using the new AWS Glue DynamoDB Export connector  for more recent updates on using Amazon Glue to extract data from Amazon DynamoDB. Amazon DynamoDB is a key-value and document database that delivers single-digit millisecond performance at any scale. It’s a fully […]

Building data lakes and implementing data retention policies with Amazon RDS snapshot export to Amazon S3

Amazon Relational Database Service (RDS) helps you easily create, operate, and scale a relational database in the cloud. In January 2020, AWS announced the ability to export snapshots from Amazon RDS for MySQL, Amazon RDS for PostgreSQL, Amazon RDS for MariaDB, Amazon Aurora PostgreSQL, and Amazon Aurora MySQL into Amazon S3 in Apache Parquet format. […]