AWS Database Blog

Category: Analytics

Use the AWS Database Migration Service to Stream Change Data to Amazon Kinesis Data Streams

In this post, we discuss how you can use AWS Database Migration Service (AWS DMS) to stream change data into Amazon Kinesis Data Streams. An earlier post, Load CDC Data, discussed real-time data processing architecture. As part of that, it covered how to capture changes in an Amazon RDS for Microsoft SQL Server database using AWS […]

Read More

Introducing Amazon Elasticsearch Service as a target in AWS Database Migration Service

We’re excited to announce the addition of a new target in AWS Database Migration Service (AWS DMS)—Amazon Elasticsearch Service. You can now migrate data to Amazon Elasticsearch Service from all AWS DMS–supported sources. With support for this new target, you can use DMS in your data integration pipelines to replicate data in near-real time into […]

Read More

Elasticsearch tutorial: a quick start guide

Elasticsearch has REST API operations for everything—including its indexing capabilities. Besides the REST API, there are AWS SDKs for the most popular development languages. In this guide, we use the REST API so that you can learn about the underlying technology in a language-agnostic way. Indexing is the core of Elasticsearch. It’s what allows you […]

Read More

Monitoring your security with GuardDuty in real time with Amazon Elasticsearch Service

When you use Amazon GuardDuty to help you protect your AWS accounts and workloads, you can enhance your ability to quickly search and visualize a large amount of data. In an enterprise, you might be analysing activity from thousands of accounts. After the analysis, your security team needs to be alerted in order to take […]

Read More

Simplify Amazon DynamoDB data extraction and analysis by using AWS Glue and Amazon Athena

More than 100,000 AWS customers have chosen Amazon DynamoDB for mobile, web, gaming, ad tech, IoT, and many other applications. For example, Duolingo uses DynamoDB to store 31 billion items in tables that reach 24,000 read capacity units per second and 3,300 write capacity units per second. DynamoDB can address a wide variety of applications […]

Read More

In-place version upgrades for Amazon Elasticsearch Service

Today, Amazon Elasticsearch Service (Amazon ES) announces support for in-place Elasticsearch upgrades for domains that are running version 5.1 or later. This new feature lets you move to the latest release in the same major version (for example, 5.3 to 5.6) or from the latest release in a major version to the latest release in […]

Read More

Load CDC data from relational databases to Amazon Kinesis using Database Migration Service

Many large enterprises are moving their data processing from batch to real-time in order to get more timely insights. The challenge of doing so is that a real-time data processing architecture must be able to keep up with the incoming data stream. This requires strong fault tolerance and elasticity. In this blog post, we discuss […]

Read More

Stream changes from Amazon RDS for PostgreSQL using Amazon Kinesis Data Streams and AWS Lambda

In this post, I discuss how to integrate a central Amazon Relational Database Service (Amazon RDS) for PostgreSQL database with other systems by streaming its modifications into Amazon Kinesis Data Streams. An earlier post, Streaming Changes in a Database with Amazon Kinesis, described how to integrate a central RDS for MySQL database with other systems […]

Read More

Get started with Amazon Elasticsearch Service: T-shirt-size your domain

Welcome to this introductory series on Elasticsearch and Amazon Elasticsearch Service (Amazon ES). In this and future blog posts, we provide the basic information that you need to get started with Elasticsearch on AWS. Introduction When you’re spinning up your first Amazon Elasticsearch Service domain, you need to configure the instance types and count, decide […]

Read More

How to perform advanced analytics and build visualizations of your Amazon DynamoDB data by using Amazon Athena

You can reap huge analytical value from billions of items and millions of requests per second in your Amazon DynamoDB service. However, you need to export your data in order to get that analytical value. Copying the data from a DynamoDB table to an analytics platform allows you to extract rich insights. In order to […]

Read More