Category: Analytics

Machine-generated data powers solutions and causes problems. It’s indispensable for identifying operational issues in today’s modern software applications, yet you need flexible, scalable tools like Amazon Elasticsearch Service to analyze it in real time. This log data is so valuable that you don’t want to remove it from hot storage, but there’s so much of […]

As applications evolve to be more scalable for the web, customers are adopting flexible data structures and database engines for their use cases. Using NoSQL data stores has become increasing popular because of NoSQL’s flexible data model for building modern applications. Amazon DynamoDB is a fast and flexible NoSQL database service that can provide consistent […]

If you’re building a data lake in the AWS cloud, you’ll most likely want to have metadata and catalog search capability for the underlying data. We recommend Amazon Elasticsearch Service (Amazon ES) for storing and searching S3 keys, and S3 and object metadata. At minimum, your S3 keys include an object name, but they probably […]

A common pattern for web application architecture includes a database for application data coupled with a search engine for searching that data. Many relational and even nonrelational databases offer rudimentary search capabilities. However, search engines add true, complex, natural-language search with relevance and Boolean expressions to other database offerings. As Werner Vogels pointed out recently, […]

When you use Amazon Elasticsearch Service (Amazon ES) for log data, you’re drinking from what usually becomes a forceful firehose. As your Elasticsearch and Kibana knowledge deepens, you find many compelling uses of your data. As your customer base scales up and you scale your infrastructure to handle it, you generate even more log data. […]

Today, Amazon Elasticsearch Service (Amazon ES) announced support for deploying your domains across three Availability Zones (AZ). This feature is available in all AWS Regions that support at least three Availability Zones. With this new feature, you can spread out your master and data nodes to gain better tolerance for Availability Zone failures. Additionally, the AWS Management […]

The following 10 posts were the most viewed AWS Database Blog posts that we published during 2018. You can use this list as a guide to catch up on your Database Blog reading, or read a post again that you found particularly useful. Query your AWS database from your serverless application How the AWS Schema […]

Let’s assume that you work for an ecommerce company and you want to provide the best user experience to your customers. A customer could land on a product page by coming from a recommendation on another page in your application or from a search engine. Whatever the route, you want to ensure that your customers […]

In this post, we discuss how you can use AWS Database Migration Service (AWS DMS) to stream change data into Amazon Kinesis Data Streams. An earlier post, Load CDC Data, discussed real-time data processing architecture. As part of that, it covered how to capture changes in an Amazon RDS for Microsoft SQL Server database using AWS […]

We’re excited to announce the addition of a new target in AWS Database Migration Service (AWS DMS)—Amazon Elasticsearch Service. You can now migrate data to Amazon Elasticsearch Service from all AWS DMS–supported sources. With support for this new target, you can use DMS in your data integration pipelines to replicate data in near-real time into […]