AWS Database Blog

Jon Handler

Author: Jon Handler

Jon Handler (@_searchgeek) is a Principal Solutions Architect at Amazon Web Services based in Palo Alto, CA. Jon works closely with the CloudSearch and Elasticsearch teams, providing help and guidance to a broad range of customers who have search workloads that they want to move to the AWS Cloud. Prior to joining AWS, Jon's career as a software developer included four years of coding a large-scale, eCommerce search engine. Jon holds a Bachelor of the Arts from the University of Pennsylvania, and a Master of Science and a Ph. D. in Computer Science and Artificial Intelligence from Northwestern University.

Analyze URL paths to search individual elements in Amazon Elasticsearch Service

If you’re building a data lake in the AWS cloud, you’ll most likely want to have metadata and catalog search capability for the underlying data. We recommend Amazon Elasticsearch Service (Amazon ES) for storing and searching S3 keys, and S3 and object metadata. At minimum, your S3 keys include an object name, but they probably […]

Read More

Run a petabyte scale cluster in Amazon Elasticsearch Service

When you use Amazon Elasticsearch Service (Amazon ES) for log data, you’re drinking from what usually becomes a forceful firehose. As your Elasticsearch and Kibana knowledge deepens, you find many compelling uses of your data. As your customer base scales up and you scale your infrastructure to handle it, you generate even more log data. […]

Read More

Get started with Amazon Elasticsearch Service: T-shirt-size your domain

Welcome to this introductory series on Elasticsearch and Amazon Elasticsearch Service (Amazon ES). In this and future blog posts, we provide the basic information that you need to get started with Elasticsearch on AWS. Introduction When you’re spinning up your first Amazon Elasticsearch Service domain, you need to configure the instance types and count, decide […]

Read More

Get started with Amazon Elasticsearch Service: Use Amazon Cognito for Kibana access control

Welcome to this introductory series on Elasticsearch and Amazon Elasticsearch Service (Amazon ES). In this and future blog posts, we provide the basic information that you need to get started with Elasticsearch on AWS. Introduction On April 2, 2018, we released integration between Amazon Elasticsearch Service and Amazon Cognito. You can now provide and manage […]

Read More

Get started with Amazon Elasticsearch Service: an easy way to send AWS SigV4 signed requests

Welcome to this introductory series on Elasticsearch and Amazon Elasticsearch Service (Amazon ES). In this and future blog posts, we provide the basic information that you need to get started with Elasticsearch on AWS. Introduction If you are using an IAM policy or policies that specify a user or role Amazon Resource Name (ARN) to […]

Read More

Get Started with Amazon Elasticsearch Service: Use Dedicated Master Instances to Improve Cluster Stability

Welcome to this introductory series on Elasticsearch and Amazon Elasticsearch Service (Amazon ES). In this and future articles, we provide the basic information that you need to get started with Elasticsearch on AWS. What dedicated master instances are and why you need them Dedicated master instances perform a single function in an Elasticsearch cluster: orchestration. […]

Read More

Get Started with Amazon Elasticsearch Service: Set CloudWatch Alarms on Key Metrics

Welcome to this introductory series on Elasticsearch and Amazon Elasticsearch Service (Amazon ES). In this and future articles, we provide the basic information that you need to get started with Elasticsearch on AWS. While supporting the many thousands of Amazon Elasticsearch Service (Amazon ES) domains for our customers, our team has amassed significant experience with […]

Read More

Viewing Amazon Elasticsearch Service Slow Logs

Today, Amazon Elasticsearch Service (Amazon ES) announced support for publishing slow logs to Amazon CloudWatch Logs. This new feature enables you to publish Elasticsearch slow logs from your indexing and search operations and gain insights into the performance of those operations. You can enable slow logs to identify whether a performance issue on your cluster […]

Read More

Get Started with Amazon Elasticsearch Service: Filter Aggregations in Kibana

Welcome to this introductory series on Elasticsearch and Amazon Elasticsearch Service (Amazon ES). In this and future articles, we provide the basic information that you need to get started with Elasticsearch on AWS. You figured out how cool Elasticsearch is, and now you’re sending your Apache web logs to Amazon Elasticsearch Service. You pop open […]

Read More

Use Amazon S3 to Store a Single Amazon Elasticsearch Service Index

As detailed in our documentation, you can use the Elasticsearch API actions in Amazon Elasticsearch Service to take manual snapshots of your domain. You can easily back up your entire domain this way. However, did you know you can also snapshot and restore a single index, or multiple indexes? This blog post walks you through […]

Read More