Category: Analytics

Pubali Sen and Shankar Ramachandran are solutions architects at Amazon Web Services. In 2016, AWS introduced the EKK stack (Amazon Elasticsearch Service, Amazon Kinesis, and Kibana, an open source plugin from Elastic) as an alternative to ELK (Amazon Elasticsearch Service, the open source tool Logstash, and Kibana) for ingesting and visualizing Apache logs. One of the […]

We have many customers who own and operate Elasticsearch, Logstash, and Kibana (ELK) stacks to load and visualize Apache web logs, among other log types. Amazon Elasticsearch Service provides Elasticsearch and Kibana in the AWS Cloud in a way that’s easy to set up and operate. Amazon Kinesis Firehose provides reliable, serverless delivery of Apache […]

Darin Briskman (@briskmad) is a technical evangelist at Amazon Web Services. So you’re working with Amazon Elasticsearch Service and you’re setting up a non-production domain, using it for a development, sandbox, test, or staging environment. (If you’re new to Elasticsearch, a domain is similar to what’s called a cluster for other computing systems. It’s a […]

James Huang is an enterprise solutions architect at Amazon Web Services. AWS recently announced support for Elasticsearch 5.1. The announcement mentioned a few important improvements in the open source software and in Amazon Elasticsearch Service (Amazon ES), the managed service.  Elasticsearch 5.1 includes three important changes: a new scripting language called Painless, significant improvements to […]

Welcome to this introductory series on Elasticsearch and Amazon Elasticsearch Service (Amazon ES). In this and future articles, we provide the basic information that you need to get started with Elasticsearch on AWS. How many shards? Elasticsearch can take in large amounts of data, split it into smaller units, called shards, and distribute those shards […]

Securing your Amazon Elasticsearch Service (Amazon ES) domain helps ensure your data cannot be accessed or altered by unauthorized users. Most customers want the security of IP address- or identity-based access policies, but choose open access out of convenience. Because a domain with open access will accept requests to create, view, modify, and delete data […]

Emmanuel Espina is a software development engineer at Amazon Web Services. In this blog post, I will discuss how to integrate a central relational database with other systems by streaming its modifications through Amazon Kinesis. The following diagram shows a common architectural design in distributed systems. It includes a central storage referred to as a […]

Welcome to the first in a series of blog posts about Elasticsearch and Amazon Elasticsearch Service, where we will provide the information you need to get started with Elasticsearch on AWS. How many instances will you need? When you create an Amazon Elasticsearch Service domain, this is one of the first questions to answer.

Amit Sharma (@amitksh44) is a solutions architect at Amazon Web Services. You can use Amazon S3 to implement a data lake architecture as the single source of truth for all your data. Taking this approach not only allows you to reliably store massive amounts of data but also enables you to ingest the data at […]