AWS Open Source Blog

Category: Analytics

Set an Alert in Open Distro for Elasticsearch

中文版 – One of Elasticsearch’s primary use cases is log analytics: you collect logs from your infrastructure, transform each log line into JSON documents, and send those documents to Elasticsearch’s _bulk API. A transformed log line contains many fields, each containing values. For instance, an Apache Web Log line has a source IP address field, […]

Read More
Open Distro for Elasticsearch logo

Add your own SSL certificates to Open Distro for Elasticsearch

中文版 – Open Distro for Elasticsearch’s security plugin comes with authentication and access control out of the box. To make it easy to get started, the binary distributions contain passwords and SSL certificates that let you try out the plugin. Before adding any of your private data, you need to change the default passwords and certificates. […]

Read More
Open Distro for Elasticsearch logo

Build and Run the Open Distro For Elasticsearch SQL Plugin with Elasticsearch OSS

中文版 – Open Distro for Elasticsearch comprises four plugins: Security — supports node-to-node encryption, five types of authentication, role-based access controls, audit logging, and cross-cluster search. Alerting — notifies you when data from one or more Elasticsearch indices meets certain conditions. Performance — This is a REST API that allows you to query a long list […]

Read More
Open Distro for Elasticsearch security plugin Kibana window showing permissions and roles as well as authentication back ends

Change your Admin Passwords in Open Distro for Elasticsearch

中文版 – Open Distro for Elasticsearch ships with an advanced security plugin. The plugin comes pre-configured with a number of different users and default passwords for them – of course, you will want to change those defaults! Passwords for some of the preconfigured users—kibanaro, logstash, readall, and snapshotrestore—are available to change in the Security UI in Kibana. […]

Read More
Open Distro for Elasticsearch kibana login screen

Get Up and Running with Open Distro for Elasticsearch

中文版 – On March 11, 2019, we released Open Distro for Elasticsearch, a value-added distribution of Elasticsearch that is 100% open source (Apache 2.0 license) and supported by AWS. (See also Open Distro for Elasticsearch from Jeff Barr and Keeping Open Source Open – Open Distro for Elasticsearch from Adrian Cockcroft.) In addition to the source […]

Read More
photo by Adrian Cockcroft taken at Petra March 10, 2019.

Keeping Open Source Open – Open Distro for Elasticsearch

中文版 – At AWS, we focus on solving problems for customers. Over the years, customer usage and dependencies on open source technologies have been steadily increasing; this is why we’ve long been committed to open source, and our pace of contributions to open source projects – both our own and others’ – continues to accelerate. […]

Read More
Amazon Kinesis Agent for Microsoft Windows data pipeline

Build More Reliable and Secure Windows Services Using Amazon Kinesis Agent for Microsoft Windows

中文版 We’ve all been there. You’ve deployed a new service on Windows servers. Maybe it’s based on Microsoft technology such as IIS, AD, DHCP, Microsoft Exchange, or SharePoint, or maybe it’s your own service running on Windows. Maybe the servers are on premises, or maybe they’re in the AWS cloud, or possibly you’ve got a […]

Read More
Data Processing Pipeline with Amazon Kinesis Data Streams and Kubeless - diagram

Building a Data Processing Pipeline with Amazon Kinesis Data Streams and Kubeless

If you’re already running Kubernetes, FaaS (Functions as a Service) platforms on Kubernetes can help you leverage your existing investment in EC2 by enabling serverless computing. The real significance of such platforms, however, lies in the number of data sources that can trigger the deployed function. The first part of this two-part series introduced one […]

Read More
SAM - What's next? You!

Open Source News Roundup: April 13, 2018

Open Source News from the AWS Summit San Francisco The AWS Summit in San Francisco on April 4th saw a slew of announcements, including some in open source: SAM Implementation is now open source! “In 2016, we launched SAM and opened up the SAM specification on this Github repo to invite collaborators. We’ve loved your […]

Read More
“leak suspects report” provided by the MAT tool

Open Source Korean Analyzer Support in Amazon Elasticsearch Service

中文版 Need for an improved Korean analyzer in Amazon Elasticsearch Service (AES) Processing content for search in Asian languages such as Chinese, Japanese, and Korean presents unique challenges. Typical processing done by a search engine, such as tokenizing based on whitespaces and stemming to derive root forms, is not sufficient for Asian languages, as many […]

Read More