AWS Open Source Blog

Open Distro for Elasticsearch 1.1.0 released

We are happy to announce that Open Distro for Elasticsearch 1.1.0 is now available for download!

Version 1.1.0 includes the upstream open source versions of Elasticsearch 7.1.1, Kibana 7.1.1, and the latest updates for alerting, SQL, security, performance analyzer, and Kibana plugins, as well as the SQL JDBC driver. You can find details on enhancements, bug fixes, and more in the release notes for each plugin in their respective GitHub repositories. See Open Distro’s version history table for previous releases.

Download the latest packages

You can find Docker Hub images Open Distro for Elasticsearch 1.1.0 and Open Distro for Elasticsearch Kibana 1.1.0 on Docker Hub. Make sure your compose file specifies 1.1.0 or uses the latest tag. See our documentation on how to install Open Distro for Elasticsearch with RPMs and install Open Distro for Elasticsearch with Debian packages. You can find our Open Distro for Elasticsearch’s Security plugin artifacts on Maven Central.

We have updated our tools as well! You can download Open Distro for Elasticsearch’s PerfTop client, and Open Distro for Elasticsearch’s SQL JDBC driver.

For more detail, see our release notes for Open Distro for Elasticsearch 1.1.0.

New features in development

We’re also excited to pre-announce new plugins in development. We’ve made available pre-release alpha versions of these plugin artifacts for developers (see below for links) to integrate into their applications. We invite you to join in to submit issues and PRs on features, bugs, and tests you need or build.

k-NN Search

Open Distro for Elasticsearch’s k-nearest neighbor (k-NN) search plugin will enable high-scale, low-latency nearest neighbor search on billions of documents across thousands of dimensions with the same ease as running any regular Elasticsearch query. The k-NN plugin relies on the Non-Metric Space Library (NMSLIB). It will power use cases such as recommendations, fraud detection, and related document search. We are extending the Apache Lucene codec to introduce a new file format to store vector data. k-NN search uses the standard Elasticsearch mapping and query syntax: to designate a field as a k-NN vector you simply map it to the new k-NN field type provided by the k-NN plugin.

Index management

Open Distro for Elasticsearch Index Management will enable you to run periodic operations on your indexes, eliminating the need to build and manage external systems for these tasks. You will define custom policies to optimize and move indexes, applied based on wildcard index patterns. Policies are finite-state automata. Policies define states and transitions (Actions). The first release of Index Management will support force merge, delete, rollover, snapshot, replica_count, close/open, read_only/read_write actions, and more. Index Management will be configurable via REST or the associated Kibana plugin. We’ve made artifacts of the alpha version of Open Distro for Elasticsearch Index Management and Open Distro for Elasticsearch Kibana Index Management available on GitHub.

Job scheduler

Open Distro for Elasticsearch’s Job Scheduler plugin is a library that enables you to build plugins that can run periodic jobs on your cluster. You can use Job Scheduler for a variety of use cases, from taking snapshots once per hour, to deleting indexes more than 90 days old, to providing scheduled reports. Read our announcement page for Open Distro for Elasticsearch Job Scheduler for more details.

SQL Kibana UI

Open Distro for Elasticsearch’s Kibana UI for SQL will make it easier for you to run SQL queries and explore your data. This plugin will support SQL syntax highlighting and output results in the familiar tabular format. The SQL Kibana UI will support nested documents, allowing you to expand columns with these documents and drill down into the nested data. You will also be able to translate your SQL query to Elasticsearch query DSL with a single click and download results of the query as a CSV file.

Questions?

Please feel free to ask questions on the Open Distro for Elasticsearch community discussion forum.

Report a bug or request a feature

You can file a bug, request a feature, or propose new ideas to enhance Open Distro for Elasticsearch. If you find bugs or want to propose a feature for a particular plug-in, you can go to the specific repo and file an issue on the plug-in repo.

Getting Started

If you’re getting started on building your open source contribution karma, you can select an issue tagged as a “Good First Issue” to start contributing to Open Distro for Elasticsearch. Read the Open Distro technical documentation on the project website to help you get started.

Go develop! And contribute to Open Distro 🙂

TAGS: ,
Alolita Sharma

Alolita Sharma

Alolita is a senior manager at AWS where she leads open source observability engineering and collaboration for OpenTelemetry, Prometheus, Cortex, Grafana. Alolita is co-chair of the CNCF Technical Advisory Group for Observability, member of the OpenTelemetry Governance Committee and a board director of the Unicode Consortium. She contributes to open standards at OpenTelemetry, Unicode and W3C. She has served on the boards of the OSI and SFLC.in. Alolita has led engineering teams at Wikipedia, Twitter, PayPal and IBM. Two decades of doing open source continue to inspire her. You can find her on Twitter @alolita.

Jon Handler

Jon Handler

Jon Handler (@_searchgeek) is a Principal Solutions Architect at Amazon Web Services based in Palo Alto, CA. Jon works closely with the CloudSearch and Elasticsearch teams, providing help and guidance to a broad range of customers who have search workloads that they want to move to the AWS Cloud. Prior to joining AWS, Jon's career as a software developer included four years of coding a large-scale, eCommerce search engine. Jon holds a Bachelor of the Arts from the University of Pennsylvania, and a Master of Science and a Ph. D. in Computer Science and Artificial Intelligence from Northwestern University.