Posted On: Nov 24, 2020
Amazon Elasticsearch Service now supports Piped Processing Language (PPL), a new feature that enables users to explore, discover and find data stored in Amazon ES, using a set of commands delimited by pipes (|). PPL extends Elasticsearch to support a standard set of commands that is easy for system developers, DevOps engineers, support engineers, site reliability engineers (SREs), and IT managers who are proficient with Linux or Unix to learn. PPL enables these users to begin extracting insights from their log, monitoring and observability data on day one.
PPL supports a comprehensive set of commands including search, where, fields, rename, dedup, stats, sort, eval, head, top and rare. These commands are read-only requests to process data and return results. PPL also supports functions including date-time, mathematical, string, aggregate, and trigonometric, and operators and expressions. With the launch of PPL we have expanded the capabilities of Query Workbench in Kibana to support PPL in addition to SQL, and view results as text.
Piped Processing Language feature is powered by Open Distro for Elasticsearch, an Apache 2.0-licensed distribution of Elasticsearch. Piped Processing Language is supported on all Amazon Elasticsearch Service domains running Elasticsearch 7.9 or greater. To learn more about Open Distro for Elasticsearch and Piped Processing Language, visit the project website and documentation.
Piped Processing Language for Amazon Elasticsearch Service are available across 24 regions globally: US East (N. Virginia, Ohio), US West (Oregon, N. California), AWS GovCloud (US-Gov-East, US-Gov-West), Canada (Central), South America (Sao Paulo), EU (Ireland, London, Frankfurt, Paris, Stockholm, Milan), Asia Pacific (Singapore, Sydney, Tokyo, Seoul, Mumbai, Hong Kong), Middle East (Bahrain), China (Beijing) region, operated by Sinnet, China (Ningxia) region, operated by NWCD, and Africa (Cape Town). Please refer to the AWS Region Table for more information about Amazon Elasticsearch Service availability.