Posted On: Jun 3, 2020
Amazon Elasticsearch Service (Amazon ES) now offers support for cross-cluster search, enabling you to perform searches, aggregations, and visualizations across multiple Amazon ES domains with a single query or from a single Kibana interface. With this feature, you can separate heterogeneous workloads into multiple domains, which provides better resource isolation, and the ability to tune each domain for their specific workloads which can improve availability and reduce costs.
Previously, if customers needed to query and aggregate data across multiple indices or workloads, they had to provision them into a single domain, a managed cluster of Elasticsearch instances. While this setup is simple and involves managing just one domain, it can be inefficient when the workloads are heterogeneous and have different resource requirements or the number of workloads sharing the domain grow to where the blast radius of a single workload impacting the entire domain can become a concern. With the availability of cross-cluster search, customers can now store different indices or workloads on different domains and while still being able to query data across all of them with a single request.
Cross-cluster search lets customers set up a secure connection between the clusters. Domain owners have the flexibility to create, view, remove and monitor connections to or from their domains. All cross-cluster search requests between clusters are encrypted and can be secured with fine-grained access policies. Cross-cluster search works across accounts within a region.
You can start creating cross-cluster connections and running queries across clusters for all new domains starting today. To learn about setting up cross-cluster connections please refer to the documentation.
Cross-cluster search on Amazon Elasticsearch Service is available in 22 regions globally: US East (N. Virginia, Ohio), US West (Oregon, N. California), Canada (Central), South America (Sao Paulo), EU (Ireland, London, Frankfurt, Paris, Stockholm, Milan), Asia Pacific (Singapore, Sydney, Tokyo, Seoul, Mumbai, Hong Kong), Middle East (Bahrain), China (Beijing – operated by Sinnet, Ningxia – operated by NWCD), Africa (Cape Town). Please refer to the AWS Region Table for more information about Amazon Elasticsearch Service availability.