Posted On: Apr 21, 2021
Amazon Elasticsearch Service now supports Asynchronous Search. Asynchronous Search lets you submit a query that gets executed asynchronously, monitor the progress of the request, and retrieve results at a later stage. You can also retrieve partial results as they become available even before the search has fully completed. Once the search completes, it can be stored for consumption at a later time up to an expiry duration.
Asynchronous Search can be a great solution for setups with large volume of data, cross-cluster search, or Ultrawarm where users need to run queries with wildcard parameters that may need to scan almost the entire dataset or multiple clusters. With the regular Search API, the query can time out even before the result set becomes available. With Asynchronous Search, even if the query is taking a long time, you can retrieve the results that have been collated so far and continue to go back for more results as and when they become available. The Asynchronous Search continues to run in the background and collect results until the entire result set is available, which can then be persisted in an index for later use. You can also monitor the Asynchronous Search requests via the metrics published to Amazon CloudWatch.
Asynchronous Search API was released recently as part of Open Distro for Elasticsearch v1.13.0, an Apache 2.0-licensed distribution of Elasticsearch and supports Elasticsearch version 7.10.
Asynchronous Search API on Amazon Elasticsearch Service is available immediately in 25 regions globally: US East (N. Virginia, Ohio), US West (Oregon, N. California), AWS GovCloud (US-Gov-East, US-Gov-West), Canada (Central), South America (Sao Paulo), EU (Ireland, London, Frankfurt, Paris, Stockholm, Milan), Asia Pacific (Singapore, Sydney, Tokyo, Osaka, Seoul, Mumbai, Hong Kong), Middle East (Bahrain), China (Beijing – operated by Sinnet, Ningxia – operated by NWCD) and Africa (Cape Town). Please refer to the AWS Regional Services List for more information about Amazon Elasticsearch Service availability.