Posted On: Nov 24, 2020
Amazon Elasticsearch Service now offers support for Remote Reindex, enabling you to migrate data from a remote cluster into Amazon Elasticsearch Service. With this feature, you can simply copy data from one cluster to another, making it easier to migrate from legacy versions of Elasticsearch. Remote Reindex also supports migrating indexes from self-managed Elasticsearch onto Amazon Elasticsearch Service, providing a simple mechanism to onboard onto the service.
In the past, customers had to spend significant time and effort to migrate data from one cluster to another, or to upgrade clusters if they were more than one major version behind. To migrate data, customers could take a snapshot and restore the data into a cluster that is one major version higher than the source, and then reindex their data locally to get the index up to the desired version. If a cluster was more than one major version behind, they would have to go through this process multiple times to get to the desired version–which could take days and a lot of effort.
Remote Reindex feature provides a simple and easy option to move data between clusters. Amazon Elasticsearch Service uses Remote Reindex to replicate data from a remote cluster, which is either self-managed or on the service, to a target cluster on the service, which may be running different Elasticsearch versions. The index settings like the number of shards and replicas can be adjusted while moving the data.
Remote Reindex is supported in Elasticsearch 1.5 and above for remote clusters and Elasticsearch 6.7 and above for target clusters. To get started with Remote Reindex for Amazon Elasticsearch Service, please refer to the documentation.
Remote Reindex is available immediately in 22 regions globally: US East (N. Virginia, Ohio), US West (Oregon, N. California), Canada (Central), South America (Sao Paulo), EU (Ireland, London, Frankfurt, Paris, Stockholm, Milan), Asia Pacific (Singapore, Sydney, Tokyo, Seoul, Mumbai, Hong Kong), Middle East (Bahrain), China (Beijing – operated by Sinnet, Ningxia – operated by NWCD) and Africa (Cape Town). Please refer to the AWS Regional Services List for more information about Amazon Elasticsearch Service availability.