How can I scale up an Amazon Elasticsearch Service domain?

Last updated: 2020-11-09

I'm trying to scale up an Amazon Elasticsearch Service (Amazon ES) domain. How can I do this?

Resolution

Before scaling up Amazon ES, consider reducing your load on the domain. If you're unable to reduce the load, use the following options to increase your storage capacity:

  • Add more storage: If you're using Amazon Elastic Block Store (Amazon EBS), increase the size of the EBS volumes. The maximum volume size depends on the node's Amazon Elastic Compute Cloud (Amazon EC2) instance type. If you can't increase the size of the EBS volumes, add additional nodes or scale up your domain. For more information about EBS volumes, see EBS volume size limits. If you're not using Amazon EBS volumes for storage, add additional nodes to your cluster configuration.
  • Add more CPU resources: To add more CPU capacity, switch to a larger instance type or add more nodes. In addition, use at least three dedicated leader nodes.
  • Add more memory: To add more memory, switch to a larger instance type or add more nodes.
  • Add UltraWarm nodes: UltraWarm nodes are a low-cost data storage option. Use UltraWarm nodes to migrate less frequently accessed data, while retaining accessed indices on standard data nodes. Also, you can use Index State Management to migrate data from hot nodes to warm nodes.

To edit your domain configuration, perform the following steps:

1.    Sign in to your AWS Management Console.

2.    Open the Amazon ES console.

3.    Choose the Amazon ES domain for which you want to add storage.

4.    Choose Edit Domain.

5.    Update the following domain configuration settings:

Data nodes: Configure your Availability Zones, instance type, and number of nodes.
Storage configuration: Update your data node storage type, EBS volume type, and EBS storage size per node.
Dedicated master nodes: Enable or disable the dedicated master node, update the instance type, or modify the number of master nodes.
UltraWarm data nodes: Enable or disable UltraWarm data nodes, update the instance type, or modify the number of UltraWarm data nodes.

6.    Choose Submit.

Note: Amazon ES uses a blue/green deployment process when you update a domain. This means that the number of nodes in the cluster might temporarily increase while your changes are applied. For more information, see About configuration changes.

7.    Configure Amazon CloudWatch alarms to monitor your resource utilization. For example, you can set an alarm that notifies you when CPUUtilization is above 80%.