Amazon OpenSearch Serverless levels up speed and efficiency with smart caching

Posted on: Jul 15, 2024

We are excited to announce the new smart caching feature for indexing in Amazon OpenSearch Serverless. This innovative caching mechanism automatically fetches and intelligently manages data, leading to faster data retrieval, efficient storage usage, and cost savings.

OpenSearch Serverless has a built-in caching tier for indexing and search compute, measured in OpenSearch Compute Units (OCU). Prior to this feature, the OCUs consumed by indexing was predominantly determined by the size of the workload. The new caching feature optimizes data management on the indexing compute by keeping only the most recently or frequently used data readily available in the cache. Instead of basing the OCU consumption primarily on the total data size, the new caching feature ensures that the cost is determined by the rate of data ingestion. When data requested is not in the cache, it automatically fetches from the data stored in Amazon Simple Storage Service (Amazon S3). This approach reduces overall OCU usage, making the indexing process more efficient and cost-effective while ensuring faster data retrieval.

The support for the new smart caching feature in OpenSearch Serverless is automatically enabled for all collections and is now available in 13 regions globally: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Europe (Frankfurt), Europe (Ireland), Europe West (Paris), Europe West (London), Asia Pacific South (Mumbai), South America (Sao Paulo), and Canada (Central).

Please refer to the AWS Regional Services List for more information about Amazon OpenSearch Service availability.

To learn more about OpenSearch Serverless, see the documentation.