Amazon Elasticsearch Service
Fully managed, scalable, and secure Elasticsearch service
Amazon Elasticsearch Service is a fully managed service that makes it easy for you to deploy, secure, and operate Elasticsearch at scale with zero down time. The service offers open-source Elasticsearch APIs, managed Kibana, and integrations with Logstash and other AWS Services, enabling you to securely ingest data from any source and search, analyze, and visualize it in real time. Amazon Elasticsearch Service lets you pay only for what you use – there are no upfront costs or usage requirements. With Amazon Elasticsearch Service, you get the ELK stack you need, without the operational overhead.
Easy to deploy and manage
With Amazon Elasticsearch Service you can deploy a production-ready Elasticsearch cluster in minutes. Amazon Elasticsearch Service simplifies management tasks such as hardware provisioning, software installing and patching, failure recovery, backups, and monitoring, allowing you to reduce operational overhead and build innovative applications.
Integrated with Open-Source Tools & AWS Services
Amazon Elasticsearch Service offers acces to open-source Elasticsearch APIs, managed Kibana, and integration with Logstash, so you can continue to use your existing code and data ingestion and visualization tools. The service also offers built-in integrations with other AWS services such as Amazon Kinesis Data Firehose, AWS IoT, and Amazon CloudWatch Logs for data ingestion; AWS CloudTrail for auditing; Amazon VPC, AWS KMS, Amazon Cognito, and AWS IAM for security.
Amazon Elasticsearch Service lets you scale easily and rapidly as your business requirement changes. You can scale your cluster up or down via a single API call or a few clicks. You can also configure your cluster to meet your performance requirements by selecting from a range of instance types and storage options including SSD-powered EBS volumes.
Secure and Compliant
Using Amazon Elasticsearch Service, you can achieve network isolation with Amazon VPC, encrypt data at-rest and in-transit using keys you create and control through AWS KMS, and manage authentication and access control with Amazon Cognito and AWS IAM policies. Amazon Elasticsearch Service is also HIPAA eligible, and compliant with PCI DSS and ISO standards to help you meet industry-specific or regulatory requirements.
Amazon Elasticsearch Service is designed to be highly available using multi-AZ deployments, which replicates data between multiple Availability Zones in the same region. The service also monitors the health of your clusters and automatically replaces failed instances.
With Amazon Elasticsearch Service, you pay only for what you use. There is no upfront fee or usage requirement. With built-in encryption and VPC support, 24x7 monitoring, and AWS support, you don’t need a team of Elasticsearch experts to scale, secure, and monitor your infrastructure, resulting in lower total cost of operations.
How it works
Analyze unstructured and semi-structured logs generated by websites, mobile devices, servers, and sensors etc., for operational intelligence, application monitoring, root cause analysis and more. Capture, pre-process, and load log data into Amazon Elasticsearch Service using Amazon Kinesis Firehose, Logstash, or Amazon CloudWatch Logs, and subsequently, search, explore, and visualize the data using Kibana and the Elasticsearch query DSL to gain valuable insights about your users and applications.
Adobe uses Amazon Elasticsearch Service to cost-effectively analyze and visualize large amount of log data for its Developer Platform, which at peak receives over 200K API calls per second. With Amazon Elasticsearch Service, Adobe is able to easily see traffic patterns and error rates and quickly identify and troubleshoot any potential issues - all with reduced operational overhead.
Real-Time Application Monitoring
Capture activity logs across your customer-facing applications and websites for real-time application monitoring and issue resolution. Push these logs to your Amazon Elasticsearch Service domain using Logstash. Elasticsearch indexes the data, makes it available for analysis in real-time, and allows you to visualize the data using the built-in Kibana plugin.
Expedia uses Amazon Elasticsearch Service for application monitoring and root-cause analysis and price optimization. Amazon Elasticsearch enables Expedia to monitor huge volumes of Docker logs cost-effectively, identify and troubleshoot issues in real-time, scale easily to accommodate additional log sources, and offload the operational overhead.
Enables security practitioners to centralize and analyze events from across the entire organization to enhance incident response and monitor threats across all their applications and systems in real time. Amazon Elasticsearch Service allows you to index the data as soon as it is ingested allowing you to analyze and visualize data from multiple sources instantly and find and prevent threats faster.
Full Text Search
Provide a low-latency, high-throughput, personalized search experience for your users across e-commerce applications, website, data lake catalogs, and other curated application data. Amazon Elasticsearch Service provides direct access to all of Elasticsearch’s rich search APIs, supporting natural language search across free text, Boolean combinations of text and metadata search, auto-completion, faceted search, location-aware search, and much more.
Mirrorweb uses Amazon Elasticsearch Service to make the UK Government and UK Parliament’s web archives searchable. With Amazon Elasticsearch Service, Mirrorweb indexed 1.4 billion documents for just $337 and indexed 146 MM docs per hour – 14x faster than the previously used technology.
Deliver real-time metrics on digital content to enable authors and marketers to connect with their customers effectively. Load billions of small messages that are compressed and batched to Amazon Elasticsearch Service using Amazon Kinesis Firehose. With Amazon Elasticsearch Service, you can then aggregate, filter, and process the data, and refresh content performance dashboards in near real-time.
Hearst Corporation built a clickstream analytics platform using Amazon Elasticsearch Service, Amazon Kinesis Streams, and Amazon Kinesis Firehose to transmit and process 30 terabytes of data a day from 300+ Hearst websites worldwide. With this platform, Hearst is able to make the entire data stream—from website clicks to aggregated data—available to editors in minutes.