AWS Open Source Blog
Tag: storage
Scale your Nextcloud with Storage on Amazon Simple Storage Service (Amazon S3)
When running Nextcloud, you will eventually be restricted by the limits of your server’s disk, or when a team rapidly accumulates documentation. Using Nextcloud’s external storage to outsource files securely to Amazon Simple Storage Service (Amazon S3) offers a simple solution.
EKS support for the EBS CSI driver
Today, we are announcing EKS support for the EBS Container Storage Interface driver, an initiative to create unified storage interfaces between container orchestrators such as Kubernetes and storage vendors like AWS. A History of Storage in Kubernetes As originally conceived, containers were a great fit for stateless applications. However, there was no provision for persistent […]
Use Elasticsearch’s _rollover API For efficient storage distribution
Many Open Distro for Elasticsearch users manage data life cycle in their clusters by creating an index based on a standard time period, usually one index per day. This pattern has many advantages: ingest tools like Logstash support index rollover out of the box; defining a retention window is straightforward; and deleting old data is […]
Announcing PartiQL: One query language for all your data
Data is being gathered and created at rates unprecedented in history. Much of this data is intended to drive business outcomes but, according to the Harvard Business Review, “…on average, less than half of an organization’s structured data is actively used in making decisions…” The root of the problem is that data is typically spread […]
Build and Run the Open Distro For Elasticsearch SQL Plugin with Elasticsearch OSS
Note: These tutorial instructions are not current and will not be updated. OpenSearch was announced on April 12, 2021. Visit opensearch.org to learn more. Open Distro for Elasticsearch comprises four plugins: Security — supports node-to-node encryption, five types of authentication, role-based access controls, audit logging, and cross-cluster search. Alerting — notifies you when data from […]
Parallelizing S3 Workloads with s5cmd
This open source project comes from our customer community. It was developed by Peak Games to assist with their own S3 workflow, and includes features such as tab completion and built-in wild card support for files in S3 commands. Enjoy! – Deirdré Background Up until now, working on multiple objects on Amazon S3 from the […]