AWS Public Sector Blog

Category: Storage

Lake Michigan lighthouse

Modeling clouds in the cloud for air pollution planning: 3 tips from LADCO on using HPC

In the spring of 2019, environmental modelers at the Lake Michigan Air Directors Consortium (LADCO) had a new problem to solve. Emerging research on air pollution along the shores of the Great Lakes in the United States showed that to properly simulate the pollution episodes in the region we needed to apply our models at a finer spatial granularity than the computational capacity of our in-house HPC cluster could handle. The LADCO modelers turned to AWS ParallelCluster to access the HPC resources needed to do this modeling faster and scale for our member states.

Read More
Hurricane imagery acquired by NOAA RSD

Open data helps recovery in the aftermath of devastating weather events

Severe and extreme weather events not only wreak havoc on lives, property and the economy, but the extent of the destruction and devastation left behind can be difficult to map and quantify. Having high resolution imagery of areas devastated by weather events (hurricanes, tornadoes, floods, and etc.) helps to characterize impacts, formulate needed recovery and response activities, support emergency managers in saving lives, and restart the flow of commerce. NOAA’s data plays a critical role in this process. As part of ASDI, we invited Jena Kent from NOAA’s Big Data Program to share how AWS is helping with disaster response by providing access to aerial data and imagery through open data initiatives.

Read More
Hope orbiter Mars, photo courtesy of MBRSC, United Arab Emirates

UAE Mars mission uses AWS to advance scientific discoveries

On February 9, a new object successfully began to orbit Mars: an uncrewed spacecraft called the Hope Probe. The mission has already returned the first image of Mars, taken by Hope’s Emirates eXploration Imager from an altitude of 24,700 km. Led by the Mohammed Bin Rashid Space Centre (MBRSC), the Hope Probe is the first interplanetary mission for the United Arab Emirates, the fifth country in history to reach the red planet. It will also be the first spacecraft to capture a complete picture of the Martian atmosphere and its layers during different times of the day and different seasons for one complete Martian year. Once data transmitted by the Hope Probe reaches the scientific teams on Earth, MBRSC will use AWS advanced technologies to process and analyze the vast amounts of data and imagery to help researchers better understand the Martian atmosphere and its layers.

Read More

How to meet business data resiliency with Amazon S3 cross-Region replication

Even though Amazon S3 provides regional data resiliency, customers often have compliance and business requirements to replicate their data to a second Region that is hundreds (or even thousands) of miles away from their primary location. Amazon S3 replication provides an automatic mechanism to make identical copies of your objects in a destination Region of your choice. Replication enables automatic, asynchronous copying of objects across S3 buckets. Learn how to configure S3 Cross Region Replication with S3 RTC feature, and do a walk-through of how to configure event notification for S3 replication events and configuring Amazon CloudWatch alarms for the replication metrics.

Read More
AWS managed storage

Amazon FSx now available in AWS GovCloud (US)

Amazon FSx is now available in the AWS GovCloud (US) Regions, allowing government agencies, educational institutions, and nonprofits to scale their most sensitive file-based workloads to reduce cost and streamline operations. When customers move their NAS data and applications to AWS, they benefit from increased cost savings, improved security, and flexibility to modernize their infrastructure at their own pace. This allows organizations to focus more on the mission-critical parts of their application and driving more innovation.

Read More
Serverless GIS

Serverless GIS with Amazon S3, open data, and ArcGIS

If you are hosting an ArcGIS web app today, then you are probably hosting it on a Windows or Linux server using traditional web server software like IIS or Apache. With the web hosting capability of Amazon S3 you can remove the need to run these servers and the maintenance, management, and monitoring overhead that comes with it. Serverless services like Amazon S3 can scale automatically and can be as simple as copying over your website assets to get up and running in minutes. This blog focuses on web app implementations using ArcGIS API for JavaScript (as other ArcGIS web apps have additional considerations).

Read More

Managing Edge of the Edge deployments with Rancher

To help support DIL environments, Amazon Web Services (AWS) created the Snow family of products to include the AWS Snowcone and AWS Snowball devices. The Snow family moves data processing and analysis as close as necessary to where data is created in order to deliver intelligent, real-time responsiveness and streamline the amount of data transferred. To address the challenges of edge of the edge computing, we use the Snowball Edge as a central management hub and a Snowcone as an outer edge device. This how-to shows how to use Rancher as a centralized Kubernetes management tool installed on a Snowball, which has been set up to manage a single-node Kubernetes cluster on a Snowcone. This configuration allows us to fully manage the containers running on one or more Snowcones from the Snowball itself.

Read More

The Water Institute of the Gulf runs compute-heavy storm surge and wave simulations on AWS

The Water Institute of the Gulf runs its storm surge and wave analysis models on Amazon Web Services (AWS)—a task that sometimes requires large bursts of compute power. These models are critical in forecasting hurricane storm surge event (like Hurricane Laura in August 2020), evaluating flood risk for the Louisiana and other coastal states, helping governments prepare for future conditions, and managing the coast proactively.

Read More
Data lake

Building a data lake at your university for academic and research success

According to the National Center for Education Statistics, only 60 percent of college students receive a degree within six years. Universities—like Portland State University (PSU) and Oklahoma State University (OSU-OKC)—are using data lakes for analytics and machine learning to improve academic achievement by helping students reach their educational goals faster. Read on for how institutions use Amazon S3 for data lakes.

Read More
Amazon S3 Glacier

Securing Amazon S3 Glacier with a customer-managed encryption key

Customer managed encryption keys are a common architecture requirement within highly regulated workloads. This post demonstrates how to satisfy this requirement within Amazon Simple Storage Service (Amazon S3), including Amazon S3 Glacier. We also clarify some common points of confusion and demonstrate how objects can be uploaded directly to Amazon S3 Glacier via Amazon S3, which can help meet regulatory requirements as well as potentially save budget.

Read More