AWS Public Sector Blog

Tag: compute

Analyze terabyte-scale geospatial datasets with Dask and Jupyter on AWS

Terabytes of Earth Observation (EO) data are collected each day, quickly leading to petabyte-scale datasets. By bringing these datasets to the cloud, users can use the compute and analytics resources of the cloud to reliably scale with growing needs. In this post, we show you how to set up a Pangeo solution with Kubernetes, Dask, and Jupyter notebooks step-by-step on Amazon Web Services (AWS), to automatically scale cloud compute resources and parallelize workloads across multiple Dask worker nodes.

Read More
Lake Michigan lighthouse

Modeling clouds in the cloud for air pollution planning: 3 tips from LADCO on using HPC

In the spring of 2019, environmental modelers at the Lake Michigan Air Directors Consortium (LADCO) had a new problem to solve. Emerging research on air pollution along the shores of the Great Lakes in the United States showed that to properly simulate the pollution episodes in the region we needed to apply our models at a finer spatial granularity than the computational capacity of our in-house HPC cluster could handle. The LADCO modelers turned to AWS ParallelCluster to access the HPC resources needed to do this modeling faster and scale for our member states.

Read More
pFaces targets heterogenous hardware configurations (HWCs) combining compute nodes (CNs) of CPUs, GPUs and hardware accelerators (HWAs). A web-based interface helps developers design parallel algorithms and run them on targeted HWCs.

TUM researcher finds new approach to safety-critical systems using parallelized algorithms on AWS

Mahmoud Khaled, a PhD student at TUM and a research assistant at LMU, researches how to improve safety-critical systems that require large amounts of compute power. Using AWS, Khaled’s research project, pFaces, accelerates parallelized algorithms and controls computational complexity to speed the time to science. His project findings introduce a new way to design and deploy verified control software for safety-critical systems, such as autonomous vehicles.

Read More

What’s New for AWS Compute Services from re:Invent 2016

We recently recapped the security and compliance updates announced at this year’s re:Invent that are important to our public sector customers. AWS also expanded upon its core foundational services – compute and storage – by announcing new game-changing services and special features. Check out the below compute updates and our follow-up post covering the storage […]

Read More