Tag: Registry of Open Data on AWS

With increasing pressure from climate change, loss of biodiversity, and demand for natural resources from already stressed ecosystems, it has become essential to understand and address environmental changes by making sustainable land use decisions with the latest and most accurate data. As part of the Amazon Sustainability Data Initiative (ASDI), AWS invited Joe Sexton, chief scientist and co-founder of terraPulse, to share how AWS technologies and open data are supporting terraPulse’s efforts to provide accurate and up-to-date information on the world’s changing ecosystems.

Since 1971, Canada Centre for Mapping and Earth Observation (CCMEO) at Natural Resources Canada (NRCan) has accumulated an Earth observation (EO) data archive in excess of two petabytes (PB). NRCan wanted to modernize its geospatial offerings at a faster pace, so they turned to the AWS Snow Family on AWS to migrate their large volume of data.

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on Amazon Web Services (AWS). Our full list of publicly available datasets are on the Registry of Open Data on AWS. This quarter, we released 13 new or updated datasets including CMIP5, 1950s US Decennial Census, and open genomics data for Galaxy. Read on for some highlights.

At AWS, we know these are challenging times and we remain committed to supporting nonprofits. This blog post outlines a sampling of programs and resources for nonprofits, including grants and credits, open data access, cloud training, educational events, and more, designed to enable organizations of all sizes to overcome barriers to technology adoption, while enhancing the scale, performance, and capabilities of mission operations.

As part of the Amazon Sustainability Data Initiative (ASDI), AWS invited Nils Helset, co-founder and chief executive officer (CEO) of DigiFarm, to share how AWS Cloud technology and open data support DigiFarm’s efforts in precision farming to make agricultural practices more sustainable and efficient.

How do we avoid the next global pandemic? For researchers collaborating with the University of British Columbia Cloud Innovation Center (UBC CIC), the answer to that question lies in a massive library of genetic sequencing data. But there is a problem: the data library is so massive that traditional computing can’t comprehensively analyze or process it. So the UBC CIC team collaborated with computational virologists to create Serratus, an open-science viral discovery platform to transform the field of genomics—built on the massive computational power of the Amazon Web Services (AWS) Cloud.

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. We work with data providers to democratize access to data by making it available to the public for analysis on AWS; to develop new cloud-native techniques, formats, and tools that lower the cost of working with data; and to encourage the development of communities that benefit from access to shared datasets. This quarter, we released 19 new or updated datasets like validated OpenStreetMap data, bioacoustic data, COVID-19 detection data, and more.

Terabytes of Earth Observation (EO) data are collected each day, quickly leading to petabyte-scale datasets. By bringing these datasets to the cloud, users can use the compute and analytics resources of the cloud to reliably scale with growing needs. In this post, we show you how to set up a Pangeo solution with Kubernetes, Dask, and Jupyter notebooks step-by-step on Amazon Web Services (AWS), to automatically scale cloud compute resources and parallelize workloads across multiple Dask worker nodes.

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. We work with data providers to democratize access to data by making it available to the public for analysis on AWS; develop new cloud-native techniques, formats, and tools that lower the cost of working with data; and encourage the development of communities that benefit from access to shared datasets. Our full list of publicly available datasets are on the Registry of Open Data on AWS. This quarter, we released 26 new or updated datasets including datasets on climate, koala genomes, analysis ready radar data, and highly-queryable genomic data. Check out some highlights.

The Allen Institute seeks to understand how our brains, cells, and immune systems work when we are healthy and, ultimately, how they go wrong in disease. Allen researchers have generated and shared atlases that map the brain, gene-edited stem cell lines, and many more resources that have been used by millions of scientists around the world to accelerate their research. In collaboration with AWS and the Registry of Open Data on AWS, they make many of their datasets publicly available. In celebration of Open Science Week, check out some of these open datasets from the Allen Institute, and their impact on the research community.