AWS Public Sector Blog

Tag: open data

Analyze terabyte-scale geospatial datasets with Dask and Jupyter on AWS

Terabytes of Earth Observation (EO) data are collected each day, quickly leading to petabyte-scale datasets. By bringing these datasets to the cloud, users can use the compute and analytics resources of the cloud to reliably scale with growing needs. In this post, we show you how to set up a Pangeo solution with Kubernetes, Dask, and Jupyter notebooks step-by-step on Amazon Web Services (AWS), to automatically scale cloud compute resources and parallelize workloads across multiple Dask worker nodes.

Read More

AWS hosts new open dataset to help businesses identify climate finance risks and investments

Companies and asset managers looking to protect their financial investments from climate change-related risks, and invest in more sustainable solutions, can now access a new dataset on the Amazon Web Services (AWS) Cloud to help inform their decision making. Amazon announced that the Legal Entity Identifier (LEI) dataset is now available and free for anyone to access in the cloud. The dataset includes key reference information that supports clear and unique identification of legal entities participating in financial transactions, and each LEI contains information about an entity’s ownership structure, including ‘who is who’ and ‘who owns whom’.

Read More
koala in tree

Climate data, koala genomes, analysis ready radar data, and highly-queryable genomic data: The latest open data on AWS

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. We work with data providers to democratize access to data by making it available to the public for analysis on AWS; develop new cloud-native techniques, formats, and tools that lower the cost of working with data; and encourage the development of communities that benefit from access to shared datasets. Our full list of publicly available datasets are on the Registry of Open Data on AWS. This quarter, we released 26 new or updated datasets including datasets on climate, koala genomes, analysis ready radar data, and highly-queryable genomic data. Check out some highlights.

Read More

Introducing 10 minute cloud tutorials for research

Ten Minute Tutorials for Research provides a way for researchers to quickly learn about topics and tools that are specific to their unique needs, covering the basics on how to get started and providing helpful links to get more in-depth information and support—all in ten minutes. The series is led by AWS solutions architects and AWS research business development specialists who work closely with researchers. Many of the presenters are former researchers themselves and content is specifically geared to a research audience.

Read More

Celebrate Open Science Week with the Allen Institute and available open datasets

The Allen Institute seeks to understand how our brains, cells, and immune systems work when we are healthy and, ultimately, how they go wrong in disease. Allen researchers have generated and shared atlases that map the brain, gene-edited stem cell lines, and many more resources that have been used by millions of scientists around the world to accelerate their research. In collaboration with AWS and the Registry of Open Data on AWS, they make many of their datasets publicly available. In celebration of Open Science Week, check out some of these open datasets from the Allen Institute, and their impact on the research community.

Read More

How open data from weather radar helps scientists improve environmental understanding

Weather radars see more than just the weather: they see smoke from fires, meteors, birds, mayflies, and almost anything else in the atmosphere. This makes weather radars an invaluable tool for scientists seeking to further the understanding of atmospheric processes and anything else that happens to be flying through the radar’s field of view. The Amazon Sustainability Data Initiative (ASDI) seeks to accelerate sustainability-related innovation and research by helping to minimizing the cost and time required to store, acquire, and analyze large weather and climate datasets.

Read More

Satellite imagery over Africa, a large-scale climate ensemble, and product listings with 3D renderings: The latest open data on AWS

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. This quarter, we released 44 new or updated datasets including satellite imagery over Africa, a large-scale climate ensemble, and product listings with 3D renderings. Learn how you can put these open datasets to work.

Read More

Open data on AWS supports sustainable agricultural practices and crop optimization

With a rapidly growing population, the world is increasingly dependent on the ability to develop and maintain sustainable agriculture and healthy environments. Learn how BASF Digital Farming is leveraging both National Oceanic and Atmospheric Administration (NOAA) weather data hosted on AWS, and commercial weather data, to develop digital solutions to help farmers effectively monitor and manage their fields, and help drive farm sustainability.

Read More
close up of laptop showing tracking of sharks via OCEARCH along the US Carolina coastline

Assessing the ocean’s health by monitoring shark populations

OCEARCH is a data-centric organization built to help scientists collect previously unattainable data about the ocean. Their mission is to accelerate the ocean’s return to balance and abundance, through innovation in scientific research, education, outreach, and policy, using unique collaborations of individuals and organizations in the US and abroad. As part of the Amazon Sustainability Data Initiative (ASDI), we invited Fernanda Ubatuba, president and COO at OCEARCH, to share how her organization is making strides in helping ocean conservation and how AWS is supporting her mission.

Read More

How the cloud is helping remove barriers to addressing climate change

What if we were to democratize access to data and compute so that anyone, anywhere in the world could contribute to climate science? The Amazon Sustainability Data Initiative (ASDI) seeks to accelerate sustainability research and innovation by minimizing the cost and time required to acquire and analyze large sustainability datasets. ASDI supports innovators and researchers with the data, tools, and technical expertise they need to advance sustainability initiatives. ASDI is committed to making climate-relevant data easier to access and analyze. ASDI’s growing data catalog comprises petabytes of open data.

Read More