Tag: open data

The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on Amazon Web Services (AWS). We work with data providers to democratize access to data by making it available for analysis on AWS; develop new cloud-native techniques, formats, and tools that lower the cost of working with data; and encourage the development of communities that benefit from access to shared datasets. Our full list of publicly available datasets are on the Registry of Open Data on AWS. This quarter, we released 28 new datasets including data on SARS-CoV-2 viral genomes, storm surge forecasts, and US census data. Check out some highlights.

Saildrone builds and operates a fleet of unmanned surface vehicles (USVs) designed to collect high-resolution oceanographic and atmospheric data in remote oceans. Known as saildrones, each vehicle can stay at sea for up to 12 months, transmitting real-time data via satellite. The data collected is used to inform climate models and extreme weather prediction, maritime domain awareness, maps and charts, and sustainable management of resources. Using clean, renewable wind and solar power, saildrones provide access to the world’s oceans at a fraction of the cost of traditional ship-based methods, while drastically reducing the carbon footprint of global ocean observation.

If you are hosting an ArcGIS web app today, then you are probably hosting it on a Windows or Linux server using traditional web server software like IIS or Apache. With the web hosting capability of Amazon S3 you can remove the need to run these servers and the maintenance, management, and monitoring overhead that comes with it. Serverless services like Amazon S3 can scale automatically and can be as simple as copying over your website assets to get up and running in minutes. This blog focuses on web app implementations using ArcGIS API for JavaScript (as other ArcGIS web apps have additional considerations).

Today more than 200,000 volunteers around the world are helping accelerate research toward COVID-19 therapies—by walking away from their computers. That’s because of a concept called distributed computing, which allows anyone with a home computer, laptop, or virtual machine to contribute computing power to a common cause. This month, nonprofit Folding@home has started sharing one of the world’s largest public protein simulation databases as an AWS Open Data Set so that researchers around the world can easily access this data to speed up the search for therapies for COVID-19.

The National Center for Atmospheric Research (NCAR) is a federally funded research and development center sponsored by the National Science Foundation. It engages in large-scale Earth system science research projects in collaboration with the broader university community. NCAR hosts visitors from around the world, develops community models including the Community Earth System Model and the Weather Research and Forecasting Model, and maintains supercomputers, observational systems, and aircraft to support further study on the how the planet works. As part of the Amazon Sustainability Data Initiative, we invited Dr. David John Gagne, machine learning (ML) scientist at NCAR, to share how open data and machine learning on AWS are impacting the way we predict and understand extreme weather.

AWS and the National Institutes of Health’s (NIH) National Center for Biotechnology Information (NCBI) announced the creation of the Coronavirus Genome Sequence Dataset to support COVID-19 research. The dataset is hosted by the AWS Open Data Sponsorship Program and accessible on the Registry of Open Data on AWS, providing researchers quick and easy access to coronavirus sequence data at no cost for use in their COVID-19 research.

Governments are sharing their technology solutions with other governments through open source tools. These tools are helping state, local, and federal governments respond quicker, and at the scale needed, especially during the COVID-19 pandemic. However, one of the challenges governments face is finding out what open source tools are available. To help public sector customers use open source tools better, AWS launched Open Government Solutions, which aggregates open source projects and assets from public sector entities around the globe for governments at all levels to find, adapt, and reuse. During a panel conversation around the launch, government leaders outlined five key reasons why governments are choosing open source technologies to deliver citizen services.

As a physical oceanographer focused on remote sensing, Dr. Chelle Gentemann, senior scientist at Farallon Institute, has worked for over 20 years on retrievals of ocean temperature from space. She uses measurements of sea surface temperature from satellites to understand how the ocean impacts our lives. Chelle’s work requires analysis of large volumes of data, which requires access to large data storage and computational resources. Although most large research institutions can secure those IT resources, that is not the case for smaller organizations or underserved communities around the world. As part of the Amazon Sustainability Data Initiative, we invited Dr. Gentemann to share her perspective on the value of hosting high-resolution climate data on AWS.

Last December, AWS announced the expansion of its collaboration with the U.S. NOAA to make environmental data easier to access and use through the Big Data Program. Users can now access new, authoritative NOAA data on AWS without needing to download and store their own copies. Researchers and entrepreneurs can deploy compute resources on-demand in the cloud, perform analysis quickly and efficiently, and save costs by letting researchers ask more questions and experiment more easily. One of the foundational datasets now available on AWS through this collaboration is Himawari-8, the Japan Meteorological Agency’s satellite dataset.

Happy Earth Day! In April, the Fix This podcast focused on how the cloud can help people and organizations further understand human impact on the environment, and help them to achieve their sustainability goals. All episodes are available for streaming and download on Spotify, Apple Podcasts, Google Play, Stitcher, TuneIn, Overcast, iHeartRadio, and via RSS.