Learn how AWS Snowcone and Amazon S3 can help Government of Canada (GC) organizations securely transfer and store their data, and how two GC organizations have already used these services to migrate data securely. Find out how these AWS services address data security, privacy, and compliance with regulatory requirements specific to GC customers.
Learn how to store historical geospatial data, such as weather data, on AWS using Amazon DynamoDB. This approach allows for virtually unlimited amounts of data storage combined with query performance fast enough to support an interactive UI. This approach can also filter by date or by location, and enables time- and cost- efficient querying.
This quarter, AWS released 36 new or updated datasets. As July 16 is Artificial Intelligence (AI) Appreciation Day, the AWS Open Data team is highlighting three unique datasets that are analysis-ready for AI. What will you build with these datasets?
Geospatial data, including many climate and weather datasets, are often released by government and nonprofit organizations in compressed file formats such as the Network Common Data Form (NetCDF) or GRIdded Binary (GRIB). As the complexity and size of geospatial datasets continue to grow, it is more time- and cost-efficient to leave the files in one place, virtually query the data, and download only the subset that is needed locally. Unlike legacy file formats, the cloud-native Zarr format is designed for virtual and efficient access to compressed chunks of data saved in a central location such as Amazon S3. In this walkthrough, learn how to convert NetCDF datasets to Zarr using an Amazon SageMaker notebook and an AWS Fargate cluster and query the resulting Zarr store, reducing the time required for time series queries from minutes to seconds.
The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. Through this program, customers are making over 100PB of high-value, cloud-optimized data available for public use. As April 22 is Earth Day, the AWS Open Data team wanted to highlight some new datasets from our geospatial and environmental communities of practice, as well as the other new or updated datasets available now on the Registry of Open Data on AWS and also discoverable on AWS Data Exchange.
In 2020, Meta introduced the Daylight Map Distribution, which combines OpenStreetMap (OSM) data with quality and consistency checks from Daylight mapping partners to create a no-cost, stable, and simple-to-use global map. This blog post provides a brief overview of OSM and Daylight followed by a step-by-step tutorial using five real-world examples. We combine the powerful query capabilities of Amazon Athena from with the feature-rich Daylight OSM data to demonstrate a typical OSM data analysis workflow.
Satellite communications (satcom) networks typically offer a rich set of performance metrics, such as signal-to-noise ratio (SNR) and bandwidth delivered by remote terminals on land, sea, or air. Customers can use performance metrics to detect network and terminal anomalies and identify trends to impact business outcomes. This walkthrough presents an approach using serverless resources from AWS to build satcom control plane analytics pipelines. The presented architecture transforms the data to extract key performance indicators (KPIs) of interest, renders them in business intelligence tools, and applies machine learning (ML) to flag unexpected SNR deviations.
Orbital Sidekick (OSK) uses advanced satellite technology and data analytics to help the energy industry protect pipelines and make them less vulnerable to risks such as leaks, contamination, and damage caused by construction and natural disasters. OSK uses compute and analytics services from AWS to power the scalable OSK data pipeline and imagery storage solution in order to persistently monitor tens of thousands of miles of pipeline energy infrastructure and deliver real-time, actionable insights to customers.
In this guest post, Ajay K. Gupta, co-founder and chief executive officer (CEO) of HSR.health, explains how healthcare technology (HealthTech) nonprofit HSR.health uses geospatial artificial intelligence and AWS to develop solutions that support improvements in healthcare and health equity around the world.
34 new or updated datasets on the Registry of Open Data: New data for land use, Alzheimer’s Disease, and more
The AWS Open Data Sponsorship Program makes high-value, cloud-optimized datasets publicly available on AWS. This quarter, AWS released 34 new or updated datasets from Impact Observatory, The Allen Institute for Brain Science, Common Screens, and others, which are available now on the Registry of Open Data in the following categories.