Data from NOAA's GOES-R series satellite is available on Amazon S3. The National Oceanic and Atmospheric Administration (NOAA) operates a constellation of Geostationary Operational Environmental Satellites (GOES) to provide continuous weather imagery and monitoring of meteorological and space environment data for the protection of life and property across the United States. GOES satellites provide critical atmospheric, oceanic, climatic and space weather products supporting weather forecasting and warnings, climatologic analysis and prediction, ecosystems management, safe and efficient public and private transportation, and other national priorities.  

The satellites provide advanced imaging with increased spatial resolution, 16 spectral channels, and up to 1 minute scan frequency for more accurate forecasts and timely warnings.

The real-time feed and full historical archive of original resolution Advanced Baseline Imager (ABI) radiance data (Level 1b) and full resolution Cloud and Moisture Imager (CMI) products (Level 2) are freely available on Amazon S3 for anyone to use. Currently, GOES-16 data is at provisional status. Please see details of the data maturity here.

While the GOES-16 ABI L1b and CMI data have reached provisional validation, please keep in mind that since GOES-16 satellite has not been declared operational, its data are still considered preliminary and undergoing testing.

The availability of GOES-R Series on AWS data is the result of the NOAA Big Data Project (BDP) to explore the potential benefits of storing copies of key observations and model outputs in the Cloud to allow computing directly on the data without requiring further distribution. Such an approach could help form new lines of business and economic growth while making NOAA's data more easily accessible to the American public.

This page includes information on data structure; you can find much more detailed information about GOES-R Series data from NOAA here.

Data will be moved to different Amazon S3 storage classes on a schedule. It will start in Standard, move to Infrequent Access after 30 days and then to Glacier after 30 more days.

All data files from GOES-16 (formerly GOES-R) are provided in netCDF4 format. The GOES-16 data is hosted in the noaa-goes16 Amazon S3 bucket in S3's us-east-1 region. Individual files are availabe in the netCDF format with the following schema:

<Product>/<Year>/<Day of Year>/<Hour>/<Filename>

where:

  • <Product> is the product generated from one of the sensors aboard the satellite (e.g.)
    • ABI-L1b-RadF
    • ABI-L1b-RadC
    • ABI-L1b-RadM
  • <Year> is the year the netCDF4 file was created
  • <Day of Year> is the numerical day of the year (1-365)
  • <Hour> is the hour the data observation was made
  • <Filename> is the name of the file containing the data. These are compressed and encapsulated using the netCDF4 standard.

A <Filename> is delineated by underscores '_' and looks like this:

OR_ABI-L1b-RadF-M3C02_G16_s20171671145342_e20171671156109_c20171671156144.nc

where:

  • OR: Operational system real-time data
  • ABI-L1b-RadF-M3C02 is delineated by hyphen '-':
    • ABI: is ABI Sensor
    • L1b: is processing level, L1b data or L2
    • Rad: is radiances. Other products include CMIP (Cloud and Moisture Imagery products) and MCMIP (multichannel CMIP).
    • F: is full disk (normally every 15 minutes), C is continental U.S. (normally every 5 minutes), M1 and M2 is Mesoscale region 1 and region 2 (usually every minute each)
    • M3: is mode 3 (scan operation), M4 is mode 4 (only full disk scans every five minutes – no mesoscale or CONUS)
    • C02: is channel or band 02, There will be sixteen bands, 01-16
  • G16: is satellite id for GOES-16 (future G17)
  • s20171671145342: is start of scan time
    • 4 digit year
    • 3 digit day of year
    • 2 digit hour
    • 2 digit minute
    • 2 digit second
    • 1 digit tenth of second
  • e20171671156109: is end of scan time
  • c20171671156144: is netCDF4 file creation time
  • .nc is netCDF file extension

Examples of how to access the objects via the AWS CLI can be seen below.

aws s3 ls noaa-goes16

aws s3 cp s3://noaa-goes16/<Product>/<Year>/<Day of Year>/<Hour>/<Filename>

We have set up public Amazon SNS topics that create a notification for every new object added to the Amazon S3 buckets for GOES on AWS. To start, you can subscribe to these notifications using Amazon SQS and AWS Lambda. This means you can automatically add new real-time and near-real-time GOES data into a queue or trigger event-based processing if the data meets certain criteria such as geographic location.

The ARN for the PDA feed is arn:aws:sns:us-east-1:123901341784:NewGOES16Object.

Source
National Oceanic and Atmospheric Administration
Category Earth Science, Sensor Data, Natural Resource, Meteorological
Format netCDF v4
License There are no restrictions on the use of this data.
Storage Service Amazon S3
Location s3://noaa-goes16 in us-east-1 region
Update Frequency New data is added as soon as it's available

Educators, researchers and students can apply for free promotional credits to take advantage of Public Datasets on AWS. If you have a research project that could take advantage of GOES data on AWS, you can apply for Earth on AWS Cloud Credits for Research.