Listing Thumbnail

    AI Weather Prediction (AIWP) Model Reforecasts

     Info
    Open data
    |
    Deployed on AWS
    <br/> <br/> This is an archive of pure AI-based weather prediction reforecasts produced collaboratively between the Cooperative Institute for Research in the Atmosphere [(CIRA)](https://www.cira.colostate.edu/) and the NOAA Global Systems Laboratory [(NOAA-GSL)](https://gsl.noaa.gov/). <br/> <br/> Currently, [FourCastNetv2-small](https://arxiv.org/abs/2306.03838), [Pangu-Weather](https://www.nature.com/articles/s41586-023-06185-3), and [GraphCast](https://www.science.org/doi/10.1126/science.adi2336) are included, with more models to come. Each of these models has been initialized with both NOAA [GFS](https://www.emc.ncep.noaa.gov/emc/pages/numerical_forecast_systems/gfs.php) (directories with no extension) and ECMWF [IFS](https://www.ecmwf.int/en/forecasts/datasets/set-i) initial conditions (directories ending in "_IFS"). The datasets are updated with near-real-time data twice per day (00Z and 12Z initializations). <br/> <br/> FourCastNetv2-small and Pangu-Weather are availab[...]

    Overview



    This is an archive of pure AI-based weather prediction reforecasts produced collaboratively between the Cooperative Institute for Research in the Atmosphere (CIRA)  and the NOAA Global Systems Laboratory (NOAA-GSL) .



    Currently, FourCastNetv2-small , Pangu-Weather , and GraphCast  are included, with more models to come. Each of these models has been initialized with both NOAA GFS  (directories with no extension) and ECMWF IFS  initial conditions (directories ending in "_IFS"). The datasets are updated with near-real-time data twice per day (00Z and 12Z initializations).



    FourCastNetv2-small and Pangu-Weather are available from 10/2020 to present, while GraphCast is available from 01/2022 to present. These periods are selected to avoid overlap with training and fine-tuning periods for each model. Data may be missing and is not guaranteed to be available at any given time. If there is data missing that you require, please email jacob.radford@noaa.gov .



    For real-time visualizations, visit our visualizations page .



    The directory structure is as follows:
    s3://noaa-oar-mlwp-data/MMMM_vNNN_III/YYYY/mmdd/MMMM_vNNN_III_YYYYmmddhh_fXXX_fYYY_ZZ.nc; where
    MMMM = Four character model code (FOUR, PANG, or GRAP)
    NNN = Three digit version number (currently 100 or 200)
    YYYY = Four digit year
    mm = Two digit month
    dd = Two digit day
    III = Three character initial condition system (GFS)
    hh = Two digit initialization time (00, 06, 12, or 18)
    XXX = Three digit first forecast hour of file (currently 000 for all files)
    YYY = Three digit last forecast hour of file (currently 240 for all files)
    ZZ = Two digit forecast step (currently 06 for all files)



    Variables available by model\:
    • FourCastNet v2-small:
      • 10-m u wind component
      • 10-m v wind component
      • 100-m u wind component
      • 100-m v wind component
      • 2-m temperature
      • Surface pressure
      • Mean sea level pressure
      • Total column integrated water vapor
      • Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • Relative humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • Pangu-Weather:
      • 10-m u wind component
      • 10-m v wind component
      • 2-m temperature
      • Mean sea level pressure
      • Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • Specific humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
    • GraphCast Operational:
      • 10-m u wind component
      • 10-m v wind component
      • 2-m temperature
      • Mean sea level pressure
      • Geopotential at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • Temperature at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • U wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • V wind component at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • Specific humidity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • Vertical velocity at: [1000, 925, 850, 700, 600, 500, 400, 300, 250, 200, 150, 100, 50] hPa
      • 6-hr accumulated precipitation

    Features and programs

    Open Data Sponsorship Program

    This dataset is part of the Open Data Sponsorship Program, an AWS program that covers the cost of storage for publicly available high-value cloud-optimized datasets.

    Pricing

    This is a publicly available data set. No subscription is required.

    How can we make this page better?

    We'd like to hear your feedback and ideas on how to improve this page.
    We'd like to hear your feedback and ideas on how to improve this page.

    Legal

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    AWS Data Exchange (ADX)

    AWS Data Exchange is a service that helps AWS easily share and manage data entitlements from other organizations at scale.

    Open data resources

    Available with or without an AWS account.

    How to use
    To access these resources, reference the Amazon Resource Name (ARN) using the AWS Command Line Interface (CLI). Learn more 
    Description
    AIWP data
    Resource type
    S3 bucket
    Amazon Resource Name (ARN)
    arn:aws:s3:::noaa-oar-mlwp-data
    AWS region
    us-east-1
    AWS CLI access (No AWS account required)
    aws s3 ls --no-sign-request s3://noaa-oar-mlwp-data/

    Resources

    Support

    Contact

    For questions regarding data availability, content, or quality, contact Dr. Jacob Radford (jacob.radford@noaa.gov ). For any general questions regarding the NOAA Open Data Dissemination (NODD) Program, email the NODD Team at nodd@noaa.gov .
    We also seek to identify case studies on how NOAA data is being used and will be featuring those stories in joint publications and in upcoming events. If you are interested in seeing your story highlighted, please share it with the NODD team by emailing nodd@noaa.gov 

    Managed By

    Dr. Jacob Radford (jacob.radford@noaa.gov )

    How to cite

    AI Weather Prediction (AIWP) Model Reforecasts was accessed on DATE from https://registry.opendata.aws/aiwp .

    License

    Open Data. There are no restrictions on the use of this data.

    Similar products