CORDEX-Evaluation

Simulations Using                                                                                                  obs4MIPs/ana4MIPs & NASA Datasets

A critical component of CORDEX are the regional climate models (RCMs) that are used to downscale the global climate model simulations and projections (e.g. typically from CMIP), and provide guidance for local/regional policy and decision support relative to climate change. Because of the potential role these RCMs (may) have, it is a high priority to bring as much observational scrutiny to them as possible. This requires the systematic application of observations; enabling such multi-variate evaluations is essential for advancing model development, and for performing quantitative model comparison and uncertainty analyses.

The goal is to perform a multi-domain, multi-model, multi-variate model evaluation. This evaluation will be based on:

  • 16 Variables:
    • Precipitation from TRMM & GPCP
    • Net longwave & shortwave radiation at the surface and TOA from CERES
    • Temperature & water vapor at 850, 500 and 200 hPa from AIRS 
    • 2m temperature, 850 & 200 hPa zonal and meridional wind, and sea level pressure from MERRA-2 and ERA-I 
  • 5 Evaluation Metrics:

    • bias, centered RMS and Taylor plots for climatological annual and seasonal means

    • temporal correlation and centered RMS for 12-month annual cycle

  • CORDEX Domains:
    • Include all domains and its models for which all or part of the above variablesare accessible via ESGF or otherwise by CORDEX domain technical point of contact.
  • CMIP5 GCMs:
    • Including a small number (~6) of select GCMs used for driving CORDEX RCMs.

 

Quick Navigation - Jump to Evaluations

North America
Europe
Africa
Arctic

 

Introduction

The Coordinated Regional Climate Downscaling Experiment (CORDEX) has helped paved the way for studying climate change at regional and local scales. Systematic model evaluation studies across the 14 domains (each with multiple simulations and many variables) have been limited, with differences in data publication requirements (e.g. ESGF vs local storage/ftp) and archiving standards (e.g. use of CF-compliant netCDF)

 

 

Why we need “Systematic Evaluation”

This Config file (namelist file) is necessary to run each evaluation combination (CORDEX Domain, Season and Variable), forming a large “evaluation matrix”.

14 variables x 13 domains x 3 seasons x ~10 models > 500 evaluations. Writing that many Config files manually would be cumbersome/prohibitive.

 

 

Solution: Extract metadata from input filenames

We can group all models and obs datasets together by common attributes (domain and variable) to form a unique evaluation, and therefore automatically generate Config Files using only the dataset locations as user input.

 

Results

 

 

North America Evaluations

Reference Dataset Variables  Results Page by Seasons
CERES-EBAF

Downwelling Longwave Radiation (Surface)

Upwelling Longwave Radiation (Surface)
Upwelling Longwave Radiation (TOA)
Downwelling Shortwave Radiation (Surface)
Downwelling Shortwave Radiation (TOA)
Upwelling Shortwave Radiation (Surface)
Upwelling Shortwave Radiation (TOA)
Annual Summer Winter
Annual Summer Winter
Annual Summer Winter
Annual Summer Winter

Annual

Summer Winter

Annual

Summer Winter
Annual Summer Winter
MODIS Total Cloud Fraction
Annual Summer Winter
QuikSCAT
Near-Surface Wind Speed
Near-Surface Zonal Wind
Near-Surface Meridional Wind
Annual Summer Winter
Annual Summer Winter
Annual Summer Winter
TRMM-L3 Precipitation
Annual Summer Winter

 

 

 

 

 

 

 

Europe Evaluations

Reference Dataset Variables

Results Page by Seasons

CERES-EBAF

Downwelling Longwave Radiation (Surface)

Upwelling Longwave Radiation (Surface)

Upwelling Longwave Radiation (TOA)

Downwelling Shortwave Radiation (Surface)

Downwelling Shortwave Radiation (TOA)

Upwelling Shortwave Radiation (Surface)

Upwelling Shortwave Radiation (TOA)

Annual Summer Winter
Annual Summer Winter
Annual Summer Winter
Annual Summer Winter

Annual

Summer Winter

Annual

Summer Winter
Annual Summer Winter
MODIS

Total Cloud Fraction

Annual Summer Winter
QuikSCAT

Near-Surface Wind Speed

Near-Surface Zonal Wind

Near-Surface Meridional Wind

Annual Summer Winter
Annual Summer Winter
Annual Summer Winter
TRMM-L3

Precipitation

Annual Summer Winter

 

 

Africa Evaluations

 

Reference Dataset Variables

Results Page by Seasons

CERES-EBAF

Downwelling Longwave Radiation (Surface)

Upwelling Longwave Radiation (Surface)

Upwelling Longwave Radiation (TOA)

Downwelling Shortwave Radiation (Surface)

Downwelling Shortwave Radiation (TOA)

Upwelling Shortwave Radiation (Surface)

Upwelling Shortwave Radiation (TOA)

Annual Summer Winter
Annual Summer Winter
Annual Summer Winter
Annual Summer Winter

Annual

Summer Winter

Annual

Summer Winter
Annual Summer Winter
MODIS

Total Cloud Fraction

Annual Summer Winter
QuikSCAT

Near-Surface Wind Speed

Near-Surface Zonal Wind

Near-Surface Meridional Wind

Annual Summer Winter
Annual Summer Winter
Annual Summer Winter
TRMM-L3

Precipitation

Annual Summer Winter
HIRS Upwelling Longwave Radiation (TOA)
Annual Summer Winter

 

 

 

Arctic Evaluations

Reference Dataset Variables

Results Page by Seasons

CERES-EBAF

Downwelling Longwave Radiation (Surface)

Upwelling Longwave Radiation (Surface)

Upwelling Longwave Radiation (TOA)

Downwelling Shortwave Radiation (Surface)

Downwelling Shortwave Radiation (TOA)

Upwelling Shortwave Radiation (Surface)

Upwelling Shortwave Radiation (TOA)

Annual Summer Winter
Annual Summer Winter
Annual Summer Winter
Annual Summer Winter

Annual

Summer Winter

Annual

Summer Winter
Annual Summer Winter
MODIS

Total Cloud Fraction

Annual Summer Winter
QuikSCAT

Near-Surface Wind Speed

Near-Surface Zonal Wind

Near-Surface Meridional Wind

Annual Summer Winter
Annual Summer Winter
Annual Summer Winter