skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Cloud Feedback Model Intercomparison Project (CFMIP) Diagnostic Codes Catalogue – metrics, diagnostics and methodologies to evaluate, understand and improve the representation of clouds and cloud feedbacks in climate models

Abstract

The CFMIP Diagnostic Codes Catalogue assembles cloud metrics, diagnostics and methodologies, together with programs to diagnose them from general circulation model (GCM) outputs written by various members of the CFMIP community. This aims to facilitate use of the diagnostics by the wider community studying climate and climate change. Here, this paper describes the diagnostics and metrics which are currently in the catalogue, together with examples of their application to model evaluation studies and a summary of some of the insights these diagnostics have provided into the main shortcomings in current GCMs. Analysis of outputs from CFMIP and CMIP6 experiments will also be facilitated by the sharing of diagnostic codes via this catalogue. Any code which implements diagnostics relevant to analysing clouds – including cloud–circulation interactions and the contribution of clouds to estimates of climate sensitivity in models – and which is documented in peer-reviewed studies, can be included in the catalogue. We very much welcome additional contributions to further support community analysis of CMIP6 outputs.

Authors:
ORCiD logo [1]; ORCiD logo [2];  [3];  [4];  [5];  [6];  [1];  [7];  [8]; ORCiD logo [3]
  1. Met Office Hadley Centre, Exeter (United Kingdom)
  2. Centre National de la Recherche Scientifique (CNRS), Toulouse (France)
  3. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States). Cloud Processes Research and Modeling Group
  4. National Observatory of Athens, Athens (Greece)
  5. Univ. Leipzig, Leipzig (Germany). Inst. for Meteorology
  6. Univ. of California, Los Angeles, CA (United States). Dept. of Atmospheric and Oceanic Sciences
  7. Univ. of New South Wales, Sydney, NSW (Australia). Climate Change Research Centre and ARC Centre of Excellence for Climate System Science
  8. Univ. of Tokyo, Kashiwa (Japan). Atmosphere and Ocean Research Inst.
Publication Date:
Research Org.:
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE; European Union (EU); National Oceanic and Atmospheric Administration (NOAA)
OSTI Identifier:
1438789
Report Number(s):
LLNL-JRNL-726858
Journal ID: ISSN 1991-9603
Grant/Contract Number:  
AC52-07NA27344; 244067; NA15OAR4310153
Resource Type:
Accepted Manuscript
Journal Name:
Geoscientific Model Development (Online)
Additional Journal Information:
Journal Name: Geoscientific Model Development (Online); Journal Volume: 10; Journal Issue: 11; Journal ID: ISSN 1991-9603
Publisher:
European Geosciences Union
Country of Publication:
United States
Language:
English
Subject:
58 GEOSCIENCES

Citation Formats

Tsushima, Yoko, Brient, Florent, Klein, Stephen A., Konsta, Dimitra, Nam, Christine C., Qu, Xin, Williams, Keith D., Sherwood, Steven C., Suzuki, Kentaroh, and Zelinka, Mark D. The Cloud Feedback Model Intercomparison Project (CFMIP) Diagnostic Codes Catalogue – metrics, diagnostics and methodologies to evaluate, understand and improve the representation of clouds and cloud feedbacks in climate models. United States: N. p., 2017. Web. doi:10.5194/gmd-10-4285-2017.
Tsushima, Yoko, Brient, Florent, Klein, Stephen A., Konsta, Dimitra, Nam, Christine C., Qu, Xin, Williams, Keith D., Sherwood, Steven C., Suzuki, Kentaroh, & Zelinka, Mark D. The Cloud Feedback Model Intercomparison Project (CFMIP) Diagnostic Codes Catalogue – metrics, diagnostics and methodologies to evaluate, understand and improve the representation of clouds and cloud feedbacks in climate models. United States. doi:10.5194/gmd-10-4285-2017.
Tsushima, Yoko, Brient, Florent, Klein, Stephen A., Konsta, Dimitra, Nam, Christine C., Qu, Xin, Williams, Keith D., Sherwood, Steven C., Suzuki, Kentaroh, and Zelinka, Mark D. Mon . "The Cloud Feedback Model Intercomparison Project (CFMIP) Diagnostic Codes Catalogue – metrics, diagnostics and methodologies to evaluate, understand and improve the representation of clouds and cloud feedbacks in climate models". United States. doi:10.5194/gmd-10-4285-2017. https://www.osti.gov/servlets/purl/1438789.
@article{osti_1438789,
title = {The Cloud Feedback Model Intercomparison Project (CFMIP) Diagnostic Codes Catalogue – metrics, diagnostics and methodologies to evaluate, understand and improve the representation of clouds and cloud feedbacks in climate models},
author = {Tsushima, Yoko and Brient, Florent and Klein, Stephen A. and Konsta, Dimitra and Nam, Christine C. and Qu, Xin and Williams, Keith D. and Sherwood, Steven C. and Suzuki, Kentaroh and Zelinka, Mark D.},
abstractNote = {The CFMIP Diagnostic Codes Catalogue assembles cloud metrics, diagnostics and methodologies, together with programs to diagnose them from general circulation model (GCM) outputs written by various members of the CFMIP community. This aims to facilitate use of the diagnostics by the wider community studying climate and climate change. Here, this paper describes the diagnostics and metrics which are currently in the catalogue, together with examples of their application to model evaluation studies and a summary of some of the insights these diagnostics have provided into the main shortcomings in current GCMs. Analysis of outputs from CFMIP and CMIP6 experiments will also be facilitated by the sharing of diagnostic codes via this catalogue. Any code which implements diagnostics relevant to analysing clouds – including cloud–circulation interactions and the contribution of clouds to estimates of climate sensitivity in models – and which is documented in peer-reviewed studies, can be included in the catalogue. We very much welcome additional contributions to further support community analysis of CMIP6 outputs.},
doi = {10.5194/gmd-10-4285-2017},
journal = {Geoscientific Model Development (Online)},
number = 11,
volume = 10,
place = {United States},
year = {2017},
month = {11}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Changes in storm tracks and energy transports in a warmer climate simulated by the GFDL CM2.1 model
journal, March 2010


Midlatitude cloud shifts, their primary link to the Hadley cell, and their diverse radiative effects: Cloud Shifts and the Hadley Cell
journal, May 2016

  • Tselioudis, George; Lipat, Bernard R.; Konsta, Dimitra
  • Geophysical Research Letters, Vol. 43, Issue 9
  • DOI: 10.1002/2016GL068242

LMDZ5B: the atmospheric component of the IPSL climate model with revisited parameterizations for clouds and convection
journal, April 2012

  • Hourdin, Frédéric; Grandpeix, Jean-Yves; Rio, Catherine
  • Climate Dynamics, Vol. 40, Issue 9-10
  • DOI: 10.1007/s00382-012-1343-y

Revealing differences in GCM representations of low clouds
journal, November 2009


A quantitative performance assessment of cloud regimes in climate models
journal, August 2008


Climate change projections using the IPSL-CM5 Earth System Model: from CMIP3 to CMIP5
journal, February 2013


Robustness, uncertainties, and emergent constraints in the radiative responses of stratocumulus cloud regimes to future warming
journal, August 2015


Application of MJO Simulation Diagnostics to Climate Models
journal, December 2009


Evaluation of Clouds and Precipitation in the ECHAM5 General Circulation Model Using CALIPSO and CloudSat Satellite Data
journal, July 2012


Tropical climate described as a distribution of weather states indicated by distinct mesoscale cloud property mixtures
journal, January 2005

  • Rossow, William B.; Tselioudis, George; Polak, Allyson
  • Geophysical Research Letters, Vol. 32, Issue 21
  • DOI: 10.1029/2005GL024584

Impact of the LMDZ atmospheric grid configuration on the climate and sensitivity of the IPSL-CM5A coupled model
journal, July 2012

  • Hourdin, Frédéric; Foujols, Marie-Alice; Codron, Francis
  • Climate Dynamics, Vol. 40, Issue 9-10
  • DOI: 10.1007/s00382-012-1411-3

Review of capabilities of multi-angle and polarization cloud measurements from POLDER
journal, January 2004


The ‘too few, too bright’ tropical low-cloud problem in CMIP5 models: TOO FEW TOO BRIGHT LOW-CLOUDS
journal, November 2012

  • Nam, C.; Bony, S.; Dufresne, J. -L.
  • Geophysical Research Letters, Vol. 39, Issue 21
  • DOI: 10.1029/2012GL053421

GCM intercomparison of global cloud regimes: present-day evaluation and climate change response
journal, March 2007


Evaluating the present-day simulation of clouds, precipitation, and radiation in climate models
journal, January 2008

  • Pincus, Robert; Batstone, Crispian P.; Hofmann, Robert J. Patrick
  • Journal of Geophysical Research, Vol. 113, Issue D14
  • DOI: 10.1029/2007JD009334

The Met Office Global Coupled model 2.0 (GC2) configuration
journal, January 2015

  • Williams, K. D.; Harris, C. M.; Bodas-Salcedo, A.
  • Geoscientific Model Development, Vol. 8, Issue 5
  • DOI: 10.5194/gmd-8-1509-2015

Processes Responsible for Cloud Feedback
journal, October 2016


Particle Growth and Drop Collection Efficiency of Warm Clouds as Inferred from Joint CloudSat and MODIS Observations
journal, September 2010

  • Suzuki, Kentaroh; Nakajima, Takashi Y.; Stephens, Graeme L.
  • Journal of the Atmospheric Sciences, Vol. 67, Issue 9
  • DOI: 10.1175/2010JAS3463.1

Quantitative evaluation of the seasonal variations in climate model cloud regimes
journal, December 2012


Shallowness of tropical low clouds as a predictor of climate models’ response to warming
journal, October 2015


A comparison of simulated cloud radar output from the multiscale modeling framework global climate model with CloudSat cloud radar observations
journal, January 2009

  • Marchand, Roger; Haynes, John; Mace, Gerald G.
  • Journal of Geophysical Research, Vol. 114
  • DOI: 10.1029/2008JD009790

A More Powerful Reality Test for Climate Models
journal, May 2016


ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
journal, January 2016

  • Eyring, Veronika; Righi, Mattia; Lauer, Axel
  • Geoscientific Model Development, Vol. 9, Issue 5
  • DOI: 10.5194/gmd-9-1747-2016

The Surface Downwelling Solar Radiation Surplus over the Southern Ocean in the Met Office Model: The Role of Midlatitude Cyclone Clouds
journal, November 2012


Cloud liquid water path and radiative feedbacks over the Southern Ocean: MIDLATITUDE FEEDBACKS
journal, October 2016

  • Bodas-Salcedo, A.; Andrews, T.; Karmalkar, A. V.
  • Geophysical Research Letters, Vol. 43, Issue 20
  • DOI: 10.1002/2016GL070770

Satellite Data Simulator Unit: A Multisensor, Multispectral Satellite Simulator Package
journal, December 2010

  • Masunaga, Hirohiko; Matsui, Toshihisa; Tao, Wei-kuo
  • Bulletin of the American Meteorological Society, Vol. 91, Issue 12
  • DOI: 10.1175/2010BAMS2809.1

Observational constraints on mixed-phase clouds imply higher climate sensitivity
journal, April 2016


A consistent poleward shift of the storm tracks in simulations of 21st century climate: POLEWARD SHIFT OF THE STORM TRACKS
journal, September 2005


Erroneous Relationships among Humidity and Cloud Forcing Variables in Three Global Climate Models
journal, September 2008


Evaluation of the Warm Rain Formation Process in Global Models with Satellite Observations
journal, October 2015

  • Suzuki, Kentaroh; Stephens, Graeme; Bodas-Salcedo, Alejandro
  • Journal of the Atmospheric Sciences, Vol. 72, Issue 10
  • DOI: 10.1175/JAS-D-14-0265.1

Performance metrics for climate models
journal, January 2008

  • Gleckler, P. J.; Taylor, K. E.; Doutriaux, C.
  • Journal of Geophysical Research, Vol. 113, Issue D6
  • DOI: 10.1029/2007JD008972

Are climate model simulations of clouds improving? An evaluation using the ISCCP simulator: EVALUATING CLOUDS IN CLIMATE MODELS
journal, February 2013

  • Klein, Stephen A.; Zhang, Yuying; Zelinka, Mark D.
  • Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 3
  • DOI: 10.1002/jgrd.50141

The ERA-Interim reanalysis: configuration and performance of the data assimilation system
journal, April 2011

  • Dee, D. P.; Uppala, S. M.; Simmons, A. J.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 656
  • DOI: 10.1002/qj.828

Using a Multiphysics Ensemble for Exploring Diversity in Cloud–Shortwave Feedback in GCMs
journal, August 2012


Clouds, circulation and climate sensitivity
journal, March 2015

  • Bony, Sandrine; Stevens, Bjorn; Frierson, Dargan M. W.
  • Nature Geoscience, Vol. 8, Issue 4
  • DOI: 10.1038/ngeo2398

Mechanisms of marine low cloud sensitivity to idealized climate perturbations: A single-LES exploration extending the CGILS cases: LES OF BOUNDARY-LAYER CLOUD FEEDBACK
journal, May 2013

  • Bretherton, Christopher S.; Blossey, Peter N.; Jones, Christopher R.
  • Journal of Advances in Modeling Earth Systems, Vol. 5, Issue 2
  • DOI: 10.1002/jame.20019

Emergent Constraints for Cloud Feedbacks
journal, October 2015


Representing 3-D cloud radiation effects in two-stream schemes: 2. Matrix formulation and broadband evaluation: 3-D RADIATIVE EFFECTS: MATRIX FORMULATION
journal, July 2016

  • Hogan, Robin J.; Schäfer, Sophia A. K.; Klinger, Carolin
  • Journal of Geophysical Research: Atmospheres, Vol. 121, Issue 14
  • DOI: 10.1002/2016JD024875

Droplet Growth in Warm Water Clouds Observed by the A-Train. Part II: A Multisensor View
journal, June 2010

  • Nakajima, Takashi Y.; Suzuki, Kentaroh; Stephens, Graeme L.
  • Journal of the Atmospheric Sciences, Vol. 67, Issue 6
  • DOI: 10.1175/2010JAS3276.1

The GCM-Oriented CALIPSO Cloud Product (CALIPSO-GOCCP)
journal, January 2010

  • Chepfer, H.; Bony, S.; Winker, D.
  • Journal of Geophysical Research, Vol. 115
  • DOI: 10.1029/2009JD012251

Hadley Cell Widening: Model Simulations versus Observations
journal, May 2009


Initial performance assessment of CALIOP
journal, January 2007

  • Winker, David M.; Hunt, William H.; McGill, Matthew J.
  • Geophysical Research Letters, Vol. 34, Issue 19
  • DOI: 10.1029/2007GL030135

Process-Oriented MJO Simulation Diagnostic: Moisture Sensitivity of Simulated Convection
journal, July 2014


Hydrometeor Detection Using Cloudsat —An Earth-Orbiting 94-GHz Cloud Radar
journal, April 2008

  • Marchand, Roger; Mace, Gerald G.; Ackerman, Thomas
  • Journal of Atmospheric and Oceanic Technology, Vol. 25, Issue 4
  • DOI: 10.1175/2007JTECHA1006.1

How Well Do Coupled Models Simulate Today's Climate?
journal, March 2008

  • Reichler, Thomas; Kim, Junsu
  • Bulletin of the American Meteorological Society, Vol. 89, Issue 3
  • DOI: 10.1175/BAMS-89-3-303

High cloud increase in a perturbed SST experiment with a global nonhydrostatic model including explicit convective processes
journal, July 2014

  • Tsushima, Yoko; Iga, Shin-ichi; Tomita, Hirofumi
  • Journal of Advances in Modeling Earth Systems, Vol. 6, Issue 3
  • DOI: 10.1002/2013MS000301

An important constraint on tropical cloud - climate feedback: TROPICAL CLOUD-CLIMATE FEEDBACK
journal, October 2002

  • Hartmann, Dennis L.; Larson, Kristin
  • Geophysical Research Letters, Vol. 29, Issue 20
  • DOI: 10.1029/2002GL015835

A process oriented characterization of tropical oceanic clouds for climate model evaluation, based on a statistical analysis of daytime A-train observations
journal, September 2012

  • Konsta, Dimitra; Chepfer, Helene; Dufresne, Jean-Louis
  • Climate Dynamics, Vol. 39, Issue 9-10
  • DOI: 10.1007/s00382-012-1533-7

Reconciling Simulated and Observed Views of Clouds: MODIS, ISCCP, and the Limits of Instrument Simulators
journal, July 2012


Multimodel evaluation of cloud phase transition using satellite and reanalysis data
journal, August 2015

  • Cesana, G.; Waliser, D. E.; Jiang, X.
  • Journal of Geophysical Research: Atmospheres, Vol. 120, Issue 15
  • DOI: 10.1002/2014JD022932

Lower-Tropospheric Mixing as a Constraint on Cloud Feedback in a Multiparameter Multiphysics Ensemble
journal, September 2016

  • Kamae, Youichi; Shiogama, Hideo; Watanabe, Masahiro
  • Journal of Climate, Vol. 29, Issue 17
  • DOI: 10.1175/JCLI-D-16-0042.1

Computing and Partitioning Cloud Feedbacks Using Cloud Property Histograms. Part I: Cloud Radiative Kernels
journal, June 2012

  • Zelinka, Mark D.; Klein, Stephen A.; Hartmann, Dennis L.
  • Journal of Climate, Vol. 25, Issue 11
  • DOI: 10.1175/JCLI-D-11-00248.1

Spread in model climate sensitivity traced to atmospheric convective mixing
journal, January 2014

  • Sherwood, Steven C.; Bony, Sandrine; Dufresne, Jean-Louis
  • Nature, Vol. 505, Issue 7481
  • DOI: 10.1038/nature12829

Coupling between subtropical cloud feedback and the local hydrological cycle in a climate model
journal, December 2012


The MODIS cloud products: algorithms and examples from terra
journal, February 2003

  • Platnick, S.; King, M. D.; Ackerman, S. A.
  • IEEE Transactions on Geoscience and Remote Sensing, Vol. 41, Issue 2
  • DOI: 10.1109/TGRS.2002.808301

Use of A-train satellite observations (CALIPSO–PARASOL) to evaluate tropical cloud properties in the LMDZ5 GCM
journal, November 2015


Uncertainty in Model Climate Sensitivity Traced to Representations of Cumulus Precipitation Microphysics
journal, January 2016


Comparing clouds and their seasonal variations in 10 atmospheric general circulation models with satellite measurements
journal, January 2005


Response of the Midlatitude Jets, and of Their Variability, to Increased Greenhouse Gases in the CMIP5 Models
journal, September 2013


Constraints on Climate Sensitivity from Space-Based Measurements of Low-Cloud Reflection
journal, August 2016


On the spread of changes in marine low cloud cover in climate model simulations of the 21st century
journal, September 2013


COSP: Satellite simulation software for model assessment
journal, August 2011

  • Bodas-Salcedo, A.; Webb, M. J.; Bony, S.
  • Bulletin of the American Meteorological Society, Vol. 92, Issue 8
  • DOI: 10.1175/2011BAMS2856.1

The Cloud Feedback Model Intercomparison Project (CFMIP) contribution to CMIP6
journal, January 2017

  • Webb, Mark J.; Andrews, Timothy; Bodas-Salcedo, Alejandro
  • Geoscientific Model Development, Vol. 10, Issue 1
  • DOI: 10.5194/gmd-10-359-2017

Is climate sensitivity related to dynamical sensitivity?: Dynamical Sensitivity
journal, May 2016

  • Grise, Kevin M.; Polvani, Lorenzo M.
  • Journal of Geophysical Research: Atmospheres, Vol. 121, Issue 10
  • DOI: 10.1002/2015JD024687

An assessment of the cloud signals simulated by NICAM using ISCCP, CALIPSO, and CloudSat satellite simulators: ASSESSMENT OF CLOUD SIMULATED BY NICAM
journal, June 2012

  • Kodama, C.; Noda, A. T.; Satoh, M.
  • Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D12
  • DOI: 10.1029/2011JD017317