skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Characterizing the Relative Importance Assigned to Physical Variables by Climate Scientists when Assessing Atmospheric Climate Model Fidelity

Journal Article · · Advances in Atmospheric Sciences

Evaluating a climate model’s fidelity – its ability to simulate the observed climate – is a critical step in establishing confidence in the model’s suitability for future climate projections. Because the criteria used by climate modelers in evaluating simulation fidelity are not always documented in a manner that is accessible to model users, and the transfer and dissemination of this expertise to new scientists entering the field is inefficient. Here we report results from a broad community survey studying one aspect of the criteria used in climate model evaluation – the relative importance of different variables in evaluating a global atmospheric model’s mean climate – with respect to several different science goals. Opinions on variable importance are diverse, although there is greater consensus on some variables (e.g., short-wave cloud forcing) than others (e.g., aerosol optical depth). For most variables, consensus does not change significantly with greater climate modelling experience, demonstrating that the establishment of objective criteria for climate model evaluation is still an area of active research. For each science goal, we report community mean importance ratings of selected model variables. Experts adjust their ratings of variable importance in response to the science objective, for instance, rating surface wind stress as significantly more important for Southern Ocean climate than for the water cycle in the Asian watershed. The concise variable lists and community ratings reported here provide a snapshot of current expert understanding of certain aspects of model evaluation, and can serve as a starting point for developing more sophisticated evaluation and scoring criteria with respect to specific scientific objectives.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
AC05-76RL01830
OSTI ID:
1459662
Alternate ID(s):
OSTI ID: 1510431
Report Number(s):
PNNL-SA-129346; PII: 7300
Journal Information:
Advances in Atmospheric Sciences, Vol. 35, Issue 9; ISSN 0256-1530
Publisher:
SpringerCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 5 works
Citation information provided by
Web of Science

References (21)

Aerosols implicated as a prime driver of twentieth-century North Atlantic climate variability journal April 2012
Uncertainty Quantification in Climate Modeling and Projection journal May 2016
Limitations of passive remote sensing to constrain global cloud condensation nuclei journal January 2016
A climate model projection weighting scheme accounting for performance and interdependence: Model Projection Weighting Scheme journal January 2017
Improving our fundamental understanding of the role of aerosol−cloud interactions in the climate system journal May 2016
Selecting a climate model subset to optimise key ensemble properties journal January 2018
Climate Change 2013 – The Physical Science Basis book March 2014
Measuring Agreement about Ranked Decision Choices for a Single Subject journal January 2009
Performance metrics for climate models journal January 2008
Uncertain then, irrelevant now journal November 2013
How Well Do Coupled Models Simulate Today's Climate? journal March 2008
Parametric sensitivity analysis of precipitation at global and local scales in the Community Atmosphere Model CAM5 journal April 2015
The Art and Science of Climate Model Tuning journal March 2017
A likelihood-based comparison of temporal models for physical processes journal April 2011
An automatic and effective parameter optimization method for model tuning journal January 2015
A Bayesian approach to climate model evaluation and multi-model averaging with an application to global mean surface temperatures from IPCC AR4 coupled climate models journal January 2006
An Evaluation of Decadal Probability Forecasts from State-of-the-Art Climate Models journal December 2013
A new test statistic for climate models that includes field and spatial dependencies using Gaussian Markov random fields journal January 2016
Uncertainty quantification and parameter tuning in the CAM5 Zhang-McFarlane convection scheme and impact of improved convection on the global circulation and climate: PARAMETERS TUNING IN CAM5 AND ITS IMPACT journal January 2013
A climate model projection weighting scheme accounting for performance and interdependence text January 2017
Selecting a climate model subset to optimise key ensemble properties text January 2018