skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Art and Science of Climate Model Tuning

Abstract

The process of parameter estimation targeting a chosen set of observations is an essential aspect of numerical modeling. This process is usually named tuning in the climate modeling community. In climate models, the variety and complexity of physical processes involved, and their interplay through a wide range of spatial and temporal scales, must be summarized in a series of approximate submodels. Most submodels depend on uncertain parameters. Tuning consists of adjusting the values of these parameters to bring the solution as a whole into line with aspects of the observed climate. Tuning is an essential aspect of climate modeling with its own scientific issues, which is probably not advertised enough outside the community of model developers. Optimization of climate models raises important questions about whether tuning methods a priori constrain the model results in unintended ways that would affect our confidence in climate projections. Here, we present the definition and rationale behind model tuning, review specific methodological aspects, and survey the diversity of tuning approaches used in current climate models. We also discuss the challenges and opportunities in applying so-called objective methods in climate model tuning. Here, we discuss how tuning methodologies may affect fundamental results of climate models, suchmore » as climate sensitivity. The article concludes with a series of recommendations to make the process of climate model tuning more transparent.« less

Authors:
 [1];  [2];  [3];  [4];  [5];  [6];  [7];  [6];  [8];  [9];  [2];  [1];  [2];  [10];  [11]
  1. Lab. de Meteorologie Dynamique, Paris (France)
  2. Max Planck Institute for Meteorology, Hamburg (Germany)
  3. National Center for Atmospheric Research, Boulder, CO (United States)
  4. National Oceanic and Atmospheric Administration/Geophysical Fluid Dynamics Lab., Princeton, NJ (United States)
  5. Princeton Univ., Princeton, NJ (United States)
  6. Beijing Normal Univ., Beijing (China)
  7. Eidgenossische Technische Hochschule, Zurich (Switzerland)
  8. Deutscher Wetterdienst, Offenbach (Germany)
  9. Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
  10. Univ. of Tokyo, Tokyo (Japan)
  11. Univ. of Exeter, Exeter (United Kingdom)
Publication Date:
Research Org.:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1366951
Report Number(s):
LLNL-JRNL-680477
Journal ID: ISSN 0003-0007
Grant/Contract Number:  
AC52-07NA27344
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Bulletin of the American Meteorological Society
Additional Journal Information:
Journal Volume: 98; Journal Issue: 3; Journal ID: ISSN 0003-0007
Publisher:
American Meteorological Society
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; 58 GEOSCIENCES; 97 MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE

Citation Formats

Hourdin, Frederic, Mauritsen, Thorsten, Gettelman, Andrew, Golaz, Jean -Christophe, Balaji, Venkatramani, Duan, Qingyun, Folini, Doris, Ji, Duoying, Klocke, Daniel, Qian, Yun, Rauser, Florian, Rio, Catherine, Tomassini, Lorenzo, Watanabe, Masahiro, and Williamson, Daniel. The Art and Science of Climate Model Tuning. United States: N. p., 2017. Web. doi:10.1175/BAMS-D-15-00135.1.
Hourdin, Frederic, Mauritsen, Thorsten, Gettelman, Andrew, Golaz, Jean -Christophe, Balaji, Venkatramani, Duan, Qingyun, Folini, Doris, Ji, Duoying, Klocke, Daniel, Qian, Yun, Rauser, Florian, Rio, Catherine, Tomassini, Lorenzo, Watanabe, Masahiro, & Williamson, Daniel. The Art and Science of Climate Model Tuning. United States. https://doi.org/10.1175/BAMS-D-15-00135.1
Hourdin, Frederic, Mauritsen, Thorsten, Gettelman, Andrew, Golaz, Jean -Christophe, Balaji, Venkatramani, Duan, Qingyun, Folini, Doris, Ji, Duoying, Klocke, Daniel, Qian, Yun, Rauser, Florian, Rio, Catherine, Tomassini, Lorenzo, Watanabe, Masahiro, and Williamson, Daniel. 2017. "The Art and Science of Climate Model Tuning". United States. https://doi.org/10.1175/BAMS-D-15-00135.1. https://www.osti.gov/servlets/purl/1366951.
@article{osti_1366951,
title = {The Art and Science of Climate Model Tuning},
author = {Hourdin, Frederic and Mauritsen, Thorsten and Gettelman, Andrew and Golaz, Jean -Christophe and Balaji, Venkatramani and Duan, Qingyun and Folini, Doris and Ji, Duoying and Klocke, Daniel and Qian, Yun and Rauser, Florian and Rio, Catherine and Tomassini, Lorenzo and Watanabe, Masahiro and Williamson, Daniel},
abstractNote = {The process of parameter estimation targeting a chosen set of observations is an essential aspect of numerical modeling. This process is usually named tuning in the climate modeling community. In climate models, the variety and complexity of physical processes involved, and their interplay through a wide range of spatial and temporal scales, must be summarized in a series of approximate submodels. Most submodels depend on uncertain parameters. Tuning consists of adjusting the values of these parameters to bring the solution as a whole into line with aspects of the observed climate. Tuning is an essential aspect of climate modeling with its own scientific issues, which is probably not advertised enough outside the community of model developers. Optimization of climate models raises important questions about whether tuning methods a priori constrain the model results in unintended ways that would affect our confidence in climate projections. Here, we present the definition and rationale behind model tuning, review specific methodological aspects, and survey the diversity of tuning approaches used in current climate models. We also discuss the challenges and opportunities in applying so-called objective methods in climate model tuning. Here, we discuss how tuning methodologies may affect fundamental results of climate models, such as climate sensitivity. The article concludes with a series of recommendations to make the process of climate model tuning more transparent.},
doi = {10.1175/BAMS-D-15-00135.1},
url = {https://www.osti.gov/biblio/1366951}, journal = {Bulletin of the American Meteorological Society},
issn = {0003-0007},
number = 3,
volume = 98,
place = {United States},
year = {Fri Mar 31 00:00:00 EDT 2017},
month = {Fri Mar 31 00:00:00 EDT 2017}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 279 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

An evaluation of neutral and convective planetary boundary-layer parameterizations relative to large eddy simulations
journal, April 1996


Objective calibration of regional climate models: OBJECTIVE CALIBRATION OF RCMS
journal, December 2012


On dynamic and thermodynamic components of cloud changes
journal, March 2004


Interpretation of Cloud-Climate Feedback as Produced by 14 Atmospheric General Circulation Models
journal, August 1989


Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments
journal, December 1991


History and Epistemology of Models: Meteorology (1946-1963) as a Case Study
journal, April 2001


Precalibrating an intermediate complexity climate model
journal, October 2010


On the Mathematical Foundations of Theoretical Statistics
journal, January 1922


Evaluating adjusted forcing and model spread for historical and future scenarios in the CMIP5 generation of climate models: FORCING IN CMIP5 CLIMATE MODELS
journal, February 2013


The Evolution of Climate Sensitivity and Climate Feedbacks in the Community Atmosphere Model
journal, March 2012


Cloud tuning in a coupled climate model: Impact on 20th century warming: CLOUD TUNING AND 20TH CENTURY WARMING
journal, March 2013


Efficacy of climate forcings
journal, January 2005


The Gap between Simulation and Understanding in Climate Modeling
journal, November 2005


Impact of the LMDZ atmospheric grid configuration on the climate and sensitivity of the IPSL-CM5A coupled model
journal, July 2012


LMDZ5B: the atmospheric component of the IPSL climate model with revisited parameterizations for clouds and convection
journal, April 2012


Error Reduction and Convergence in Climate Prediction
journal, December 2008


Bayesian calibration of computer models
journal, August 2001


Twentieth century climate model response and climate sensitivity
journal, January 2007


The Tropical Subseasonal Variability Simulated in the NASA GISS General Circulation Model
journal, July 2012


Process-Oriented MJO Simulation Diagnostic: Moisture Sensitivity of Simulated Convection
journal, July 2014


The Observed State of the Energy Budget in the Early Twenty-First Century
journal, November 2015


Hierarchical modelling of tropical convective systems using explicit and parametrized approaches
journal, January 2001


Toward Optimal Closure of the Earth's Top-of-Atmosphere Radiation Budget
journal, February 2009


The origins of computer weather prediction and climate modeling
journal, March 2008


Tuning the climate of a global model: TUNING THE CLIMATE OF A GLOBAL MODEL
journal, March 2012


Quantification of modelling uncertainties in a large ensemble of climate change simulations
journal, August 2004


Considerations for parameter optimization and sensitivity in climate models
journal, November 2010


How well must climate models agree with observations?
journal, October 2015


The general circulation of the atmosphere: A numerical experiment
journal, April 1956


Parametric sensitivity analysis of precipitation at global and local scales in the Community Atmosphere Model CAM5
journal, April 2015


Design and Analysis of Computer Experiments
journal, November 1989


Configuration and assessment of the GISS ModelE2 contributions to the CMIP5 archive: GISS MODEL-E2 CMIP5 SIMULATIONS
journal, March 2014


Multivariate probabilistic projections using imperfect climate models part I: outline of methodology
journal, November 2011


Evaluating cloud tuning in a climate model with satellite observations: EVALUATION OF CLOUD TUNING
journal, August 2013


The use of the multi-model ensemble in probabilistic climate projections
journal, June 2007

  • Tebaldi, Claudia; Knutti, Reto
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 365, Issue 1857
  • https://doi.org/10.1098/rsta.2007.2076

Fast linked analyses for scenario-based hierarchies
journal, May 2012


History matching for exploring and reducing climate model parameter space using observations and a large perturbed physics ensemble
journal, August 2013


Identifying and removing structural biases in climate models with history matching
journal, October 2014


Technical Note: On the use of nudging for aerosol–climate model intercomparison studies
journal, January 2014


An automatic and effective parameter optimization method for model tuning
journal, January 2015


Works referencing / citing this record:

Assessing Parameter Importance of the Weather Research and Forecasting Model Based On Global Sensitivity Analysis Methods
journal, May 2018


A comparison of statistical emulation methodologies for multi‐wave calibration of environmental models
journal, September 2016


Discrepancies with satellite observations in the spatial structure of global precipitation as derived from global climate models
journal, November 2018

  • Tapiador, Francisco J.; Navarro, Andrés; Jiménez, Alfonso
  • Quarterly Journal of the Royal Meteorological Society, Vol. 144, Issue S1
  • https://doi.org/10.1002/qj.3289

How does knowledge of atmospheric gravity waves guide their parameterizations?
journal, February 2020

  • Plougonven, Riwal; la Cámara, Alvaro; Hertzog, Albert
  • Quarterly Journal of the Royal Meteorological Society, Vol. 146, Issue 728
  • https://doi.org/10.1002/qj.3732

Characterizing the Relative Importance Assigned to Physical Variables by Climate Scientists when Assessing Atmospheric Climate Model Fidelity
journal, July 2018


Impact of chlorophyll bias on the tropical Pacific mean climate in an earth system model
journal, December 2017


Inter-hemispheric differences in energy budgets and cross-equatorial transport anomalies during the 20th century
journal, December 2018


Finding plausible and diverse variants of a climate model. Part II: development and validation of methodology
journal, February 2019


Climate sensitivity, agricultural productivity and the social cost of carbon in FUND
journal, January 2020


The Radiative Forcing of Aerosol–Cloud Interactions in Liquid Clouds: Wrestling and Embracing Uncertainty
journal, February 2018


Ongoing Breakthroughs in Convective Parameterization
journal, April 2019


Epistemology and Politics in Earth System Modeling: Historical Perspectives
journal, May 2019


New Cloud System Metrics to Assess Bulk Ice Cloud Schemes in a GCM
journal, October 2019


Uncertainty in the Representation of Orography in Weather and Climate Models and Implications for Parameterized Drag
journal, August 2019


Beyond equilibrium climate sensitivity
journal, September 2017


Reassessment of pre-industrial fire emissions strongly affects anthropogenic aerosol forcing
journal, August 2018


Critical Southern Ocean climate model biases traced to atmospheric model cloud errors
journal, September 2018


Taking climate model evaluation to the next level
journal, January 2019


Striking stationarity of large-scale climate model bias patterns under strong climate change
journal, September 2018


Deep learning to represent subgrid processes in climate models
journal, September 2018


Uncertainty Quantification for Computer Models With Spatial Output Using Calibration-Optimal Bases
journal, September 2018


A short review of numerical cloud-resolving models
journal, January 2017


Bias patterns and climate change signals in GCM-RCM model chains
journal, July 2018


Guess-Work and Reasonings on Centennial Evolution of Surface Air Temperature in Russia. Part V: Stability Margin Towards Emergency
journal, May 2019


How parameter specification of an Earth system model of intermediate complexity influences its climate simulations
journal, June 2019


The importance of comprehensive parameter sampling and multiple observations for robust constraint of aerosol radiative forcing
journal, January 2018


Quantifying uncertainty from aerosol and atmospheric parameters and their impact on climate sensitivity
journal, January 2018


Aerosol and physical atmosphere model parameters are both important sources of uncertainty in aerosol ERF
journal, January 2018


Inter-model comparison of global hydroxyl radical (OH) distributions and their impact on atmospheric methane over the 2000–2016 period
journal, January 2019


Long-term Surface Temperature (LoST) database as a complement for GCM preindustrial simulations
journal, January 2019


A radiative-convective model based on constrained maximum entropy production
journal, January 2019


ESD Reviews: Model dependence in multi-model climate ensembles: weighting, sub-selection and out-of-sample testing
journal, January 2019


Towards improved and more routine Earth system model evaluation in CMIP
journal, January 2016


Practice and philosophy of climate model tuning across six US modeling centers
journal, January 2017


The chemistry–climate model ECHAM6.3-HAM2.3-MOZ1.0
journal, January 2018


Automated model optimisation using the Cylc workflow engine (Cyclops v1.0)
journal, January 2018


The NUIST Earth System Model (NESM) version 3: description and preliminary evaluation
journal, January 2018


Climate model configurations of the ECMWF Integrated Forecasting System (ECMWF-IFS cycle 43r1) for HighResMIP
journal, January 2018


An EC-Earth coupled atmosphere–ocean single-column model (AOSCM.v1_EC-Earth3) for studying coupled marine and polar processes
journal, January 2018


The Met Office Unified Model Global Atmosphere 7.0/7.1 and JULES Global Land 7.0 configurations
journal, January 2019


Description and basic evaluation of simulated mean state, internal variability, and climate sensitivity in MIROC6
journal, January 2019


The global aerosol–climate model ECHAM6.3–HAM2.3 – Part 2: Cloud evaluation, aerosol radiative forcing, and climate sensitivity
journal, January 2019


TheDiaTo (v1.0) – a new diagnostic tool for water, energy and entropy budgets in climate models
journal, January 2019


Sensitivity studies with the regional climate model COSMO-CLM 5.0 over the CORDEX Central Asia Domain
journal, January 2019


Surface mass balance downscaling through elevation classes in an Earth system model: application to the Greenland ice sheet
journal, January 2019


Sensitivity studies with the regional climate model COSMO-CLM 5.0 over the CORDEX Central Asia Domain
text, January 2019


Bias patterns and climate change signals in GCM-RCM model chains
text, January 2018


Taking climate model evaluation to the next level
text, January 2019


Automated model optimisation using the Cylc workflow engine (Cyclops v1.0)
posted_content, September 2017


Deep learning to represent subgrid processes in climate models
text, January 2018


Sensitivity studies with the regional climate model COSMO-CLM 5.0 over the CORDEX Central Asia Domain
text, January 2019


Beyond equilibrium climate sensitivity
text, January 2017


The chemistry-climate model ECHAM6.3-HAM2.3-MOZ1.0
text, January 2018


The Chemistry Climate Model ECHAM6.3-HAM2.3-MOZ1.0
journal, November 2017


Effects of snow grain shape on climate simulations: sensitivity tests with the Norwegian Earth System Model
journal, January 2017