DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method

Abstract

Traditional trial-and-error tuning of uncertain parameters in global atmospheric general circulation models (GCMs) is time consuming and subjective. This study explores the feasibility of automatic optimization of GCM parameters for fast physics by using short-term hindcasts. An automatic workflow is described and applied to the Community Atmospheric Model (CAM5) to optimize several parameters in its cloud and convective parameterizations. We show that the auto-optimization leads to 10 % reduction of the overall bias in CAM5, which is already a well-calibrated model, based on a predefined metric that includes precipitation, temperature, humidity, and longwave/shortwave cloud forcing. The computational cost of the entire optimization procedure is about equivalent to a single 12-year atmospheric model simulation. The tuning reduces the large underestimation in the CAM5 longwave cloud forcing by decreasing the threshold relative humidity and the sedimentation velocity of ice crystals in the cloud schemes; it reduces the overestimation of precipitation by increasing the adjustment time in the convection scheme. The physical processes behind the tuned model performance for each targeted field are discussed. Limitations of the automatic tuning are described, including the slight deterioration in some targeted fields that reflect the structural errors of the model. It is pointed out that automaticmore » tuning can be a viable supplement to process-oriented model evaluations and improvement.« less

Authors:
 [1];  [2];  [3];  [4];  [5];  [2];  [6];  [7]; ORCiD logo [8];  [8];  [9]
  1. Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling. Dept. for Earth System Science; Brookhaven National Lab. (BNL), Upton, NY (United States)
  2. Stony Brook Univ., NY (United States). School of Marine and Atmospheric Sciences
  3. Brookhaven National Lab. (BNL), Upton, NY (United States)
  4. Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling. Dept. for Earth System Science
  5. Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling. Dept. for Earth System Science. Dept. of Computer Science and Technology
  6. Chinese Academy of Sciences (CAS), Beijing (China). Inst. of Atmospheric Physics
  7. China Meteorological Administration, Beijing (China). Beijing Climate Center
  8. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  9. Tsinghua Univ., Beijing (China). Dept. of Computer Science and Technology
Publication Date:
Research Org.:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Brookhaven National Laboratory (BNL), Upton, NY (United States); Stony Brook Univ., NY (United States); Tsinghua Univ., Beijing (China)
Sponsoring Org.:
USDOE Office of Science (SC), Biological and Environmental Research (BER); National Key Research and Development Program of China; National Natural Science Foundation of China (NSFC)
OSTI Identifier:
1498460
Report Number(s):
LLNL-JRNL-765387
Journal ID: ISSN 1991-9603; 955420
Grant/Contract Number:  
AC52-07NA27344; 2017YFA0604500; 2016YFA0602100; 91530323; 41776010
Resource Type:
Accepted Manuscript
Journal Name:
Geoscientific Model Development (Online)
Additional Journal Information:
Journal Name: Geoscientific Model Development (Online); Journal Volume: 11; Journal Issue: 12; Journal ID: ISSN 1991-9603
Publisher:
European Geosciences Union
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES

Citation Formats

Zhang, Tao, Zhang, Minghua, Lin, Wuyin, Lin, Yanluan, Xue, Wei, Yu, Haiyang, He, Juanxiong, Xin, Xiaoge, Ma, Hsi-Yen, Xie, Shaocheng, and Zheng, Weimin. Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method. United States: N. p., 2018. Web. doi:10.5194/gmd-11-5189-2018.
Zhang, Tao, Zhang, Minghua, Lin, Wuyin, Lin, Yanluan, Xue, Wei, Yu, Haiyang, He, Juanxiong, Xin, Xiaoge, Ma, Hsi-Yen, Xie, Shaocheng, & Zheng, Weimin. Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method. United States. https://doi.org/10.5194/gmd-11-5189-2018
Zhang, Tao, Zhang, Minghua, Lin, Wuyin, Lin, Yanluan, Xue, Wei, Yu, Haiyang, He, Juanxiong, Xin, Xiaoge, Ma, Hsi-Yen, Xie, Shaocheng, and Zheng, Weimin. Fri . "Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method". United States. https://doi.org/10.5194/gmd-11-5189-2018. https://www.osti.gov/servlets/purl/1498460.
@article{osti_1498460,
title = {Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method},
author = {Zhang, Tao and Zhang, Minghua and Lin, Wuyin and Lin, Yanluan and Xue, Wei and Yu, Haiyang and He, Juanxiong and Xin, Xiaoge and Ma, Hsi-Yen and Xie, Shaocheng and Zheng, Weimin},
abstractNote = {Traditional trial-and-error tuning of uncertain parameters in global atmospheric general circulation models (GCMs) is time consuming and subjective. This study explores the feasibility of automatic optimization of GCM parameters for fast physics by using short-term hindcasts. An automatic workflow is described and applied to the Community Atmospheric Model (CAM5) to optimize several parameters in its cloud and convective parameterizations. We show that the auto-optimization leads to 10 % reduction of the overall bias in CAM5, which is already a well-calibrated model, based on a predefined metric that includes precipitation, temperature, humidity, and longwave/shortwave cloud forcing. The computational cost of the entire optimization procedure is about equivalent to a single 12-year atmospheric model simulation. The tuning reduces the large underestimation in the CAM5 longwave cloud forcing by decreasing the threshold relative humidity and the sedimentation velocity of ice crystals in the cloud schemes; it reduces the overestimation of precipitation by increasing the adjustment time in the convection scheme. The physical processes behind the tuned model performance for each targeted field are discussed. Limitations of the automatic tuning are described, including the slight deterioration in some targeted fields that reflect the structural errors of the model. It is pointed out that automatic tuning can be a viable supplement to process-oriented model evaluations and improvement.},
doi = {10.5194/gmd-11-5189-2018},
journal = {Geoscientific Model Development (Online)},
number = 12,
volume = 11,
place = {United States},
year = {Fri Dec 21 00:00:00 EST 2018},
month = {Fri Dec 21 00:00:00 EST 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 8 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Quantifying the uncertainty in forecasts of anthropogenic climate change
journal, October 2000

  • Allen, Myles R.; Stott, Peter A.; Mitchell, John F. B.
  • Nature, Vol. 407, Issue 6804
  • DOI: 10.1038/35036559

Overview of the CALIPSO Mission and CALIOP Data Processing Algorithms
journal, November 2009

  • Winker, David M.; Vaughan, Mark A.; Omar, Ali
  • Journal of Atmospheric and Oceanic Technology, Vol. 26, Issue 11
  • DOI: 10.1175/2009JTECHA1281.1

Review of Metamodeling Techniques in Support of Engineering Design Optimization
journal, May 2006

  • Wang, G. Gary; Shan, S.
  • Journal of Mechanical Design, Vol. 129, Issue 4
  • DOI: 10.1115/1.2429697

A modified formulation of fractional stratiform condensation rate in the NCAR Community Atmospheric Model (CAM2)
journal, January 2003


Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models
journal, January 2008

  • Iacono, Michael J.; Delamere, Jennifer S.; Mlawer, Eli J.
  • Journal of Geophysical Research, Vol. 113, Issue D13
  • DOI: 10.1029/2008JD009944

Earth's Global Energy Budget
journal, March 2009

  • Trenberth, Kevin E.; Fasullo, John T.; Kiehl, Jeffrey
  • Bulletin of the American Meteorological Society, Vol. 90, Issue 3
  • DOI: 10.1175/2008BAMS2634.1

Efficient screening of climate model sensitivity to a large number of perturbed input parameters: PERTURBED INPUT-PARAMETER SENSITIVITY
journal, July 2013

  • Covey, Curt; Lucas, Donald D.; Tannahill, John
  • Journal of Advances in Modeling Earth Systems, Vol. 5, Issue 3
  • DOI: 10.1002/jame.20040

Climate Model Forecast Experiments for TOGA COARE
journal, March 2008


Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES)
journal, March 2003

  • Hansen, Nikolaus; Müller, Sibylle D.; Koumoutsakos, Petros
  • Evolutionary Computation, Vol. 11, Issue 1
  • DOI: 10.1162/106365603321828970

Short ensembles: an efficient method for discerning climate-relevant sensitivities in atmospheric general circulation models
journal, January 2014


On closure parameter estimation in chaotic systems
journal, January 2012

  • Hakkarainen, J.; Ilin, A.; Solonen, A.
  • Nonlinear Processes in Geophysics, Vol. 19, Issue 1
  • DOI: 10.5194/npg-19-127-2012

THE CLOUDSAT MISSION AND THE A-TRAIN: A New Dimension of Space-Based Observations of Clouds and Precipitation
journal, December 2002

  • Stephens, Graeme L.; Vane, Deborah G.; Boain, Ronald J.
  • Bulletin of the American Meteorological Society, Vol. 83, Issue 12
  • DOI: 10.1175/BAMS-83-12-1771

Considerations for parameter optimization and sensitivity in climate models
journal, November 2010

  • Neelin, J. D.; Bracco, A.; Luo, H.
  • Proceedings of the National Academy of Sciences, Vol. 107, Issue 50
  • DOI: 10.1073/pnas.1015473107

Analysis and Reduction of Systematic Errors through a Seamless Approach to Modeling Weather and Climate
journal, November 2010

  • Martin, G. M.; Milton, S. F.; Senior, C. A.
  • Journal of Climate, Vol. 23, Issue 22
  • DOI: 10.1175/2010jcli3541.1

Performance metrics for climate models
journal, January 2008

  • Gleckler, P. J.; Taylor, K. E.; Doutriaux, C.
  • Journal of Geophysical Research, Vol. 113, Issue D6
  • DOI: 10.1029/2007JD008972

An evaluation of adaptive surrogate modeling based optimization with two benchmark problems
journal, October 2014


Evaluation of Climate Models
book, January 2014


An automatic and effective parameter optimization method for model tuning
journal, January 2015


Modelling climate change: the role of unresolved processes
journal, October 2005

  • Williams, Paul D.
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 363, Issue 1837
  • DOI: 10.1098/rsta.2005.1676

Evaluation of grid-point atmospheric model of IAP LASG version 2 (GAMIL2)
journal, April 2013


Quantification of modelling uncertainties in a large ensemble of climate change simulations
journal, August 2004

  • Murphy, James M.; Sexton, David M. H.; Barnett, David N.
  • Nature, Vol. 430, Issue 7001
  • DOI: 10.1038/nature02771

A New Moist Turbulence Parameterization in the Community Atmosphere Model
journal, June 2009


Climate statistics from the National Center for Atmospheric Research community climate model CCM2
journal, January 1994

  • Hack, J. J.; Boville, B. A.; Kiehl, J. T.
  • Journal of Geophysical Research, Vol. 99, Issue D10
  • DOI: 10.1029/94JD01570

Efficient Global Optimization of Expensive Black-Box Functions
journal, January 1998

  • Jones, Donald R.; Schonlau, Matthias; Welch, William J.
  • Journal of Global Optimization, Vol. 13, Issue 4, p. 455-492
  • DOI: 10.1023/A:1008306431147

Parameterization improvements and functional and structural advances in Version 4 of the Community Land Model: PARAMETERIZATION IMPROVEMENTS AND FUNCTIONAL AND STRUCTURAL ADVANCES
journal, January 2011

  • Lawrence, David M.; Oleson, Keith W.; Flanner, Mark G.
  • Journal of Advances in Modeling Earth Systems, Vol. 3, Issue 1
  • DOI: 10.1029/2011MS00045

A “Vertically Lagrangian” Finite-Volume Dynamical Core for Global Models
journal, October 2004


Multidimensional Flux-Form Semi-Lagrangian Transport Schemes
journal, September 1996


Metrics and Diagnostics for Precipitation-Related Processes in Climate Model Short-Range Hindcasts
journal, March 2013


On the Correspondence between Mean Forecast Errors and Climate Errors in CMIP5 Models
journal, February 2014


Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave
journal, July 1997

  • Mlawer, Eli J.; Taubman, Steven J.; Brown, Patrick D.
  • Journal of Geophysical Research: Atmospheres, Vol. 102, Issue D14
  • DOI: 10.1029/97JD00237

The Impact of Convection on ENSO: From a Delayed Oscillator to a Series of Events
journal, November 2008

  • Neale, Richard B.; Richter, Jadwiga H.; Jochum, Markus
  • Journal of Climate, Vol. 21, Issue 22
  • DOI: 10.1175/2008JCLI2244.1

Integrating Cloud Processes in the Community Atmosphere Model, Version 5
journal, September 2014

  • Park, Sungsu; Bretherton, Christopher S.; Rasch, Philip J.
  • Journal of Climate, Vol. 27, Issue 18
  • DOI: 10.1175/JCLI-D-14-00087.1

Parametric sensitivity analysis of precipitation at global and local scales in the Community Atmosphere Model CAM5
journal, April 2015

  • Qian, Yun; Yan, Huiping; Hou, Zhangshuan
  • Journal of Advances in Modeling Earth Systems, Vol. 7, Issue 2
  • DOI: 10.1002/2014MS000354

Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century
journal, January 2003


How Well Do Coupled Models Simulate Today's Climate?
journal, March 2008

  • Reichler, Thomas; Kim, Junsu
  • Bulletin of the American Meteorological Society, Vol. 89, Issue 3
  • DOI: 10.1175/BAMS-89-3-303

Effects of Convective Momentum Transport on the Atmospheric Circulation in the Community Atmosphere Model, Version 3
journal, April 2008


Summarizing multiple aspects of model performance in a single diagram
journal, April 2001

  • Taylor, Karl E.
  • Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
  • DOI: 10.1029/2000JD900719

Initial Tendencies of Cloud Regimes in the Met Office Unified Model
journal, February 2008


On the Correspondence between Short- and Long-Time-Scale Systematic Errors in CAM4/CAM5 for the Year of Tropical Convection
journal, November 2012


Coherent response of the Indian Monsoon Rainfall to Atlantic Multi-decadal Variability over the last 2000 years
journal, January 2020

  • Naidu, Pothuri Divakar; Ganeshram, Raja; Bollasina, Massimo A.
  • Scientific Reports, Vol. 10, Issue 1
  • DOI: 10.1038/s41598-020-58265-3

Review of Metamodeling Techniques in Support of Engineering Design Optimization
conference, June 2008

  • Wang, G. Gary; Shan, S.
  • ASME 2006 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Volume 1: 32nd Design Automation Conference, Parts A and B
  • DOI: 10.1115/detc2006-99412

A sensitivity study of radiative fluxes at the top of atmosphere to cloud-microphysics and aerosol parameters in the Community Atmosphere Model CAM5
journal, January 2013


Quantifying the uncertainty in forecasts of anthropogenic climate change
journal, October 2000

  • Allen, Myles R.; Stott, Peter A.; Mitchell, John F. B.
  • Nature, Vol. 407, Issue 6804
  • DOI: 10.1038/35036559

Considerations for parameter optimization and sensitivity in climate models
journal, November 2010

  • Neelin, J. D.; Bracco, A.; Luo, H.
  • Proceedings of the National Academy of Sciences, Vol. 107, Issue 50
  • DOI: 10.1073/pnas.1015473107

Supplement to How Well Do Coupled Models Simulate Today's Climate?
journal, March 2008