Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method
Abstract
Traditional trial-and-error tuning of uncertain parameters in global atmospheric general circulation models (GCMs) is time consuming and subjective. This study explores the feasibility of automatic optimization of GCM parameters for fast physics by using short-term hindcasts. An automatic workflow is described and applied to the Community Atmospheric Model (CAM5) to optimize several parameters in its cloud and convective parameterizations. We show that the auto-optimization leads to 10 % reduction of the overall bias in CAM5, which is already a well-calibrated model, based on a predefined metric that includes precipitation, temperature, humidity, and longwave/shortwave cloud forcing. The computational cost of the entire optimization procedure is about equivalent to a single 12-year atmospheric model simulation. The tuning reduces the large underestimation in the CAM5 longwave cloud forcing by decreasing the threshold relative humidity and the sedimentation velocity of ice crystals in the cloud schemes; it reduces the overestimation of precipitation by increasing the adjustment time in the convection scheme. The physical processes behind the tuned model performance for each targeted field are discussed. Limitations of the automatic tuning are described, including the slight deterioration in some targeted fields that reflect the structural errors of the model. It is pointed out that automaticmore »
- Authors:
-
- Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling. Dept. for Earth System Science; Brookhaven National Lab. (BNL), Upton, NY (United States)
- Stony Brook Univ., NY (United States). School of Marine and Atmospheric Sciences
- Brookhaven National Lab. (BNL), Upton, NY (United States)
- Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling. Dept. for Earth System Science
- Tsinghua Univ., Beijing (China). Ministry of Education Key Lab. for Earth System Modeling. Dept. for Earth System Science. Dept. of Computer Science and Technology
- Chinese Academy of Sciences (CAS), Beijing (China). Inst. of Atmospheric Physics
- China Meteorological Administration, Beijing (China). Beijing Climate Center
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Tsinghua Univ., Beijing (China). Dept. of Computer Science and Technology
- Publication Date:
- Research Org.:
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Brookhaven National Laboratory (BNL), Upton, NY (United States); Stony Brook Univ., NY (United States); Tsinghua Univ., Beijing (China)
- Sponsoring Org.:
- USDOE Office of Science (SC), Biological and Environmental Research (BER); National Key Research and Development Program of China; National Natural Science Foundation of China (NSFC)
- OSTI Identifier:
- 1498460
- Report Number(s):
- LLNL-JRNL-765387
Journal ID: ISSN 1991-9603; 955420
- Grant/Contract Number:
- AC52-07NA27344; 2017YFA0604500; 2016YFA0602100; 91530323; 41776010
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Geoscientific Model Development (Online)
- Additional Journal Information:
- Journal Name: Geoscientific Model Development (Online); Journal Volume: 11; Journal Issue: 12; Journal ID: ISSN 1991-9603
- Publisher:
- European Geosciences Union
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES
Citation Formats
Zhang, Tao, Zhang, Minghua, Lin, Wuyin, Lin, Yanluan, Xue, Wei, Yu, Haiyang, He, Juanxiong, Xin, Xiaoge, Ma, Hsi-Yen, Xie, Shaocheng, and Zheng, Weimin. Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method. United States: N. p., 2018.
Web. doi:10.5194/gmd-11-5189-2018.
Zhang, Tao, Zhang, Minghua, Lin, Wuyin, Lin, Yanluan, Xue, Wei, Yu, Haiyang, He, Juanxiong, Xin, Xiaoge, Ma, Hsi-Yen, Xie, Shaocheng, & Zheng, Weimin. Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method. United States. https://doi.org/10.5194/gmd-11-5189-2018
Zhang, Tao, Zhang, Minghua, Lin, Wuyin, Lin, Yanluan, Xue, Wei, Yu, Haiyang, He, Juanxiong, Xin, Xiaoge, Ma, Hsi-Yen, Xie, Shaocheng, and Zheng, Weimin. Fri .
"Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method". United States. https://doi.org/10.5194/gmd-11-5189-2018. https://www.osti.gov/servlets/purl/1498460.
@article{osti_1498460,
title = {Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method},
author = {Zhang, Tao and Zhang, Minghua and Lin, Wuyin and Lin, Yanluan and Xue, Wei and Yu, Haiyang and He, Juanxiong and Xin, Xiaoge and Ma, Hsi-Yen and Xie, Shaocheng and Zheng, Weimin},
abstractNote = {Traditional trial-and-error tuning of uncertain parameters in global atmospheric general circulation models (GCMs) is time consuming and subjective. This study explores the feasibility of automatic optimization of GCM parameters for fast physics by using short-term hindcasts. An automatic workflow is described and applied to the Community Atmospheric Model (CAM5) to optimize several parameters in its cloud and convective parameterizations. We show that the auto-optimization leads to 10 % reduction of the overall bias in CAM5, which is already a well-calibrated model, based on a predefined metric that includes precipitation, temperature, humidity, and longwave/shortwave cloud forcing. The computational cost of the entire optimization procedure is about equivalent to a single 12-year atmospheric model simulation. The tuning reduces the large underestimation in the CAM5 longwave cloud forcing by decreasing the threshold relative humidity and the sedimentation velocity of ice crystals in the cloud schemes; it reduces the overestimation of precipitation by increasing the adjustment time in the convection scheme. The physical processes behind the tuned model performance for each targeted field are discussed. Limitations of the automatic tuning are described, including the slight deterioration in some targeted fields that reflect the structural errors of the model. It is pointed out that automatic tuning can be a viable supplement to process-oriented model evaluations and improvement.},
doi = {10.5194/gmd-11-5189-2018},
journal = {Geoscientific Model Development (Online)},
number = 12,
volume = 11,
place = {United States},
year = {Fri Dec 21 00:00:00 EST 2018},
month = {Fri Dec 21 00:00:00 EST 2018}
}
Web of Science
Works referenced in this record:
Quantifying the uncertainty in forecasts of anthropogenic climate change
journal, October 2000
- Allen, Myles R.; Stott, Peter A.; Mitchell, John F. B.
- Nature, Vol. 407, Issue 6804
Overview of the CALIPSO Mission and CALIOP Data Processing Algorithms
journal, November 2009
- Winker, David M.; Vaughan, Mark A.; Omar, Ali
- Journal of Atmospheric and Oceanic Technology, Vol. 26, Issue 11
Review of Metamodeling Techniques in Support of Engineering Design Optimization
journal, May 2006
- Wang, G. Gary; Shan, S.
- Journal of Mechanical Design, Vol. 129, Issue 4
A modified formulation of fractional stratiform condensation rate in the NCAR Community Atmospheric Model (CAM2)
journal, January 2003
- Zhang, Minghua
- Journal of Geophysical Research, Vol. 108, Issue D1
Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models
journal, January 2008
- Iacono, Michael J.; Delamere, Jennifer S.; Mlawer, Eli J.
- Journal of Geophysical Research, Vol. 113, Issue D13
Earth's Global Energy Budget
journal, March 2009
- Trenberth, Kevin E.; Fasullo, John T.; Kiehl, Jeffrey
- Bulletin of the American Meteorological Society, Vol. 90, Issue 3
Efficient screening of climate model sensitivity to a large number of perturbed input parameters: PERTURBED INPUT-PARAMETER SENSITIVITY
journal, July 2013
- Covey, Curt; Lucas, Donald D.; Tannahill, John
- Journal of Advances in Modeling Earth Systems, Vol. 5, Issue 3
Climate Model Forecast Experiments for TOGA COARE
journal, March 2008
- Boyle, J.; Klein, S.; Zhang, G.
- Monthly Weather Review, Vol. 136, Issue 3
Diagnosis of the summertime warm and dry bias over the U.S. Southern Great Plains in the GFDL climate model using a weather forecasting approach: GFDL CLIMATE MODEL SUMMERTIME BIAS
journal, September 2006
- Klein, Stephen A.; Jiang, Xianan; Boyle, Jim
- Geophysical Research Letters, Vol. 33, Issue 18
Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES)
journal, March 2003
- Hansen, Nikolaus; Müller, Sibylle D.; Koumoutsakos, Petros
- Evolutionary Computation, Vol. 11, Issue 1
Sensitivity of climate simulations to the parameterization of cumulus convection in the Canadian climate centre general circulation model
journal, September 1995
- Zhang, G. J.; McFarlane, Norman A.
- Atmosphere-Ocean, Vol. 33, Issue 3
Short ensembles: an efficient method for discerning climate-relevant sensitivities in atmospheric general circulation models
journal, January 2014
- Wan, H.; Rasch, P. J.; Zhang, K.
- Geoscientific Model Development, Vol. 7, Issue 5
Impact of a revised convective triggering mechanism on Community Atmosphere Model, Version 2, simulations: Results from short-range weather forecasts
journal, January 2004
- Xie, Shaocheng
- Journal of Geophysical Research, Vol. 109, Issue D14
On closure parameter estimation in chaotic systems
journal, January 2012
- Hakkarainen, J.; Ilin, A.; Solonen, A.
- Nonlinear Processes in Geophysics, Vol. 19, Issue 1
A sensitivity study of radiative fluxes at the top of atmosphere to cloud-microphysics and aerosol parameters in the community atmosphere model CAM5
journal, January 2013
- Zhao, C.; Liu, X.; Qian, Y.
- Atmospheric Chemistry and Physics, Vol. 13, Issue 21
THE CLOUDSAT MISSION AND THE A-TRAIN: A New Dimension of Space-Based Observations of Clouds and Precipitation
journal, December 2002
- Stephens, Graeme L.; Vane, Deborah G.; Boain, Ronald J.
- Bulletin of the American Meteorological Society, Vol. 83, Issue 12
Considerations for parameter optimization and sensitivity in climate models
journal, November 2010
- Neelin, J. D.; Bracco, A.; Luo, H.
- Proceedings of the National Academy of Sciences, Vol. 107, Issue 50
Analysis and Reduction of Systematic Errors through a Seamless Approach to Modeling Weather and Climate
journal, November 2010
- Martin, G. M.; Milton, S. F.; Senior, C. A.
- Journal of Climate, Vol. 23, Issue 22
Performance metrics for climate models
journal, January 2008
- Gleckler, P. J.; Taylor, K. E.; Doutriaux, C.
- Journal of Geophysical Research, Vol. 113, Issue D6
An evaluation of adaptive surrogate modeling based optimization with two benchmark problems
journal, October 2014
- Wang, Chen; Duan, Qingyun; Gong, Wei
- Environmental Modelling & Software, Vol. 60
Evaluation of Climate Models
book, January 2014
- , Ipcc
- Climate Change 2013 – The Physical Science Basis
Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence
book, January 1992
- Holland, John H.
- The MIT Press
An automatic and effective parameter optimization method for model tuning
journal, January 2015
- Zhang, T.; Li, L.; Lin, Y.
- Geoscientific Model Development, Vol. 8, Issue 11
Modelling climate change: the role of unresolved processes
journal, October 2005
- Williams, Paul D.
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 363, Issue 1837
Evaluation of grid-point atmospheric model of IAP LASG version 2 (GAMIL2)
journal, April 2013
- Li, Lijuan; Wang, Bin; Dong, Li
- Advances in Atmospheric Sciences, Vol. 30, Issue 3
Quantification of modelling uncertainties in a large ensemble of climate change simulations
journal, August 2004
- Murphy, James M.; Sexton, David M. H.; Barnett, David N.
- Nature, Vol. 430, Issue 7001
A New Moist Turbulence Parameterization in the Community Atmosphere Model
journal, June 2009
- Bretherton, Christopher S.; Park, Sungsu
- Journal of Climate, Vol. 22, Issue 12
Climate statistics from the National Center for Atmospheric Research community climate model CCM2
journal, January 1994
- Hack, J. J.; Boville, B. A.; Kiehl, J. T.
- Journal of Geophysical Research, Vol. 99, Issue D10
Efficient Global Optimization of Expensive Black-Box Functions
journal, January 1998
- Jones, Donald R.; Schonlau, Matthias; Welch, William J.
- Journal of Global Optimization, Vol. 13, Issue 4, p. 455-492
Parameterization improvements and functional and structural advances in Version 4 of the Community Land Model: PARAMETERIZATION IMPROVEMENTS AND FUNCTIONAL AND STRUCTURAL ADVANCES
journal, January 2011
- Lawrence, David M.; Oleson, Keith W.; Flanner, Mark G.
- Journal of Advances in Modeling Earth Systems, Vol. 3, Issue 1
A “Vertically Lagrangian” Finite-Volume Dynamical Core for Global Models
journal, October 2004
- Lin, Shian-Jiann
- Monthly Weather Review, Vol. 132, Issue 10
Multidimensional Flux-Form Semi-Lagrangian Transport Schemes
journal, September 1996
- Lin, Shian-Jiann; Rood, Richard B.
- Monthly Weather Review, Vol. 124, Issue 9
Metrics and Diagnostics for Precipitation-Related Processes in Climate Model Short-Range Hindcasts
journal, March 2013
- Ma, H. -Y.; Xie, S.; Boyle, J. S.
- Journal of Climate, Vol. 26, Issue 5
On the Correspondence between Mean Forecast Errors and Climate Errors in CMIP5 Models
journal, February 2014
- Ma, H. -Y.; Xie, S.; Klein, S. A.
- Journal of Climate, Vol. 27, Issue 4
Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave
journal, July 1997
- Mlawer, Eli J.; Taubman, Steven J.; Brown, Patrick D.
- Journal of Geophysical Research: Atmospheres, Vol. 102, Issue D14
The Impact of Convection on ENSO: From a Delayed Oscillator to a Series of Events
journal, November 2008
- Neale, Richard B.; Richter, Jadwiga H.; Jochum, Markus
- Journal of Climate, Vol. 21, Issue 22
The University of Washington Shallow Convection and Moist Turbulence Schemes and Their Impact on Climate Simulations with the Community Atmosphere Model
journal, June 2009
- Park, Sungsu; Bretherton, Christopher S.
- Journal of Climate, Vol. 22, Issue 12
Integrating Cloud Processes in the Community Atmosphere Model, Version 5
journal, September 2014
- Park, Sungsu; Bretherton, Christopher S.; Rasch, Philip J.
- Journal of Climate, Vol. 27, Issue 18
Parametric sensitivity analysis of precipitation at global and local scales in the Community Atmosphere Model CAM5
journal, April 2015
- Qian, Yun; Yan, Huiping; Hou, Zhangshuan
- Journal of Advances in Modeling Earth Systems, Vol. 7, Issue 2
Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century
journal, January 2003
- Rayner, N. A.
- Journal of Geophysical Research, Vol. 108, Issue D14
How Well Do Coupled Models Simulate Today's Climate?
journal, March 2008
- Reichler, Thomas; Kim, Junsu
- Bulletin of the American Meteorological Society, Vol. 89, Issue 3
Effects of Convective Momentum Transport on the Atmospheric Circulation in the Community Atmosphere Model, Version 3
journal, April 2008
- Richter, Jadwiga H.; Rasch, Philip J.
- Journal of Climate, Vol. 21, Issue 7
Summarizing multiple aspects of model performance in a single diagram
journal, April 2001
- Taylor, Karl E.
- Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
Initial Tendencies of Cloud Regimes in the Met Office Unified Model
journal, February 2008
- Williams, K. D.; Brooks, M. E.
- Journal of Climate, Vol. 21, Issue 4
On the Correspondence between Short- and Long-Time-Scale Systematic Errors in CAM4/CAM5 for the Year of Tropical Convection
journal, November 2012
- Xie, Shaocheng; Ma, Hsi-Yen; Boyle, James S.
- Journal of Climate, Vol. 25, Issue 22
Uncertainty quantification and parameter tuning in the CAM5 Zhang-McFarlane convection scheme and impact of improved convection on the global circulation and climate: PARAMETERS TUNING IN CAM5 AND ITS IMPACT
journal, January 2013
- Yang, Ben; Qian, Yun; Lin, Guang
- Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 2
Coherent response of the Indian Monsoon Rainfall to Atlantic Multi-decadal Variability over the last 2000 years
journal, January 2020
- Naidu, Pothuri Divakar; Ganeshram, Raja; Bollasina, Massimo A.
- Scientific Reports, Vol. 10, Issue 1
Review of Metamodeling Techniques in Support of Engineering Design Optimization
conference, June 2008
- Wang, G. Gary; Shan, S.
- ASME 2006 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Volume 1: 32nd Design Automation Conference, Parts A and B
A sensitivity study of radiative fluxes at the top of atmosphere to cloud-microphysics and aerosol parameters in the Community Atmosphere Model CAM5
journal, January 2013
- Zhao, C.; Liu, X.; Qian, Y.
- Atmospheric Chemistry and Physics Discussions, Vol. 13, Issue 5
Quantifying the uncertainty in forecasts of anthropogenic climate change
journal, October 2000
- Allen, Myles R.; Stott, Peter A.; Mitchell, John F. B.
- Nature, Vol. 407, Issue 6804
Considerations for parameter optimization and sensitivity in climate models
journal, November 2010
- Neelin, J. D.; Bracco, A.; Luo, H.
- Proceedings of the National Academy of Sciences, Vol. 107, Issue 50
Supplement to How Well Do Coupled Models Simulate Today's Climate?
journal, March 2008
- Reichler, Thomas; Kim, Junsu
- Bulletin of the American Meteorological Society, Vol. 89, Issue 3