DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: An improved hindcast approach for evaluation and diagnosis of physical processes in global climate models

Abstract

Here, we present an improved procedure of generating initial conditions (ICs) for climate model hindcast experiments with specified sea surface temperature and sea ice. The motivation is to minimize errors in the ICs and lead to a better evaluation of atmospheric parameterizations' performance in the hindcast mode. We apply state variables (horizontal velocities, temperature and specific humidity) from the operational analysis/reanalysis for the atmospheric initial states. Without a data assimilation system, we apply a two-step process to obtain other necessary variables to initialize both the atmospheric (e.g., aerosols and clouds) and land models (e.g., soil moisture). First, we nudge only the model horizontal velocities towards operational analysis/reanalysis values, given a 6-hour relaxation time scale, to obtain all necessary variables. Compared to the original strategy in which horizontal velocities, temperature and specific humidity are nudged, the revised approach produces a better representation of initial aerosols and cloud fields which are more consistent and closer to observations and model's preferred climatology. Second, we obtain land ICs from an offline land model simulation forced with observed precipitation, winds, and surface fluxes. This approach produces more realistic soil moisture in the land ICs. With this refined procedure, the simulated precipitation, clouds, radiation, and surfacemore » air temperature over land are improved in the Day 2 mean hindcasts. Following this procedure, we propose a “Core” integration suite which provides an easily repeatable test allowing model developers to rapidly assess the impacts of various parameterization changes on the fidelity of modelled cloud-associated processes relative to observations.« less

Authors:
 [1];  [1];  [1];  [2];  [1];  [1];  [1];  [3];  [1];  [1]
  1. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  2. National Taiwan Univ., Taipei (Taiwan)
  3. Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Publication Date:
Research Org.:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE; Ministry of Science and Technology (MOST) Taiwan
OSTI Identifier:
1239491
Alternate Identifier(s):
OSTI ID: 1367986
Report Number(s):
PNNL-SA-110968; LLNL-JRNL-671916
Journal ID: ISSN 1942-2466; KP1703010
Grant/Contract Number:  
AC05-76RL01830; AC52-07NA27344
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Advances in Modeling Earth Systems
Additional Journal Information:
Journal Volume: 7; Journal Issue: 4; Journal ID: ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)
Country of Publication:
United States
Language:
English
Subject:
54 ENVIRONMENTAL SCIENCES; 58 GEOSCIENCES; GCM; model evaluation; transpose-AMIP; initial conditions; hindcast

Citation Formats

Ma, H. -Y., Chuang, C. C., Klein, S. A., Lo, M. -H., Zhang, Y., Xie, S., Zheng, X., Ma, P. -L., Zhang, Y., and Phillips, T. J. An improved hindcast approach for evaluation and diagnosis of physical processes in global climate models. United States: N. p., 2015. Web. doi:10.1002/2015MS000490.
Ma, H. -Y., Chuang, C. C., Klein, S. A., Lo, M. -H., Zhang, Y., Xie, S., Zheng, X., Ma, P. -L., Zhang, Y., & Phillips, T. J. An improved hindcast approach for evaluation and diagnosis of physical processes in global climate models. United States. https://doi.org/10.1002/2015MS000490
Ma, H. -Y., Chuang, C. C., Klein, S. A., Lo, M. -H., Zhang, Y., Xie, S., Zheng, X., Ma, P. -L., Zhang, Y., and Phillips, T. J. Fri . "An improved hindcast approach for evaluation and diagnosis of physical processes in global climate models". United States. https://doi.org/10.1002/2015MS000490. https://www.osti.gov/servlets/purl/1239491.
@article{osti_1239491,
title = {An improved hindcast approach for evaluation and diagnosis of physical processes in global climate models},
author = {Ma, H. -Y. and Chuang, C. C. and Klein, S. A. and Lo, M. -H. and Zhang, Y. and Xie, S. and Zheng, X. and Ma, P. -L. and Zhang, Y. and Phillips, T. J.},
abstractNote = {Here, we present an improved procedure of generating initial conditions (ICs) for climate model hindcast experiments with specified sea surface temperature and sea ice. The motivation is to minimize errors in the ICs and lead to a better evaluation of atmospheric parameterizations' performance in the hindcast mode. We apply state variables (horizontal velocities, temperature and specific humidity) from the operational analysis/reanalysis for the atmospheric initial states. Without a data assimilation system, we apply a two-step process to obtain other necessary variables to initialize both the atmospheric (e.g., aerosols and clouds) and land models (e.g., soil moisture). First, we nudge only the model horizontal velocities towards operational analysis/reanalysis values, given a 6-hour relaxation time scale, to obtain all necessary variables. Compared to the original strategy in which horizontal velocities, temperature and specific humidity are nudged, the revised approach produces a better representation of initial aerosols and cloud fields which are more consistent and closer to observations and model's preferred climatology. Second, we obtain land ICs from an offline land model simulation forced with observed precipitation, winds, and surface fluxes. This approach produces more realistic soil moisture in the land ICs. With this refined procedure, the simulated precipitation, clouds, radiation, and surface air temperature over land are improved in the Day 2 mean hindcasts. Following this procedure, we propose a “Core” integration suite which provides an easily repeatable test allowing model developers to rapidly assess the impacts of various parameterization changes on the fidelity of modelled cloud-associated processes relative to observations.},
doi = {10.1002/2015MS000490},
journal = {Journal of Advances in Modeling Earth Systems},
number = 4,
volume = 7,
place = {United States},
year = {Fri Nov 06 00:00:00 EST 2015},
month = {Fri Nov 06 00:00:00 EST 2015}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 42 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Tropospheric adjustment to increasing CO2: its timescale and the role of land–sea contrast
journal, October 2012


The Transpose-AMIP II Experiment and Its Application to the Understanding of Southern Ocean Cloud Biases in Climate Models
journal, May 2013


How does increasing horizontal resolution in a global climate model improve the simulation of aerosol-cloud interactions?: RESOLUTION DEPENDENCE OF AIF
journal, June 2015

  • Ma, Po-Lun; Rasch, Philip J.; Wang, Minghuai
  • Geophysical Research Letters, Vol. 42, Issue 12
  • DOI: 10.1002/2015GL064183

Using numerical weather prediction to assess climate models
journal, January 2007

  • Rodwell, M. J.; Palmer, T. N.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 133, Issue 622
  • DOI: 10.1002/qj.23

Spatiotemporal Variations in Soil Water: First Results from the ARM SGP CART Network
journal, February 2003


Analysis and Reduction of Systematic Errors through a Seamless Approach to Modeling Weather and Climate
journal, November 2010

  • Martin, G. M.; Milton, S. F.; Senior, C. A.
  • Journal of Climate, Vol. 23, Issue 22
  • DOI: 10.1175/2010JCLI3541.1

Toward a minimal representation of aerosols in climate models: description and evaluation in the Community Atmosphere Model CAM5
journal, January 2012

  • Liu, X.; Easter, R. C.; Ghan, S. J.
  • Geoscientific Model Development, Vol. 5, Issue 3
  • DOI: 10.5194/gmd-5-709-2012

On the potential of assimilating meteorological analyses in a global climate model for the purpose of model validation
journal, July 1996

  • Jeuken, A. B. M.; Siegmund, P. C.; Heijboer, L. C.
  • Journal of Geophysical Research: Atmospheres, Vol. 101, Issue D12
  • DOI: 10.1029/96JD01218

Assessing the utility of frequency dependent nudging for reducing biases in biogeochemical models
journal, September 2014


Initial Tendencies of Cloud Regimes in the Met Office Unified Model
journal, February 2008


Vertical structure and physical processes of the Madden-Julian Oscillation: Biases and uncertainties at short range: PHYSICAL PROCESSES OF MJO
journal, May 2015

  • Xavier, Prince K.; Petch, Jon C.; Klingaman, Nicholas P.
  • Journal of Geophysical Research: Atmospheres, Vol. 120, Issue 10
  • DOI: 10.1002/2014JD022718

An Overview of CMIP5 and the Experiment Design
journal, April 2012

  • Taylor, Karl E.; Stouffer, Ronald J.; Meehl, Gerald A.
  • Bulletin of the American Meteorological Society, Vol. 93, Issue 4
  • DOI: 10.1175/BAMS-D-11-00094.1

Assessment of simulated water balance from Noah, Noah-MP, CLM, and VIC over CONUS using the NLDAS test bed
journal, December 2014

  • Cai, Xitian; Yang, Zong-Liang; Xia, Youlong
  • Journal of Geophysical Research: Atmospheres, Vol. 119, Issue 24
  • DOI: 10.1002/2014JD022113

Characterizing and understanding radiation budget biases in CMIP3/CMIP5 GCMs, contemporary GCM, and reanalysis: RADIATION BUDGET BIASES IN CMIP3/CMIP5
journal, August 2013

  • Li, J. -L. F.; Waliser, D. E.; Stephens, G.
  • Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 15
  • DOI: 10.1002/jgrd.50378

The role of circulation features on black carbon transport into the Arctic in the Community Atmosphere Model version 5 (CAM5): BC TRANSPORT IN OFF-LINE CAM5
journal, May 2013

  • Ma, Po-Lun; Rasch, Philip J.; Wang, Hailong
  • Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 10
  • DOI: 10.1002/jgrd.50411

Arctic synoptic regimes: Comparing domain-wide Arctic cloud observations with CAM4 and CAM5 during similar dynamics: CAM4 AND CAM5 ARCTIC CLOUD EVALUATION
journal, August 2012

  • Barton, Neil P.; Klein, Stephen A.; Boyle, James S.
  • Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D15
  • DOI: 10.1029/2012JD017589

A Comparison of Forecast Errors in CAM2 and CAM3 at the ARM Southern Great Plains Site
journal, September 2007

  • Williamson, David L.; Olson, Jerry G.
  • Journal of Climate, Vol. 20, Issue 18
  • DOI: 10.1175/JCLI4267.1

Summarizing multiple aspects of model performance in a single diagram
journal, April 2001

  • Taylor, Karl E.
  • Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D7
  • DOI: 10.1029/2000JD900719

Global simulations of ice nucleation and ice supersaturation with an improved cloud scheme in the Community Atmosphere Model
journal, January 2010

  • Gettelman, A.; Liu, X.; Ghan, S. J.
  • Journal of Geophysical Research, Vol. 115, Issue D18
  • DOI: 10.1029/2009JD013797

Contributions of Clouds, Surface Albedos, and Mixed-Phase Ice Nucleation Schemes to Arctic Radiation Biases in CAM5
journal, July 2014

  • English, Jason M.; Kay, Jennifer E.; Gettelman, Andrew
  • Journal of Climate, Vol. 27, Issue 13
  • DOI: 10.1175/JCLI-D-13-00608.1

Contribution of land surface initialization to subseasonal forecast skill: First results from a multi-model experiment: GLACE-2-SOIL MOISTURE AND FORECASTING
journal, January 2010

  • Koster, R. D.; Mahanama, S. P. P.; Yamada, T. J.
  • Geophysical Research Letters, Vol. 37, Issue 2
  • DOI: 10.1029/2009GL041677

Sensitivity of remote aerosol distributions to representation of cloud–aerosol interactions in a global climate model
journal, January 2013

  • Wang, H.; Easter, R. C.; Rasch, P. J.
  • Geoscientific Model Development, Vol. 6, Issue 3
  • DOI: 10.5194/gmd-6-765-2013

Four-Dimensional Variational Data Assimilation with Digital Filter Initialization
journal, July 2000


Integrating Cloud Processes in the Community Atmosphere Model, Version 5
journal, September 2014

  • Park, Sungsu; Bretherton, Christopher S.; Rasch, Philip J.
  • Journal of Climate, Vol. 27, Issue 18
  • DOI: 10.1175/JCLI-D-14-00087.1

The Impact of Convection on ENSO: From a Delayed Oscillator to a Series of Events
journal, November 2008

  • Neale, Richard B.; Richter, Jadwiga H.; Jochum, Markus
  • Journal of Climate, Vol. 21, Issue 22
  • DOI: 10.1175/2008JCLI2244.1

TWP-ICE global atmospheric model intercomparison: Convection responsiveness and resolution impact: TWP-ICE AGCM INTERCOMPARISON
journal, May 2012

  • Lin, Yanluan; Donner, L. J.; Petch, J.
  • Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D9
  • DOI: 10.1029/2011JD017018

Are climate model simulations of clouds improving? An evaluation using the ISCCP simulator: EVALUATING CLOUDS IN CLIMATE MODELS
journal, February 2013

  • Klein, Stephen A.; Zhang, Yuying; Zelinka, Mark D.
  • Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 3
  • DOI: 10.1002/jgrd.50141

Simulations of Arctic mixed-phase clouds in forecasts with CAM3 and AM2 for M-PACE
journal, January 2008

  • Xie, Shaocheng; Boyle, James; Klein, Stephen A.
  • Journal of Geophysical Research, Vol. 113, Issue D4
  • DOI: 10.1029/2007JD009225

Southeast Pacific Stratocumulus in the Community Atmosphere Model
journal, September 2012

  • Medeiros, Brian; Williamson, David L.; Hannay, Cécile
  • Journal of Climate, Vol. 25, Issue 18
  • DOI: 10.1175/JCLI-D-11-00503.1

The ERA-Interim reanalysis: configuration and performance of the data assimilation system
journal, April 2011

  • Dee, D. P.; Uppala, S. M.; Simmons, A. J.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 656
  • DOI: 10.1002/qj.828

Evaluation of Forecasted Southeast Pacific Stratocumulus in the NCAR, GFDL, and ECMWF Models
journal, June 2009

  • Hannay, Cécile; Williamson, David L.; Hack, James J.
  • Journal of Climate, Vol. 22, Issue 11
  • DOI: 10.1175/2008JCLI2479.1

Climate Model Forecast Experiments for TOGA COARE
journal, March 2008


Evaluating cloud systems in the Met Office global forecast model using simulated CloudSat radar reflectivities
journal, January 2008

  • Bodas-Salcedo, A.; Webb, M. J.; Brooks, M. E.
  • Journal of Geophysical Research, Vol. 113
  • DOI: 10.1029/2007JD009620

Initialization of the HIRLAM Model Using a Digital Filter
journal, June 1992


On the Correspondence between Short- and Long-Time-Scale Systematic Errors in CAM4/CAM5 for the Year of Tropical Convection
journal, November 2012


Vertical structure and physical processes of the Madden-Julian oscillation: Linking hindcast fidelity to simulated diabatic heating and moistening: DIABATIC PROCESSES IN MJO HINDCASTS
journal, May 2015

  • Klingaman, Nicholas P.; Woolnough, Steven J.; Jiang, Xianan
  • Journal of Geophysical Research: Atmospheres, Vol. 120, Issue 10
  • DOI: 10.1002/2014JD022374

The Initialization of Numerical Models by a Dynamic-Initialization Technique
journal, December 1976


Evaluating Parameterizations in General Circulation Models: Climate Simulation Meets Weather Prediction
journal, December 2004

  • Phillips, Thomas J.; Potter, Gerald L.; Williamson, David L.
  • Bulletin of the American Meteorological Society, Vol. 85, Issue 12
  • DOI: 10.1175/BAMS-85-12-1903

Unified Modeling and Prediction of Weather and Climate: A 25-Year Journey
journal, December 2012

  • Brown, Andrew; Milton, Sean; Cullen, Mike
  • Bulletin of the American Meteorological Society, Vol. 93, Issue 12
  • DOI: 10.1175/BAMS-D-12-00018.1

Impact of horizontal resolution on climate model forecasts of tropical precipitation and diabatic heating for the TWP-ICE period
journal, January 2010

  • Boyle, James; Klein, Stephen A.
  • Journal of Geophysical Research, Vol. 115, Issue D23
  • DOI: 10.1029/2010JD014262

Geostationary Enhanced Temporal Interpolation for CERES Flux Products
journal, June 2013

  • Doelling, David R.; Loeb, Norman G.; Keyes, Dennis F.
  • Journal of Atmospheric and Oceanic Technology, Vol. 30, Issue 6
  • DOI: 10.1175/JTECH-D-12-00136.1

Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models
journal, January 2008

  • Iacono, Michael J.; Delamere, Jennifer S.; Mlawer, Eli J.
  • Journal of Geophysical Research, Vol. 113, Issue D13
  • DOI: 10.1029/2008JD009944

On the Correspondence between Mean Forecast Errors and Climate Errors in CMIP5 Models
journal, February 2014


A History and Review of the Global Soil Wetness Project (GSWP)
journal, October 2011


Realistic Initialization of Land Surface States: Impacts on Subseasonal Forecast Skill
journal, December 2004

  • Koster, Randal D.; Suarez, Max J.; Liu, Ping
  • Journal of Hydrometeorology, Vol. 5, Issue 6
  • DOI: 10.1175/JHM-387.1

Assessing the CAM5 physics suite in the WRF-Chem model: implementation, resolution sensitivity, and a first evaluation for a regional case study
journal, January 2014

  • Ma, P. -L.; Rasch, P. J.; Fast, J. D.
  • Geoscientific Model Development, Vol. 7, Issue 3
  • DOI: 10.5194/gmd-7-755-2014

Low‐cloud characteristics over the tropical western Pacific from ARM observations and CAM5 simulations
journal, September 2015

  • Chandra, Arunchandra S.; Zhang, Chidong; Klein, Stephen A.
  • Journal of Geophysical Research: Atmospheres, Vol. 120, Issue 17
  • DOI: 10.1002/2015JD023369

An observationally based evaluation of cloud ice water in CMIP3 and CMIP5 GCMs and contemporary reanalyses using contemporary satellite data: CMIP3, CMIP5, IWC, CloudSat, GCM
journal, August 2012

  • Li, J. -L. F.; Waliser, D. E.; Chen, W. -T.
  • Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D16
  • DOI: 10.1029/2012JD017640

On the Contribution of Longwave Radiation to Global Climate Model Biases in Arctic Lower Tropospheric Stability
journal, October 2014


Spread in model climate sensitivity traced to atmospheric convective mixing
journal, January 2014

  • Sherwood, Steven C.; Bony, Sandrine; Dufresne, Jean-Louis
  • Nature, Vol. 505, Issue 7481
  • DOI: 10.1038/nature12829

An Improved In Situ and Satellite SST Analysis for Climate
journal, July 2002


The “Year” of Tropical Convection (May 2008–April 2010): Climate Variability and Weather Highlights
journal, August 2012

  • Waliser, Duane E.; Moncrieff, Mitchell W.; Burridge, David
  • Bulletin of the American Meteorological Society, Vol. 93, Issue 8
  • DOI: 10.1175/2011BAMS3095.1

The effect of time steps and time-scales on parametrization suites
journal, August 2012

  • Williamson, David L.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 139, Issue 671
  • DOI: 10.1002/qj.1992

Evaluation of cloud and water vapor simulations in CMIP5 climate models using NASA “A-Train” satellite observations: EVALUATION OF IPCC AR5 MODEL SIMULATIONS
journal, July 2012

  • Jiang, Jonathan H.; Su, Hui; Zhai, Chengxing
  • Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D14
  • DOI: 10.1029/2011JD017237

Technical Note: On the use of nudging for aerosol–climate model intercomparison studies
journal, January 2014


Metrics and Diagnostics for Precipitation-Related Processes in Climate Model Short-Range Hindcasts
journal, March 2013


The Version-2 Global Precipitation Climatology Project (GPCP) Monthly Precipitation Analysis (1979–Present)
journal, December 2003


Black holes, elementary strings and holomorphic anomaly
journal, July 2005


Using regime analysis to identify the contribution of clouds to surface temperature errors in weather and climate models: Cloud-Regime Analysis and Surface Temperature Errors
journal, September 2015

  • Van Weverberg, Kwinten; Morcrette, Cyril J.; Ma, Hsi-Yen
  • Quarterly Journal of the Royal Meteorological Society, Vol. 141, Issue 693
  • DOI: 10.1002/qj.2603

The CALIPSO mission: spaceborne lidar for observation of aerosols and clouds
conference, March 2003

  • Winker, David M.; Pelon, Jacques R.; McCormick, M. Patrick
  • Third International Asia-Pacific Environmental Remote Sensing Remote Sensing of the Atmosphere, Ocean, Environment, and Space, SPIE Proceedings
  • DOI: 10.1117/12.466539

Accelerated dryland expansion regulates future variability in dryland gross primary production
journal, April 2020


A History and Review of the Global Soil Wetness Project (GSWP)
journal, March 2011


Sensitivity of remote aerosol distributions to representation of cloud-aerosol interactions in a global climate model
journal, January 2013

  • Wang, H.; Easter, R. C.; Rasch, P. J.
  • Geoscientific Model Development Discussions, Vol. 6, Issue 1
  • DOI: 10.5194/gmdd-6-331-2013

Technical note: On the use of nudging for aerosol-climate model intercomparison studies
text, January 2014


Works referencing / citing this record:

Object-based precipitation system bias in grey zone simulation: the 2016 South China Sea summer monsoon onset
journal, January 2019


A Prospectus for Constraining Rapid Cloud Adjustments in General Circulation Models
journal, August 2018

  • Nam, Christine; Kühne, Philipp; Salzmann, Marc
  • Journal of Advances in Modeling Earth Systems, Vol. 10, Issue 8
  • DOI: 10.1029/2017ms001153

Practice and philosophy of climate model tuning across six US modeling centers
journal, January 2017

  • Schmidt, Gavin A.; Bader, David; Donner, Leo J.
  • Geoscientific Model Development, Vol. 10, Issue 9
  • DOI: 10.5194/gmd-10-3207-2017

Regionally refined test bed in E3SM atmosphere model version 1 (EAMv1) and applications for high-resolution modeling
journal, January 2019

  • Tang, Qi; Klein, Stephen A.; Xie, Shaocheng
  • Geoscientific Model Development, Vol. 12, Issue 7
  • DOI: 10.5194/gmd-12-2679-2019