DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity

Abstract

Using 5-day averaged precipitation from all initial condition realizations of 33 CMIP5 models for the Historical and RCP8.5scenarios, we performed an assessment of summer precipitation in terms of amount, onset date, withdrawal date, and length of season using probability distributions of interannual anomalies. Climate change projections were generated using all models, one model per modelling group to account for overconfidence, and sub-selecting models on annual cycle fidelity. Compared to using all models, sub-selecting on annual cycle fidelity has a large impact on the climate change perturbation of the fractional change in precipitation, with differences between the two projections of up to ± 50%, especially in the tropics and subtropics. Sensitivity testing indicates that the Gaussian t-test and the non-parametric Mann–Whitney U-test (the latter using Monte Carlo sampling) yield consistent results for assessing where the climate change perturbation is significant at the 1% level, even in cases where skewness and excess kurtosis indicate non-Gaussian behavior. Similarly, in terms of climate change induced perturbations to below-normal, normal, and above-normal categorical probabilities, the Gaussian results are typically consistent with the non-parametric estimates. We suggest these sensitivity results promote the use of Gaussian statistics to present global maps of the lower-bound and upper-bound ofmore » the climate change response, given that the non-parametric calculation of confidence intervals would otherwise not be tractable in a desktop computing environment due to its CPU intensive requirement.« less

Authors:
ORCiD logo [1];  [2]; ORCiD logo [1]
  1. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  2. Univ. of Hawaii at Manoa, Honolulu, HI (United States)
Publication Date:
Research Org.:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Biological and Environmental Research (BER); National Science Foundation (NSF)
OSTI Identifier:
1598106
Report Number(s):
LLNL-JRNL-748698
Journal ID: ISSN 0930-7575; 933450
Grant/Contract Number:  
AC52-07NA27344; 1460742
Resource Type:
Accepted Manuscript
Journal Name:
Climate Dynamics
Additional Journal Information:
Journal Volume: 54; Journal Issue: 3-4; Journal ID: ISSN 0930-7575
Publisher:
Springer-Verlag
Country of Publication:
United States
Language:
English
Subject:
58 GEOSCIENCES; 54 ENVIRONMENTAL SCIENCES; Anthropogenic climate change; Precipitation; Annual cycle skill; Monte Carlo sampling

Citation Formats

Sperber, Kenneth R., Annamalai, H., and Pallotta, Giuliana. CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity. United States: N. p., 2020. Web. doi:10.1007/s00382-019-05082-8.
Sperber, Kenneth R., Annamalai, H., & Pallotta, Giuliana. CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity. United States. https://doi.org/10.1007/s00382-019-05082-8
Sperber, Kenneth R., Annamalai, H., and Pallotta, Giuliana. Fri . "CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity". United States. https://doi.org/10.1007/s00382-019-05082-8. https://www.osti.gov/servlets/purl/1598106.
@article{osti_1598106,
title = {CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity},
author = {Sperber, Kenneth R. and Annamalai, H. and Pallotta, Giuliana},
abstractNote = {Using 5-day averaged precipitation from all initial condition realizations of 33 CMIP5 models for the Historical and RCP8.5scenarios, we performed an assessment of summer precipitation in terms of amount, onset date, withdrawal date, and length of season using probability distributions of interannual anomalies. Climate change projections were generated using all models, one model per modelling group to account for overconfidence, and sub-selecting models on annual cycle fidelity. Compared to using all models, sub-selecting on annual cycle fidelity has a large impact on the climate change perturbation of the fractional change in precipitation, with differences between the two projections of up to ± 50%, especially in the tropics and subtropics. Sensitivity testing indicates that the Gaussian t-test and the non-parametric Mann–Whitney U-test (the latter using Monte Carlo sampling) yield consistent results for assessing where the climate change perturbation is significant at the 1% level, even in cases where skewness and excess kurtosis indicate non-Gaussian behavior. Similarly, in terms of climate change induced perturbations to below-normal, normal, and above-normal categorical probabilities, the Gaussian results are typically consistent with the non-parametric estimates. We suggest these sensitivity results promote the use of Gaussian statistics to present global maps of the lower-bound and upper-bound of the climate change response, given that the non-parametric calculation of confidence intervals would otherwise not be tractable in a desktop computing environment due to its CPU intensive requirement.},
doi = {10.1007/s00382-019-05082-8},
journal = {Climate Dynamics},
number = 3-4,
volume = 54,
place = {United States},
year = {Fri Jan 03 00:00:00 EST 2020},
month = {Fri Jan 03 00:00:00 EST 2020}
}

Works referenced in this record:

Probabilistic Multimodel Regional Temperature Change Projections
journal, September 2006

  • Greene, Arthur M.; Goddard, Lisa; Lall, Upmanu
  • Journal of Climate, Vol. 19, Issue 17
  • DOI: 10.1175/JCLI3864.1

Quantifying Uncertainty in Projections of Regional Climate Change: A Bayesian Approach to the Analysis of Multimodel Ensembles
journal, May 2005

  • Tebaldi, Claudia; Smith, Richard L.; Nychka, Doug
  • Journal of Climate, Vol. 18, Issue 10
  • DOI: 10.1175/JCLI3363.1

A Climate-based Distribution Model of Malaria Transmission in Sub-Saharan Africa
journal, March 1999


Addressing Interdependency in a Multimodel Ensemble by Interpolation of Model Properties
journal, July 2015


Climate change and the South Asian summer monsoon
journal, June 2012


Global Precipitation: A 17-Year Monthly Analysis Based on Gauge Observations, Satellite Estimates, and Numerical Model Outputs
journal, November 1997


Models agree on forced response pattern of precipitation and temperature extremes
journal, December 2014

  • Fischer, E. M.; Sedláček, J.; Hawkins, E.
  • Geophysical Research Letters, Vol. 41, Issue 23
  • DOI: 10.1002/2014GL062018

Subtropical Anticyclones and Summer Monsoons
journal, August 2001


Holocene winter climate variability in mid-latitude western North America
journal, January 2012

  • Ersek, Vasile; Clark, Peter U.; Mix, Alan C.
  • Nature Communications, Vol. 3, Issue 1
  • DOI: 10.1038/ncomms2222

Future change of Asian-Australian monsoon under RCP 4.5 anthropogenic warming scenario
journal, April 2013


Monsoons in a changing world: A regional perspective in a global context: GLOBAL MONSOONS IN CMIP5 MODELS
journal, April 2013

  • Kitoh, Akio; Endo, Hirokazu; Krishna Kumar, K.
  • Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 8
  • DOI: 10.1002/jgrd.50258

An Overview of CMIP5 and the Experiment Design
journal, April 2012

  • Taylor, Karl E.; Stouffer, Ronald J.; Meehl, Gerald A.
  • Bulletin of the American Meteorological Society, Vol. 93, Issue 4
  • DOI: 10.1175/BAMS-D-11-00094.1

The Standard Error of Time-Average Estimates of Climatic Means
journal, September 1973


El Niño in a changing climate: a multi-model study
journal, January 2005

  • van Oldenborgh, G. J.; Philip, S. Y.; Collins, M.
  • Ocean Science, Vol. 1, Issue 2
  • DOI: 10.5194/os-1-81-2005

Analysis of historical changes in rainfall in the Indian Himalayas
journal, March 2009

  • Basistha, Ashoke; Arya, D. S.; Goel, N. K.
  • International Journal of Climatology, Vol. 29, Issue 4
  • DOI: 10.1002/joc.1706

Need for Caution in Interpreting Extreme Weather Statistics
journal, December 2015

  • Sardeshmukh, Prashant D.; Compo, Gilbert P.; Penland, Cécile
  • Journal of Climate, Vol. 28, Issue 23
  • DOI: 10.1175/JCLI-D-15-0020.1

The Asian summer monsoon: an intercomparison of CMIP5 vs. CMIP3 simulations of the late 20th century
journal, December 2012


Malaria early warnings based on seasonal climate forecasts from multi-model ensembles
journal, February 2006

  • Thomson, M. C.; Doblas-Reyes, F. J.; Mason, S. J.
  • Nature, Vol. 439, Issue 7076
  • DOI: 10.1038/nature04503

The use of fractional accumulated precipitation for the evaluation of the annual cycle of monsoons
journal, March 2014


Evaluating the “Rich-Get-Richer” Mechanism in Tropical Precipitation Change under Global Warming
journal, April 2009

  • Chou, Chia; Neelin, J. David; Chen, Chao-An
  • Journal of Climate, Vol. 22, Issue 8
  • DOI: 10.1175/2008JCLI2471.1

The Global Precipitation Climatology Project (GPCP) Combined Precipitation Dataset
journal, January 1997


Performance metrics for climate models
journal, January 2008

  • Gleckler, P. J.; Taylor, K. E.; Doutriaux, C.
  • Journal of Geophysical Research, Vol. 113, Issue D6
  • DOI: 10.1029/2007JD008972

Robust Responses of the Hydrological Cycle to Global Warming
journal, November 2006

  • Held, Isaac M.; Soden, Brian J.
  • Journal of Climate, Vol. 19, Issue 21
  • DOI: 10.1175/JCLI3990.1

A more realistic look at the robustness and Type II error properties of the t test to departures from population normality.
journal, January 1992


Weakening of the North American monsoon with global warming
journal, October 2017

  • Pascale, Salvatore; Boos, William R.; Bordoni, Simona
  • Nature Climate Change, Vol. 7, Issue 11
  • DOI: 10.1038/nclimate3412

On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other
journal, March 1947


Projections of a Wetter Sahel in the Twenty-First Century from Global and Regional Models
journal, July 2013


The Asian Monsoon and its Future Change in Climate Models: A Review
journal, January 2017

  • Kitoh, Akio
  • Journal of the Meteorological Society of Japan. Ser. II, Vol. 95, Issue 1
  • DOI: 10.2151/jmsj.2017-002

Attribution of extreme weather to anthropogenic greenhouse gas emissions: Sensitivity to spatial and temporal scales
journal, March 2014

  • Angélil, Oliver; Stone, Dáithí A.; Tadross, Mark
  • Geophysical Research Letters, Vol. 41, Issue 6
  • DOI: 10.1002/2014GL059234

Tropical Australian climate and the Australian monsoon as simulated by 23 CMIP3 models
journal, January 2011

  • Colman, R. A.; Moise, A. F.; Hanson, L. I.
  • Journal of Geophysical Research, Vol. 116, Issue D10
  • DOI: 10.1029/2010JD015149

IPCC global coupled model simulations of the South America monsoon system
journal, November 2008


The response of the North American Monsoon to increased greenhouse gas forcing: NA MONSOON AND GHG WARMING
journal, February 2013

  • Cook, B. I.; Seager, R.
  • Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 4
  • DOI: 10.1002/jgrd.50111

Climate Change in the South American Monsoon System: Present Climate and CMIP5 Projections
journal, September 2013


The Wilcoxon–Mann–Whitney Procedure Fails as a Test of Medians
journal, January 2018


Changes in temperature and precipitation extremes in the CMIP5 ensemble
journal, February 2013


Quantifying uncertainty in twenty-first century climate change over India
journal, July 2018


Forced Sahel rainfall trends in the CMIP5 archive: FORCED RAINFALL TRENDS IN THE SAHEL
journal, February 2013

  • Biasutti, M.
  • Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 4
  • DOI: 10.1002/jgrd.50206

EURO-CORDEX: new high-resolution climate change projections for European impact research
journal, July 2013

  • Jacob, Daniela; Petersen, Juliane; Eggert, Bastian
  • Regional Environmental Change, Vol. 14, Issue 2
  • DOI: 10.1007/s10113-013-0499-2

GPCP Pentad Precipitation Analyses: An Experimental Dataset Based on Gauge Observations and Satellite Estimates
journal, July 2003

  • Xie, Pingping; Janowiak, John E.; Arkin, Phillip A.
  • Journal of Climate, Vol. 16, Issue 13
  • DOI: 10.1175/2769.1

A Probability and Decision-Model Analysis of a Multimodel Ensemble of Climate Change Simulations
journal, August 2001


The western Pacific monsoon in CMIP5 models: Model evaluation and projections: WESTERN PACIFIC MONSOON IN CMIP5
journal, November 2013

  • Brown, Josephine R.; Colman, Robert A.; Moise, Aurel F.
  • Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 22
  • DOI: 10.1002/2013jd020290

Long term spatial and temporal rainfall trends and homogeneity analysis in Wainganga basin, Central India
journal, August 2014


The modulated annual cycle: an alternative reference frame for climate anomalies
journal, July 2008


Two Approaches to Quantifying Uncertainty in Global Temperature Changes
journal, October 2006

  • Lopez, Ana; Tebaldi, Claudia; New, Mark
  • Journal of Climate, Vol. 19, Issue 19
  • DOI: 10.1175/JCLI3895.1

Quantifying Uncertainty in Projections of Regional Climate Change: A Bayesian Approach to the Analysis of Multimodel Ensembles
text, January 2005

  • Claudia, Tebaldi,; L., Smith, Richard; Doug, Nychka,
  • The University of North Carolina at Chapel Hill University Libraries
  • DOI: 10.17615/r9d0-bj60

El Niño in a changing climate: a multi-model study
journal, January 2005

  • van Oldenborgh, G. J.; Philip, S.; Collins, M.
  • Ocean Science Discussions, Vol. 2, Issue 3
  • DOI: 10.5194/osd-2-267-2005

Probabilistic Multimodel Regional Temperature Change Projections
text, January 2006

  • Greene, Arthur M.; Goddard, Lisa M.; Lall, Upmanu
  • Columbia University
  • DOI: 10.7916/d8t72hbb

EURO-CORDEX: new high-resolution climate change projections for European impact research
text, January 2014


The response of the North American Monsoon to increased greenhouse gas forcing
text, January 2013