CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity
Abstract
Using 5-day averaged precipitation from all initial condition realizations of 33 CMIP5 models for the Historical and RCP8.5scenarios, we performed an assessment of summer precipitation in terms of amount, onset date, withdrawal date, and length of season using probability distributions of interannual anomalies. Climate change projections were generated using all models, one model per modelling group to account for overconfidence, and sub-selecting models on annual cycle fidelity. Compared to using all models, sub-selecting on annual cycle fidelity has a large impact on the climate change perturbation of the fractional change in precipitation, with differences between the two projections of up to ± 50%, especially in the tropics and subtropics. Sensitivity testing indicates that the Gaussian t-test and the non-parametric Mann–Whitney U-test (the latter using Monte Carlo sampling) yield consistent results for assessing where the climate change perturbation is significant at the 1% level, even in cases where skewness and excess kurtosis indicate non-Gaussian behavior. Similarly, in terms of climate change induced perturbations to below-normal, normal, and above-normal categorical probabilities, the Gaussian results are typically consistent with the non-parametric estimates. We suggest these sensitivity results promote the use of Gaussian statistics to present global maps of the lower-bound and upper-bound ofmore »
- Authors:
-
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Univ. of Hawaii at Manoa, Honolulu, HI (United States)
- Publication Date:
- Research Org.:
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Biological and Environmental Research (BER); National Science Foundation (NSF)
- OSTI Identifier:
- 1598106
- Report Number(s):
- LLNL-JRNL-748698
Journal ID: ISSN 0930-7575; 933450
- Grant/Contract Number:
- AC52-07NA27344; 1460742
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Climate Dynamics
- Additional Journal Information:
- Journal Volume: 54; Journal Issue: 3-4; Journal ID: ISSN 0930-7575
- Publisher:
- Springer-Verlag
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 58 GEOSCIENCES; 54 ENVIRONMENTAL SCIENCES; Anthropogenic climate change; Precipitation; Annual cycle skill; Monte Carlo sampling
Citation Formats
Sperber, Kenneth R., Annamalai, H., and Pallotta, Giuliana. CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity. United States: N. p., 2020.
Web. doi:10.1007/s00382-019-05082-8.
Sperber, Kenneth R., Annamalai, H., & Pallotta, Giuliana. CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity. United States. https://doi.org/10.1007/s00382-019-05082-8
Sperber, Kenneth R., Annamalai, H., and Pallotta, Giuliana. Fri .
"CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity". United States. https://doi.org/10.1007/s00382-019-05082-8. https://www.osti.gov/servlets/purl/1598106.
@article{osti_1598106,
title = {CMIP5: a Monte Carlo assessment of changes in summertime precipitation characteristics under RCP8.5-sensitivity to annual cycle fidelity, overconfidence, and gaussianity},
author = {Sperber, Kenneth R. and Annamalai, H. and Pallotta, Giuliana},
abstractNote = {Using 5-day averaged precipitation from all initial condition realizations of 33 CMIP5 models for the Historical and RCP8.5scenarios, we performed an assessment of summer precipitation in terms of amount, onset date, withdrawal date, and length of season using probability distributions of interannual anomalies. Climate change projections were generated using all models, one model per modelling group to account for overconfidence, and sub-selecting models on annual cycle fidelity. Compared to using all models, sub-selecting on annual cycle fidelity has a large impact on the climate change perturbation of the fractional change in precipitation, with differences between the two projections of up to ± 50%, especially in the tropics and subtropics. Sensitivity testing indicates that the Gaussian t-test and the non-parametric Mann–Whitney U-test (the latter using Monte Carlo sampling) yield consistent results for assessing where the climate change perturbation is significant at the 1% level, even in cases where skewness and excess kurtosis indicate non-Gaussian behavior. Similarly, in terms of climate change induced perturbations to below-normal, normal, and above-normal categorical probabilities, the Gaussian results are typically consistent with the non-parametric estimates. We suggest these sensitivity results promote the use of Gaussian statistics to present global maps of the lower-bound and upper-bound of the climate change response, given that the non-parametric calculation of confidence intervals would otherwise not be tractable in a desktop computing environment due to its CPU intensive requirement.},
doi = {10.1007/s00382-019-05082-8},
journal = {Climate Dynamics},
number = 3-4,
volume = 54,
place = {United States},
year = {Fri Jan 03 00:00:00 EST 2020},
month = {Fri Jan 03 00:00:00 EST 2020}
}
Works referenced in this record:
Probabilistic Multimodel Regional Temperature Change Projections
journal, September 2006
- Greene, Arthur M.; Goddard, Lisa; Lall, Upmanu
- Journal of Climate, Vol. 19, Issue 17
Quantifying Uncertainty in Projections of Regional Climate Change: A Bayesian Approach to the Analysis of Multimodel Ensembles
journal, May 2005
- Tebaldi, Claudia; Smith, Richard L.; Nychka, Doug
- Journal of Climate, Vol. 18, Issue 10
A Climate-based Distribution Model of Malaria Transmission in Sub-Saharan Africa
journal, March 1999
- Craig, M. H.; Snow, R. W.; le Sueur, D.
- Parasitology Today, Vol. 15, Issue 3
Addressing Interdependency in a Multimodel Ensemble by Interpolation of Model Properties
journal, July 2015
- Sanderson, Benjamin M.; Knutti, Reto; Caldwell, Peter
- Journal of Climate, Vol. 28, Issue 13
Climate change and the South Asian summer monsoon
journal, June 2012
- Turner, Andrew G.; Annamalai, H.
- Nature Climate Change, Vol. 2, Issue 8
Global Precipitation: A 17-Year Monthly Analysis Based on Gauge Observations, Satellite Estimates, and Numerical Model Outputs
journal, November 1997
- Xie, Pingping; Arkin, Phillip A.
- Bulletin of the American Meteorological Society, Vol. 78, Issue 11
Models agree on forced response pattern of precipitation and temperature extremes
journal, December 2014
- Fischer, E. M.; Sedláček, J.; Hawkins, E.
- Geophysical Research Letters, Vol. 41, Issue 23
Subtropical Anticyclones and Summer Monsoons
journal, August 2001
- Rodwell, M. J.; Hoskins, B. J.
- Journal of Climate, Vol. 14, Issue 15
Holocene winter climate variability in mid-latitude western North America
journal, January 2012
- Ersek, Vasile; Clark, Peter U.; Mix, Alan C.
- Nature Communications, Vol. 3, Issue 1
Future change of Asian-Australian monsoon under RCP 4.5 anthropogenic warming scenario
journal, April 2013
- Wang, Bin; Yim, So-Young; Lee, June-Yi
- Climate Dynamics, Vol. 42, Issue 1-2
Monsoons in a changing world: A regional perspective in a global context: GLOBAL MONSOONS IN CMIP5 MODELS
journal, April 2013
- Kitoh, Akio; Endo, Hirokazu; Krishna Kumar, K.
- Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 8
An Overview of CMIP5 and the Experiment Design
journal, April 2012
- Taylor, Karl E.; Stouffer, Ronald J.; Meehl, Gerald A.
- Bulletin of the American Meteorological Society, Vol. 93, Issue 4
The Standard Error of Time-Average Estimates of Climatic Means
journal, September 1973
- Leith, C. E.
- Journal of Applied Meteorology, Vol. 12, Issue 6
El Niño in a changing climate: a multi-model study
journal, January 2005
- van Oldenborgh, G. J.; Philip, S. Y.; Collins, M.
- Ocean Science, Vol. 1, Issue 2
Analysis of historical changes in rainfall in the Indian Himalayas
journal, March 2009
- Basistha, Ashoke; Arya, D. S.; Goel, N. K.
- International Journal of Climatology, Vol. 29, Issue 4
Need for Caution in Interpreting Extreme Weather Statistics
journal, December 2015
- Sardeshmukh, Prashant D.; Compo, Gilbert P.; Penland, Cécile
- Journal of Climate, Vol. 28, Issue 23
The Asian summer monsoon: an intercomparison of CMIP5 vs. CMIP3 simulations of the late 20th century
journal, December 2012
- Sperber, K. R.; Annamalai, H.; Kang, I. -S.
- Climate Dynamics, Vol. 41, Issue 9-10
Malaria early warnings based on seasonal climate forecasts from multi-model ensembles
journal, February 2006
- Thomson, M. C.; Doblas-Reyes, F. J.; Mason, S. J.
- Nature, Vol. 439, Issue 7076
The use of fractional accumulated precipitation for the evaluation of the annual cycle of monsoons
journal, March 2014
- Sperber, Kenneth R.; Annamalai, H.
- Climate Dynamics, Vol. 43, Issue 12
Evaluating the “Rich-Get-Richer” Mechanism in Tropical Precipitation Change under Global Warming
journal, April 2009
- Chou, Chia; Neelin, J. David; Chen, Chao-An
- Journal of Climate, Vol. 22, Issue 8
The Global Precipitation Climatology Project (GPCP) Combined Precipitation Dataset
journal, January 1997
- Huffman, George J.; Adler, Robert F.; Arkin, Philip
- Bulletin of the American Meteorological Society, Vol. 78, Issue 1
Performance metrics for climate models
journal, January 2008
- Gleckler, P. J.; Taylor, K. E.; Doutriaux, C.
- Journal of Geophysical Research, Vol. 113, Issue D6
Robust Responses of the Hydrological Cycle to Global Warming
journal, November 2006
- Held, Isaac M.; Soden, Brian J.
- Journal of Climate, Vol. 19, Issue 21
A more realistic look at the robustness and Type II error properties of the t test to departures from population normality.
journal, January 1992
- Sawilowsky, Shlomo S.; Blair, R. Clifford
- Psychological Bulletin, Vol. 111, Issue 2
Weakening of the North American monsoon with global warming
journal, October 2017
- Pascale, Salvatore; Boos, William R.; Bordoni, Simona
- Nature Climate Change, Vol. 7, Issue 11
On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other
journal, March 1947
- Mann, H. B.; Whitney, D. R.
- The Annals of Mathematical Statistics, Vol. 18, Issue 1
Projections of a Wetter Sahel in the Twenty-First Century from Global and Regional Models
journal, July 2013
- Vizy, Edward K.; Cook, Kerry H.; Crétat, Julien
- Journal of Climate, Vol. 26, Issue 13
The Asian Monsoon and its Future Change in Climate Models: A Review
journal, January 2017
- Kitoh, Akio
- Journal of the Meteorological Society of Japan. Ser. II, Vol. 95, Issue 1
Attribution of extreme weather to anthropogenic greenhouse gas emissions: Sensitivity to spatial and temporal scales
journal, March 2014
- Angélil, Oliver; Stone, Dáithí A.; Tadross, Mark
- Geophysical Research Letters, Vol. 41, Issue 6
Tropical Australian climate and the Australian monsoon as simulated by 23 CMIP3 models
journal, January 2011
- Colman, R. A.; Moise, A. F.; Hanson, L. I.
- Journal of Geophysical Research, Vol. 116, Issue D10
IPCC global coupled model simulations of the South America monsoon system
journal, November 2008
- Bombardi, Rodrigo J.; Carvalho, Leila M. V.
- Climate Dynamics, Vol. 33, Issue 7-8
The response of the North American Monsoon to increased greenhouse gas forcing: NA MONSOON AND GHG WARMING
journal, February 2013
- Cook, B. I.; Seager, R.
- Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 4
Climate Change in the South American Monsoon System: Present Climate and CMIP5 Projections
journal, September 2013
- Jones, Charles; Carvalho, Leila M. V.
- Journal of Climate, Vol. 26, Issue 17
The Wilcoxon–Mann–Whitney Procedure Fails as a Test of Medians
journal, January 2018
- Divine, George W.; Norton, H. James; Barón, Anna E.
- The American Statistician, Vol. 72, Issue 3
Changes in temperature and precipitation extremes in the CMIP5 ensemble
journal, February 2013
- Kharin, V. V.; Zwiers, F. W.; Zhang, X.
- Climatic Change, Vol. 119, Issue 2
Quantifying uncertainty in twenty-first century climate change over India
journal, July 2018
- Singh, Ram; AchutaRao, K.
- Climate Dynamics, Vol. 52, Issue 7-8
Forced Sahel rainfall trends in the CMIP5 archive: FORCED RAINFALL TRENDS IN THE SAHEL
journal, February 2013
- Biasutti, M.
- Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 4
EURO-CORDEX: new high-resolution climate change projections for European impact research
journal, July 2013
- Jacob, Daniela; Petersen, Juliane; Eggert, Bastian
- Regional Environmental Change, Vol. 14, Issue 2
GPCP Pentad Precipitation Analyses: An Experimental Dataset Based on Gauge Observations and Satellite Estimates
journal, July 2003
- Xie, Pingping; Janowiak, John E.; Arkin, Phillip A.
- Journal of Climate, Vol. 16, Issue 13
A Probability and Decision-Model Analysis of a Multimodel Ensemble of Climate Change Simulations
journal, August 2001
- Räisänen, Jouni; Palmer, T. N.
- Journal of Climate, Vol. 14, Issue 15
The western Pacific monsoon in CMIP5 models: Model evaluation and projections: WESTERN PACIFIC MONSOON IN CMIP5
journal, November 2013
- Brown, Josephine R.; Colman, Robert A.; Moise, Aurel F.
- Journal of Geophysical Research: Atmospheres, Vol. 118, Issue 22
Long term spatial and temporal rainfall trends and homogeneity analysis in Wainganga basin, Central India
journal, August 2014
- Taxak, Arun Kumar; Murumkar, A. R.; Arya, D. S.
- Weather and Climate Extremes, Vol. 4
The modulated annual cycle: an alternative reference frame for climate anomalies
journal, July 2008
- Wu, Zhaohua; Schneider, Edwin K.; Kirtman, Ben P.
- Climate Dynamics, Vol. 31, Issue 7-8
Two Approaches to Quantifying Uncertainty in Global Temperature Changes
journal, October 2006
- Lopez, Ana; Tebaldi, Claudia; New, Mark
- Journal of Climate, Vol. 19, Issue 19
Quantifying Uncertainty in Projections of Regional Climate Change: A Bayesian Approach to the Analysis of Multimodel Ensembles
text, January 2005
- Claudia, Tebaldi,; L., Smith, Richard; Doug, Nychka,
- The University of North Carolina at Chapel Hill University Libraries
El Niño in a changing climate: a multi-model study
journal, January 2005
- van Oldenborgh, G. J.; Philip, S.; Collins, M.
- Ocean Science Discussions, Vol. 2, Issue 3
Probabilistic Multimodel Regional Temperature Change Projections
text, January 2006
- Greene, Arthur M.; Goddard, Lisa M.; Lall, Upmanu
- Columbia University
EURO-CORDEX: new high-resolution climate change projections for European impact research
text, January 2014
- Jacob, Daniela; Petersen, Juliane; Eggert, Bastian
- Karlsruhe
The response of the North American Monsoon to increased greenhouse gas forcing
text, January 2013
- Cook, Benjamin I.; Seager, Richard
- Columbia University