DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Estimating Uncertainty in Simulated ENSO Statistics

Journal Article · · Journal of Advances in Modeling Earth Systems
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3];  [4]; ORCiD logo [5]; ORCiD logo [6]; ORCiD logo [4]
  1. School of Earth Atmosphere and Environment Monash University Clayton VIC Australia, NOAA Pacific Marine Environmental Laboratory Seattle WA USA
  2. Lawrence Livermore National Laboratory Livermore CA USA
  3. NOAA Geophysical Fluid Dynamics Laboratory Princeton NJ USA
  4. NOAA Pacific Marine Environmental Laboratory Seattle WA USA
  5. LOCEAN‐IPSL CNRS‐IRD‐MNHN‐Sorbonne Université Paris France, NCAS‐Climate University of Reading Reading UK
  6. School of Earth Atmosphere and Environment Monash University Clayton VIC Australia, ARC Centre of Excellence for Climate Extremes Monash University Clayton VIC Australia

Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.

Sponsoring Organization:
USDOE
Grant/Contract Number:
NONE; AC52-07NA27344
OSTI ID:
2440096
Journal Information:
Journal of Advances in Modeling Earth Systems, Journal Name: Journal of Advances in Modeling Earth Systems Journal Issue: 9 Vol. 16; ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (16)

ENSO representation in climate models: from CMIP3 to CMIP5 journal April 2013
Trans-Pacific ENSO teleconnections pose a correlated risk to agriculture journal November 2018
Fair weather or foul? The macroeconomic effects of El Niño journal May 2017
Statistical Analysis in Climate Research book January 1999
Tropical Pacific Ocean heat content variations and ENSO persistence barriers journal January 2003
Are historical records sufficient to constrain ENSO simulations? journal January 2009
Toward Standardized Data Sets for Climate Model Experimentation journal July 2018
ENSO Change in Climate Projections: Forced Response or Internal Variability? journal October 2018
Presentation and Evaluation of the IPSL‐CM6A‐LR Climate Model journal July 2020
GISS‐E2.1: Configurations and Climatology journal August 2020
Robust Evaluation of ENSO in Climate Models: How Many Ensemble Members Are Needed? journal October 2021
A pan-tropical cascade of fire driven by El Niño/Southern Oscillation journal November 2017
Decadal climate variability in the tropical Pacific: Characteristics, causes, predictability, and prospects journal October 2021
THE WCRP CMIP3 Multimodel Dataset: A New Era in Climate Change Research journal September 2007
An Overview of CMIP5 and the Experiment Design journal April 2012
Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization journal January 2016