DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The effects of bias, drift, and trends in calculating anomalies for evaluating skill of seasonal-to-decadal initialized climate predictions

Journal Article · · Climate Dynamics
ORCiD logo [1];  [2];  [3];  [4];  [5];  [6];  [7]
  1. National Center for Atmospheric Research (NCAR), Boulder, CO (United States); UCAR
  2. Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
  3. Hadley Centre, Exeter (United Kingdom)
  4. National Center for Atmospheric Research (NCAR), Boulder, CO (United States); International Lab. for High Resolution Earth System Prediction (iHESP), College Station, TX (United States)
  5. Canadian Centre for Climate Modelling and Analysis, Victoria (Canada)
  6. Inst. Catalana de Recerca i Estudis Avançats (ICREA), Barcelona (Spain); Barcelona Supercomputing Center (BSC) (Spain)
  7. National Center for Atmospheric Research (NCAR), Boulder, CO (United States)

In initialized seasonal to decadal (S2D) predictions, model hindcasts rapidly drift away from the initial observed state and converge toward a preferred state characterized by systematic error, or bias. Bias and drift are among the greatest challenges facing initialized prediction today. Differences in trends between initial states and drifted states, combined with bias and drift, introduce complexities in calculating anomalies to assess skill of initialized predictions. We examine several methods of calculating anomalies using the Decadal Prediction Large Ensemble (DPLE) using the Community Earth System Model (CESM) initialized hindcasts and focus on Pacific and Atlantic SSTs to illustrate issues with anomaly calculations. Three methods of computing anomalies, one as differences from a long term model climatology, another as bias-adjusted differences from the previous 15 year average from observations, and a third as differences from the previous 15 year average from the model, are contrasted and each is shown to have limitations. For the first, trends in bias and drift introduce higher skill estimates earlier and later in the hindcast period due to the trends that contribute to skill. For the second, higher skill can be introduced in situations where low frequency variability in the observations is large compared to the hindcasts on timescales greater than 15 years, while lower skill can result if the predicted signal is small and the bias-correction itself produces a transition of SST anomalies to the opposite sign of those that are observed. The third method has somewhat lower skill compared to each of the others, but has less difficulties with not only the long term trends in the model climatology, but also with the unrealistic situational skill from using observations as a reference. However, the first 15 years of the hindcast period cannot be evaluated due to having to wait to accumulate the previous 15 year model climatology before the method can be applied. Here, the IPO transition in the 2014–2016 time frame from negative to positive (predicted by Meehl et al. in in Nat Commun, 10.1038/NCOMMS11718, 2016) did indeed verify using all three methods, though each provides somewhat different skill values as a result of the respective limitations. There is no clear best method, as all are roughly comparable, and each has its own set of limitations and caveats. However, all three methods show generally higher overall skill in the AMO region compared to the IPO region.

Research Organization:
University Corporation for Atmospheric Research (UCAR), Boulder, CO (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER)
Grant/Contract Number:
SC0022070
OSTI ID:
1891517
Journal Information:
Climate Dynamics, Journal Name: Climate Dynamics Journal Issue: 11-12 Vol. 59; ISSN 0930-7575
Publisher:
Springer-VerlagCopyright Statement
Country of Publication:
United States
Language:
English

References (26)

Decadal Prediction: Can It Be Skillful? journal October 2009
The Decadal Climate Prediction Project (DCPP) contribution to CMIP6 journal January 2016
Methodological aspects of the validation of decadal predictions journal January 2013
Enhancing Skill of Initialized Decadal Predictions Using a Dynamic Model of Drift journal August 2019
Recalibrating decadal climate predictions – what is an adequate model for the drift? journal July 2021
Robust skill of decadal climate predictions journal May 2019
Probabilistic evaluation of decadal prediction skill regarding Northern Hemisphere winter storms [Probabilistic evaluation of decadal prediction skill regarding Northern Hemisphere winter storms] journal December 2016
A verification framework for interannual-to-decadal predictions experiments journal August 2012
Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century journal January 2003
Initialized Earth System prediction from subseasonal to decadal timescales journal April 2021
Climate model simulations of the observed early-2000s hiatus of global warming journal September 2014
Parametric decadal climate forecast recalibration (DeFoReSt 1.0) journal January 2018
Initialized near-term regional climate change prediction journal April 2013
Effects of the Mount Pinatubo eruption on decadal climate prediction skill of Pacific sea surface temperatures: PINATUBO AND DECADAL PREDICTION SKILL journal December 2015
Decadal Variability of Asian–Australian Monsoon–ENSO–TBO Relationships journal September 2011
CMIP5 multi-model hindcasts for the mid-1970s shift and early 2000s hiatus and predictions for 2016-2035: Meehl and Teng: Initialized hindcasts and predictions journal March 2014
Effects of volcanism on tropical variability: EFFECTS OF VOLCANISM journal July 2015
Observed multivariable signals of late 20th and early 21st century volcanic activity journal January 2015
Initialized decadal prediction for transition to positive phase of the Interdecadal Pacific Oscillation journal June 2016
Decadal Climate Prediction: An Update from the Trenches journal February 2014
Decadal Climate Variability and Predictability: Challenges and Opportunities journal March 2018
Statistical adjustment of decadal predictions in a changing climate: STATISTICAL ADJUSTMENT OF PREDICTIONS journal October 2012
Decadal climate variability in the tropical Pacific: Characteristics, causes, predictability, and prospects journal October 2021
Best Practices for Postprocessing Ensemble Climate Forecasts. Part I: Selecting Appropriate Recalibration Methods journal September 2016
Predicting Near-Term Changes in the Earth System: A Large Ensemble of Initialized Decadal Prediction Simulations Using the Community Earth System Model journal September 2018
A posteriori adjustment of near-term climate predictions: Accounting for the drift dependence on the initial conditions journal July 2014