skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A Bayesian Deep Learning Approach to Near-Term Climate Prediction

Journal Article · · Journal of Advances in Modeling Earth Systems
DOI:https://doi.org/10.1029/2022ms003058· OSTI ID:1906948

Since model bias and associated initialization shock are serious shortcomings that reduce prediction skills in state-of-the-art decadal climate prediction efforts, we pursue a complementary machine-learning-based approach to climate prediction. The example problem setting we consider consists of predicting natural variability of the North Atlantic sea surface temperature on the interannual timescale in the pre-industrial control simulation of the Community Earth System Model. While previous works have considered the use of recurrent networks such as convolutional LSTMs and reservoir computing networks in this and other similar problem settings, we currently focus on the use of feedforward convolutional networks. In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill. Next, we go on to consider a probabilistic formulation of the same network based on Stein variational gradient descent and find that in addition to providing useful measures of predictive uncertainty, the probabilistic (Bayesian) version improves on its deterministic counterpart in terms of predictive skill. Finally, we characterize the reliability of the ensemble of machine learning models obtained in the probabilistic setting by using analysis tools developed in the context of ensemble numerical weather prediction.

Research Organization:
Brookhaven National Laboratory (BNL), Upton, NY (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR). Scientific Discovery through Advanced Computing (SciDAC)
Grant/Contract Number:
SC0012704; AC02-05CH11231; NERSC DDR-ERCAP0022110
OSTI ID:
1906948
Report Number(s):
BNL-223836-2022-JAAM
Journal Information:
Journal of Advances in Modeling Earth Systems, Vol. 14, Issue 10; ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (17)

Physics-informed machine learning: case studies for weather and climate modelling
  • Kashinath, K.; Mustafa, M.; Albert, A.
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 379, Issue 2194 https://doi.org/10.1098/rsta.2020.0093
journal February 2021
Bayesian deep learning with hierarchical prior: Predictions from limited and noisy data journal May 2020
The Relationship between Spread and Forecast Error in Extended-range Forecasts journal July 1991
Trust Region Methods book January 2000
Densely Connected Convolutional Networks conference July 2017
Deep Residual Learning for Image Recognition conference June 2016
Variational Inference: A Review for Statisticians journal July 2016
Identity Mappings in Deep Residual Networks book January 2016
Bayesian deep convolutional encoder–decoder networks for surrogate modeling and uncertainty quantification journal August 2018
Deep learning and process understanding for data-driven Earth system science journal February 2019
Spatio-Temporal Image Pattern Prediction Method Based on a Physical Model With Time-Varying Optical Flow journal May 2013
Cases for the nugget in modeling computer experiments journal December 2010
Drift dynamics in a coupled model initialized for decadal forecasts journal June 2015
Probabilistic machine learning and artificial intelligence journal May 2015
Deconvolution and Checkerboard Artifacts journal October 2016
Stochastic dynamic prediction journal December 1969
Global and Local Skill Forecasts journal June 1993