DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Learning Forecasts of Rare Stratospheric Transitions from Short Simulations

Journal Article · · Monthly Weather Review
 [1];  [2];  [3];  [4];  [3]
  1. a Committee on Computational and Applied Mathematics, University of Chicago, Chicago, Illinois
  2. b Department of Computing and Mathematical Sciences, California Institute of Technology, Pasadena, California
  3. c Courant Institute of Mathematical Sciences, New York University, New York, New York
  4. d Department of Geophysical Sciences, University of Chicago, Chicago, Illinois

Abstract Rare events arising in nonlinear atmospheric dynamics remain hard to predict and attribute. We address the problem of forecasting rare events in a prototypical example, sudden stratospheric warmings (SSWs). Approximately once every other winter, the boreal stratospheric polar vortex rapidly breaks down, shifting midlatitude surface weather patterns for months. We focus on two key quantities of interest: the probability of an SSW occurring, and the expected lead time if it does occur, as functions of initial condition. These optimal forecasts concretely measure the event’s progress. Direct numerical simulation can estimate them in principle but is prohibitively expensive in practice: each rare event requires a long integration to observe, and the cost of each integration grows with model complexity. We describe an alternative approach using integrations that are short compared to the time scale of the warming event. We compute the probability and lead time efficiently by solving equations involving the transition operator, which encodes all information about the dynamics. We relate these optimal forecasts to a small number of interpretable physical variables, suggesting optimal measurements for forecasting. We illustrate the methodology on a prototype SSW model developed by Holton and Mass and modified by stochastic forcing. While highly idealized, this model captures the essential nonlinear dynamics of SSWs and exhibits the key forecasting challenge: the dramatic separation in time scales between a single event and the return time between successive events. Our methodology is designed to fully exploit high-dimensional data from models and observations, and has the potential to identify detailed predictors of many complex rare events in meteorology.

Sponsoring Organization:
USDOE
Grant/Contract Number:
SC0019323; SC0020427
OSTI ID:
1834220
Journal Information:
Monthly Weather Review, Journal Name: Monthly Weather Review Journal Issue: 11 Vol. 149; ISSN 0027-0644
Publisher:
American Meteorological SocietyCopyright Statement
Country of Publication:
United States
Language:
English

References (77)

Data-assisted reduced-order modeling of extreme events in complex dynamical systems journal May 2018
Predicting observed and hidden extreme events in complex nonlinear dynamical systems with partial observations and short training time series journal March 2020
An early warning indicator for atmospheric blocking events using transfer operators journal March 2015
Experimental Evidence of Hydrodynamic Instantons: The Universal Route to Rogue Waves journal December 2019
Practical rare event sampling for extreme mesoscale weather journal May 2019
Influence of blocking on Northern European and Western Russian heatwaves in large climate model ensembles journal May 2018
Computing committor functions for the study of rare events using deep learning journal August 2019
Simulation of the 23 July 2012 extreme space weather event: What if this extremely rare CME was Earth directed?: THE 23 JULY 2012 SPACE WEATHER EVENT journal December 2013
A mathematical framework for stochastic climate models journal January 2001
Noise‐induced vortex‐splitting stratospheric sudden warmings journal January 2019
Extraction and prediction of indices for monsoon intraseasonal oscillations: an approach based on nonlinear Laplacian spectral analysis journal January 2017
A new mathematical framework for atmospheric blocking events journal November 2019
Towards a Theory of Transition Paths journal May 2006
Langevin Dynamics, Large Deviations and Instantons for the Quasi-Geostrophic Model and Two-Dimensional Euler Equations journal July 2014
Computation of Extreme Values of Time Averaged Observables in Climate Models with Large Deviation Techniques journal November 2019
Solving for high-dimensional committor functions using artificial neural networks journal October 2018
The Torino Impact Hazard Scale journal April 2000
Kac’s moment formula and the Feynman–Kac formula for additive functionals of a Markov process journal January 1999
Particle filtering with path sampling and an application to a bimodal ocean current model journal July 2009
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
Toward a stochastic parameterization of ocean mesoscale eddies journal July 2014
Transition networks for modeling the kinetics of conformational change in macromolecules journal April 2008
Markov state models of biomolecular conformational dynamics journal April 2014
Collective variables for the study of long-time kinetics from molecular trajectories: theory and methods journal April 2017
Everything you wanted to know about Markov State Models but were afraid to ask journal September 2010
Koopman analysis of the long-term evolution in a turbulent convection cell journal May 2018
Long-Time-Scale Predictions from Short-Trajectory Data: A Benchmark Analysis of the Trp-Cage Miniprotein journal April 2021
Integrated Variational Approach to Conformational Dynamics: A Robust Strategy for Identifying Eigenfunctions of Dynamical Operators journal September 2020
Maximizing Simulated Tropical Cyclone Intensity With Action Minimization journal April 2019
Applications of Deep Learning to Ocean Data Inference and Subgrid Parameterization journal January 2019
Analog Forecasting of Extreme‐Causing Weather Patterns Using Deep Learning journal February 2020
VAMPnets for deep learning of molecular kinetics journal January 2018
The sub-seasonal to seasonal prediction project (S2S) and the prediction of extreme events journal March 2018
Illustration of transition path theory on a collection of simple examples journal August 2006
Rare Event Sampling Methods journal August 2019
Transition paths of marine debris and the stability of the garbage patches journal March 2021
Constructing the equilibrium ensemble of folding pathways from short off-equilibrium simulations journal November 2009
Nonlinear Laplacian spectral analysis for time series with intermittency and low-frequency variability journal January 2012
Rogue waves and large deviations in deep sea journal January 2018
Computation of extreme heat waves in climate models using a large deviation algorithm journal December 2017
Solving high-dimensional partial differential equations using deep learning journal August 2018
Sequential sampling strategy for extreme event statistics in nonlinear dynamical systems journal October 2018
Control and instanton trajectories for random transitions in turbulent flows journal December 2011
Rare Event Algorithm Links Transitions in Turbulent Flows with Activated Nucleations journal February 2019
A variational approach to probing extreme events in turbulent dynamical systems journal September 2017
Solving the quantum many-body problem with artificial neural networks journal February 2017
Long‐Time Protein Folding Dynamics from Short‐Time Molecular Dynamics Simulations journal January 2006
Transition Path Theory for Markov Jump Processes journal January 2009
Time-Scale Separation from Diffusion-Mapped Delay Coordinates journal January 2013
An MCMC Algorithm for Parameter Estimation in Signals with Hidden Intermittent Instability journal January 2014
Statistics of Extreme Events in Fluid Flows and Waves journal January 2021
Transition-Path Theory and Path-Finding Algorithms for the Study of Rare Events journal March 2010
A Simple Model of Stratospheric Dynamics Including Solar Variability journal May 2003
Deterministic Nonperiodic Flow journal March 1963
A Dynamical Model of the Stratospheric Sudden Warming journal November 1971
Stratospheric Vacillation Cycles journal November 1976
Multiple Flow Equilibria in the Atmosphere and Blocking journal July 1979
Persistent Anomalies, Blocking and Variations in Atmospheric Predictability journal March 1985
Bifurcation Properties of a Stratospheric Vacillation Model journal July 1987
Dynamical Aspects of Stratospheric Vacillations in a Highly Truncated Model journal December 1987
A Stochastically Excited Linear System as a Model for Quasigeostrophic Turbulence:Analytic Results for One- and Two-Layer Fluids journal July 1995
Chaos, Quasiperiodicity, and Interannual Variability: Studies of a Stratospheric Vacillation Model journal September 2000
A Nonlinear Theory for El Niño Bursting journal January 2003
Regime Transitions and Heteroclinic Connections in a Barotropic Atmosphere journal January 2003
A Spectral Stochastic Kinetic Energy Backscatter Scheme and Its Impact on Flow-Dependent Predictability in the ECMWF Ensemble Prediction System journal March 2009
Sudden Stratospheric Warmings as Noise-Induced Transitions journal October 2008
Effects of Moist Convection on Hurricane Predictability journal July 2009
Stratospheric Wave–Mean Flow Feedbacks and Sudden Stratospheric Warmings in a Simple Model Forced by Upward Wave Activity Flux journal November 2014
A New Interpretation of Vortex-Split Sudden Stratospheric Warmings in Terms of Equilibrium Statistical Mechanics journal November 2017
Path Properties of Atmospheric Transitions: Illustration with a Low-Order Sudden Stratospheric Warming Model journal July 2020
Low-Order Stochastic Mode Reduction for a Prototype Atmospheric GCM journal February 2006
The Response of Damaging Winds of a Simulated Tropical Cyclone to Finite-Amplitude Perturbations of Different Variables journal July 2006
A New Look at Stratospheric Sudden Warmings. Part I: Climatology and Modeling Benchmarks journal February 2007
Data Assimilation in the Low Noise Regime with Application to the Kuroshio journal June 2013
Stochastic climate models Part I. Theory journal January 1976
Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism journal January 2021
Physics-informed machine learning: case studies for weather and climate modelling journal February 2021