Title: Simulating Atmospheric Processes in Earth System Models and Quantifying Uncertainties With Deep Learning Multi‐Member and Stochastic Parameterizations

Journal Article · · Journal of Advances in Modeling Earth Systems
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3]; ORCiD logo [4]; ORCiD logo [5]; ORCiD logo [6]; ORCiD logo [7]; ORCiD logo [1]
  1. Deutsches Zentrum für Luft‐ und Raumfahrt (DLR) Institut für Physik der Atmosphäre Oberpfaffenhofen Germany, University of Bremen Institute of Environmental Physics (IUP) Bremen Germany
  2. Faculty of Geosciences and Environment University of Lausanne Lausanne Switzerland, Expertise Center for Climate Extremes University of Lausanne Lausanne Switzerland
  3. Deutsches Zentrum für Luft‐ und Raumfahrt (DLR) Institut für Physik der Atmosphäre Oberpfaffenhofen Germany, Predictia Intelligent Data Solutions S.L. Santander Spain
  4. Department of Earth System Science University of California Irvine Irvine CA USA, Intel Labs Multimodal Cognitive AI Research SantaClara CA USA
  5. Department of Earth and Environmental Engineering Columbia University New York NY USA, Earth Institute and Data Science Institute Columbia University New York NY USA
  6. Department of Earth System Science University of California Irvine Irvine CA USA, NVIDIA Santa Clara CA USA
  7. Deutsches Zentrum für Luft‐ und Raumfahrt (DLR) Institut für Physik der Atmosphäre Oberpfaffenhofen Germany

Abstract Deep learning is a powerful tool to represent subgrid processes in climate models, but many application cases have so far used idealized settings and deterministic approaches. Here, we develop stochastic parameterizations with calibrated uncertainty quantification to learn subgrid convective and turbulent processes and surface radiative fluxes of a superparameterization embedded in an Earth System Model (ESM). We explore three methods to construct stochastic parameterizations: (a) a single Deep Neural Network (DNN) with Monte Carlo Dropout; (b) a multi‐member parameterization; and (c) a Variational Encoder Decoder with latent space perturbation. We show that the multi‐member parameterization improves the representation of convective processes, especially in the planetary boundary layer, compared to individual DNNs. The respective uncertainty quantification illustrates that methods (b) and (c) are advantageous compared to a dropout‐based DNN parameterization regarding the spread of convective processes. Hybrid simulations with our best‐performing multi‐member parameterizations remained challenging and crash within the first days. Therefore, we develop a pragmatic partial coupling strategy relying on the superparameterization for condensate emulation. Partial coupling reduces the computational efficiency of hybrid Earth‐like simulations but enables model stability over 5 months with our multi‐member parameterizations. However, our hybrid simulations exhibit biases in thermodynamic fields and differences in precipitation patterns. Despite this, the multi‐member parameterizations enable improvements in reproducing tropical extreme precipitation compared to a traditional convection parameterization. Despite these challenges, our results indicate the potential of a new generation of multi‐member machine learning parameterizations leveraging uncertainty quantification to improve the representation of stochasticity of subgrid effects.

Sponsoring Organization:
USDOE
Grant/Contract Number:
SC0022331; SC0023368
OSTI ID:
2555915
Journal Information:
Journal of Advances in Modeling Earth Systems, Journal Name: Journal of Advances in Modeling Earth Systems Journal Issue: 4 Vol. 17; ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (44)

Restricting 32-128 km horizontal scales hardly affects the MJO in the Superparameterized Community Atmosphere Model v.3.0 but the number of cloud-resolving grid columns constrains vertical mixing journal August 2014
Sensitivity of Coupled Tropical Pacific Model Biases to Convective Parameterization in CESM1 journal January 2018
Deep Learning for the Parametrization of Subgrid Processes in Climate Models book August 2021
Stochastic climate theory and modeling journal October 2014
Stochastic parameterization of column physics using generative adversarial networks journal January 2022
Machine learning for stochastic parametrization journal January 2024
A cloud resolving model as a cloud parameterization in the NCAR Community Climate System Model: Preliminary results journal September 2001
Could Machine Learning Break the Convection Parameterization Deadlock? journal June 2018
Physically Constrained Stochastic Shallow Convection in Realistic Kilometer‐Scale Simulations journal November 2018
Quantifying Progress Across Different CMIP Phases With the ESMValTool journal October 2020
Multiple‐Instance Superparameterization: 1. Concept, and Predictability of Precipitation journal November 2019
Multiple‐Instance Superparameterization: 2. The Effects of Stochastic Convection on the Simulated Climate journal November 2019
Spatially Extended Tests of a Neural Network Parametrization Trained by Coarse‐Graining journal August 2019
Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Model journal March 2020
The Community Earth System Model Version 2 (CESM2) journal February 2020
Use of Neural Networks for Stable, Accurate and Physically Consistent Parameterization of Subgrid Atmospheric Processes With Good Performance at Reduced Precision journal March 2021
A Moist Physics Parameterization Based on Deep Learning journal August 2020
Assessing the Potential of Deep Learning for Emulating Cloud Superparameterization in Climate Models With Real‐Geography Boundary Conditions journal May 2021
Stochastic‐Deep Learning Parameterization of Ocean Momentum Forcing journal September 2021
Parameterization of Stochastically Entraining Convection Using Machine Learning Technique journal April 2022
Representing Cloud Mesoscale Variability in Superparameterized Climate Models journal August 2022
Deep Learning Based Cloud Cover Parameterization for ICON journal December 2022
Non‐Local Parameterization of Atmospheric Subgrid Processes With Neural Networks journal October 2022
Non‐Linear Dimensionality Reduction With a Variational Encoder Decoder to Understand Convective Processes in Climate Models journal August 2022
Correcting a 200 km Resolution Climate Model in Multiple Climates by Machine Learning From 25 km Resolution Simulations journal September 2022
Machine‐Learned Climate Model Corrections From a Global Storm‐Resolving Model: Performance Across the Annual Cycle journal May 2023
An Ensemble of Neural Networks for Moist Physics Processes, Its Generalizability and Stable Integration journal October 2023
Neural Network Parameterization of Subgrid‐Scale Physics From a Realistic Geography Global Storm‐Resolving Simulation journal February 2024
Generative Data‐Driven Approaches for Stochastic Subgrid Parameterizations in an Idealized Ocean Model journal October 2023
Improving the Reliability of ML‐Corrected Climate Models With Novelty Detection journal November 2023
Uncertainty Quantification of a Machine Learning Subgrid‐Scale Parameterization for Atmospheric Gravity Waves journal July 2024
Climate goals and computing the future of clouds journal January 2017
Deep learning to represent subgrid processes in climate models journal September 2018
Implicit learning of convective organization explains precipitation stochasticity journal May 2023
Sensitivity of climate simulations to the parameterization of cumulus convection in the Canadian climate centre general circulation model journal September 1995
Enforcing Analytic Constraints in Neural Networks Emulating Physical Systems journal March 2021
ATMOSPHERIC SCIENCE: Weather Forecasting with Ensemble Methods journal October 2005
A Fortran-Keras Deep Learning Bridge for Scientific Computing journal August 2020
A New Sea Surface Temperature and Sea Ice Boundary Dataset for the Community Atmosphere Model journal October 2008
Strictly Proper Scoring Rules, Prediction, and Estimation journal March 2007
Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization journal January 2016
SPCESM2 data sets dataset January 2024
EyringMLClimateGroup/behrens24james_SPCESM2_ML_ensembles: Simulating Atmospheric Processes in Earth System Models and Quantifying Uncertainties with Deep Learning Multi-Member and Stochastic Parameterizations software February 2025
raspstephan/CBRAIN-CAM software August 2018

Similar Records

Causally‐Informed Deep Learning to Improve Climate Models and Projections
Journal Article · 2024 · Journal of Geophysical Research: Atmospheres · OSTI ID:2308857

Deep learning to represent subgrid processes in climate models
Journal Article · 2018 · Proceedings of the National Academy of Sciences of the United States of America · OSTI ID:1468882

Learning Weight Uncertainty with Stochastic Gradient MCMC for Shape Classification
Conference · 2016 · OSTI ID:1334875

Related Subjects