DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Climate-invariant machine learning

Journal Article · · Science Advances
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3]; ORCiD logo [4];  [4]; ORCiD logo [4]; ORCiD logo [4];  [5];  [6]; ORCiD logo [3]; ORCiD logo [6]; ORCiD logo [7]; ORCiD logo [8]
  1. University of Lausanne (Switzerland); University of California, Irvine, CA (United States); OSTI
  2. Columbia University, New York, NY (United States)
  3. Massachusetts Institute of Technology, Cambridge, MA (United States)
  4. University of California, Irvine, CA (United States)
  5. Google Research, Mountain View, CA (United States)
  6. University of California, Los Angeles, CA (United States)
  7. University of California, San Diego, La Jolla, CA (United States)
  8. University of California, Irvine, CA (United States); NVIDIA, Santa Clara, CA (United States)

Projecting climate change is a generalization problem: We extrapolate the recent past using physical models across past, present, and future climates. Current climate models require representations of processes that occur at scales smaller than model grid size, which have been the main source of model projection uncertainty. Recent machine learning (ML) algorithms hold promise to improve such process representations but tend to extrapolate poorly to climate regimes that they were not trained on. To get the best of the physical and statistical worlds, we propose a framework, termed “climate-invariant” ML, incorporating knowledge of climate processes into ML algorithms, and show that it can maintain high offline accuracy across a wide range of climate conditions and configurations in three distinct atmospheric models. Our results suggest that explicitly incorporating physical knowledge into data-driven models of Earth system processes can improve their consistency, data efficiency, and generalizability across climate regimes.

Research Organization:
University of California, San Diego, CA (United States); University of California, Irvine, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC); National Science Foundation (NSF); Schmidt Family Foundation
Grant/Contract Number:
SC0022255; SC0022331
OSTI ID:
2472228
Journal Information:
Science Advances, Journal Name: Science Advances Journal Issue: 6 Vol. 10; ISSN 2375-2548
Publisher:
AAASCopyright Statement
Country of Publication:
United States
Language:
English

References (90)

A multiscale modeling framework model (superparameterized CAM5) with a higher‐order turbulence closure: Model description and low‐cloud simulations journal April 2015
A strategy for representing the effects of convective momentum transport in multiscale models: Evaluation using a new superparameterized version of the Weather Research and Forecast model (SP-WRF): CMT IN SP-WRF journal June 2015
Deep Learning for the Parametrization of Subgrid Processes in Climate Models book August 2021
Machine Learning for Clouds and Climate other December 2023
A critical view on the suitability of machine learning techniques to downscale climate change projections: Illustration for temperature with a toy experiment journal April 2022
Linear response functions of two convective parameterization schemes journal July 2013
An efficient and accurate correlated-k parameterization of infrared radiative transfer for troposphere–stratosphere–mesosphere GCMs journal July 2000
The (Un)reliability of Saliency Methods book January 2019
Adjusting spatial dependence of climate model outputs with cycle-consistent adversarial networks journal July 2021
Regional climate model emulator based on deep learning: concept and first evaluation of a novel hybrid downscaling approach journal July 2022
Bias Correcting Climate Change Simulations - a Critical Review journal October 2016
Tree approximation of the long wave radiation parameterization in the NCAR CAM global climate model journal September 2011
Reynolds averaged turbulence modelling using deep neural networks with embedded invariance journal October 2016
Random Forests journal January 2001
A cloud resolving model as a cloud parameterization in the NCAR Community Climate System Model: Preliminary results journal September 2001
An important constraint on tropical cloud - climate feedback: TROPICAL CLOUD-CLIMATE FEEDBACK journal October 2002
Could Machine Learning Break the Convection Parameterization Deadlock? journal June 2018
Prognostic Validation of a Neural Network Unified Physics Parameterization journal June 2018
FAT or FiTT: Are Anvil Clouds or the Tropopause Temperature Invariant? journal February 2019
A Linear Response Framework for Radiative‐Convective Instability journal August 2018
Using Machine Learning to Parameterize Moist Convection: Potential for Modeling of Climate, Climate Change, and Extreme Events journal October 2018
Insensitivity of the Cloud Response to Surface Warming Under Radical Changes to Boundary Layer Turbulence and Cloud Microphysics: Results From the Ultraparameterized CAM journal December 2018
Applications of Deep Learning to Ocean Data Inference and Subgrid Parameterization journal January 2019
Discovering the Importance of Mesoscale Cloud Organization Through Unsupervised Classification journal January 2020
Spatially Extended Tests of a Neural Network Parametrization Trained by Coarse‐Graining journal August 2019
A Benchmark to Test Generalization Capabilities of Deep Learning Methods to Classify Severe Convective Storms in a Changing Climate journal August 2021
Application of Deep Learning to Estimate Atmospheric Gravity Wave Parameters in Reanalysis Data Sets journal September 2020
On the Relationship Between Shallow Cumulus Cloud Field Properties and Surface Solar Irradiance journal November 2020
Use of Neural Networks for Stable, Accurate and Physically Consistent Parameterization of Subgrid Atmospheric Processes With Good Performance at Reduced Precision journal March 2021
A Large‐Scale Analysis of Pockets of Open Cells and Their Radiative Impact journal March 2021
A Moist Physics Parameterization Based on Deep Learning journal August 2020
Accelerating Radiation Computations for Dynamical Models With Targeted Machine Learning and Code Optimization journal December 2020
Machine Learning the Warm Rain Process journal February 2021
Potential and Limitations of Machine Learning for Modeling Warm‐Rain Cloud Microphysical Processes journal November 2020
Assessing the Potential of Deep Learning for Emulating Cloud Superparameterization in Climate Models With Real‐Geography Boundary Conditions journal May 2021
Machine Learning Emulation of Gravity Wave Drag in Numerical Weather Forecasting journal July 2021
Learning to Correct Climate Projection Biases journal October 2021
Stochastic‐Deep Learning Parameterization of Ocean Momentum Forcing journal September 2021
Machine Learning Gravity Wave Parameterization Generalizes to Capture the QBO and Response to Increased CO2 journal April 2022
Correcting a 200 km Resolution Climate Model in Multiple Climates by Machine Learning From 25 km Resolution Simulations journal September 2022
Neural‐Network Parameterization of Subgrid Momentum Transport in the Atmosphere journal April 2023
Climate goals and computing the future of clouds journal January 2017
Clouds, circulation and climate sensitivity journal March 2015
Stable machine-learning parameterization of subgrid processes for climate modeling at a range of resolutions journal July 2020
Deep learning and process understanding for data-driven Earth system science journal February 2019
Towards neural Earth system modelling by integrating artificial intelligence in Earth system science journal August 2021
GoAmazon2014/5 campaign points to deep-inflow approach to deep convection across scales journal April 2018
Mean precipitation change from a deepening troposphere journal October 2018
Deep learning to represent subgrid processes in climate models journal September 2018
An Overview of Overfitting and its Solutions journal February 2019
Atmospheric Convection book February 1994
Enforcing Analytic Constraints in Neural Networks Emulating Physical Systems journal March 2021
Towards Physically-Consistent, Data-Driven Models of Convection conference September 2020
Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances journal June 2016
Visual Domain Adaptation: A survey of recent advances journal May 2015
A new metric for probability distributions journal July 2003
A Survey on Transfer Learning journal October 2010
Machine Learning for the Geosciences: Challenges and Opportunities journal August 2019
A Review of Domain Adaptation without Target Labels journal March 2021
Cyclical Learning Rates for Training Neural Networks conference March 2017
An Introduction to Dynamic Meteorology journal May 1973
A Survey of Unsupervised Deep Domain Adaptation journal September 2020
Relationships between Water Vapor Path and Precipitation over the Tropical Oceans journal April 2004
Thermal Equilibrium of the Atmosphere with a Given Distribution of Relative Humidity journal May 1967
Variability of Midtropospheric Moisture and Its Effect on Cloud-Top Height Distribution during TOGA COARE* journal December 1997
Cloud Resolving Modeling of the ARM Summer 1997 IOP: Model Formulation, Results, Uncertainties, and Sensitivities journal February 2003
A New Sea Surface Temperature and Sea Ice Boundary Dataset for the Community Atmosphere Model journal October 2008
Temporal Relations of Column Water Vapor and Tropical Precipitation journal April 2010
Breaking the Cloud Parameterization Deadlock journal November 2003
A Minimum Standard for Publishing Computational Results in the Weather and Climate Sciences journal July 2016
Combining Crowdsourcing and Deep Learning to Explore the Mesoscale Organization of Shallow Convection journal November 2020
Causal Evidence that Rotational Moisture Advection is Critical to the Superparameterized Madden–Julian Oscillation journal February 2014
Convective Self-Aggregation and Tropical Cyclogenesis under the Hypohydrostatic Rescaling journal January 2016
Reverse Engineering the Tropical Precipitation–Buoyancy Relationship journal May 2018
Linear Stability of Moist Convecting Atmospheres. Part I: From Linear Response Functions to a Simple Model and Applications to Convectively Coupled Waves journal September 2018
A Bayesian Approach for Statistical–Physical Bulk Parameterization of Rain Microphysics. Part I: Scheme Description journal March 2019
Deep Convective Adjustment of Temperature and Moisture journal June 2020
Tropical Precipitation Evolution in a Buoyancy-Budget Framework journal February 2021
Interpreting and Stabilizing Machine-Learning Parametrizations of Convection journal December 2020
Simulations of the Atmospheric General Circulation Using a Cloud-Resolving Model as a Superparameterization of Physical Processes journal July 2005
The Convective Cold Top and Quasi Equilibrium* journal May 2007
Resolving Convection in a Global Hypohydrostatic Model journal June 2007
Moist Static Energy Budget of MJO-like Disturbances in the Atmosphere of a Zonally Symmetric Aquaplanet journal April 2012
Upward Shift of the Atmospheric General Circulation under Global Warming: Theory and Simulations journal December 2012
Protected Convection as a Metric of Dry Air Influence on Precipitation journal May 2021
Testing the Fixed Anvil Temperature Hypothesis in a Cloud-Resolving Model journal May 2007
Stochastic Estimation of the Maximum of a Regression Function journal September 1952
Minimum Hellinger Distance Estimates for Parametric Models journal May 1977
A Value for n-Person Games book December 1953
Machine learning for numerical weather and climate modelling: a review journal November 2023