DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Accelerating Radiation Computations for Dynamical Models With Targeted Machine Learning and Code Optimization

Journal Article · · Journal of Advances in Modeling Earth Systems
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3];  [4]; ORCiD logo [5]
  1. Danish Meteorological Institute Copenhagen Denmark, Niels Bohr Institute University of Copenhagen Copenhagen Denmark
  2. Cooperative Institute for Research in Environmental Sciences University of Colorado Boulder Boulder CO USA, NOAA Physical Sciences Laboratory Boulder CO USA
  3. European Centre for Medium‐Range Weather Forecasts Reading UK
  4. Danish Meteorological Institute Copenhagen Denmark, European Centre for Medium‐Range Weather Forecasts Reading UK
  5. Niels Bohr Institute University of Copenhagen Copenhagen Denmark

Abstract Atmospheric radiation is the main driver of weather and climate, yet due to a complicated absorption spectrum, the precise treatment of radiative transfer in numerical weather and climate models is computationally unfeasible. Radiation parameterizations need to maximize computational efficiency as well as accuracy, and for predicting the future climate many greenhouse gases need to be included. In this work, neural networks (NNs) were developed to replace the gas optics computations in a modern radiation scheme (RTE+RRTMGP) by using carefully constructed models and training data. The NNs, implemented in Fortran and utilizing BLAS for batched inference, are faster by a factor of 1–6, depending on the software and hardware platforms. We combined the accelerated gas optics with a refactored radiative transfer solver, resulting in clear‐sky longwave (shortwave) fluxes being 3.5 (1.8) faster to compute on an Intel platform. The accuracy, evaluated with benchmark line‐by‐line computations across a large range of atmospheric conditions, is very similar to the original scheme with errors in heating rates and top‐of‐atmosphere radiative forcings typically below 0.1 K day −1 and 0.5 W m −2 , respectively. These results show that targeted machine learning, code restructuring techniques, and the use of numerical libraries can yield material gains in efficiency while retaining accuracy.

Sponsoring Organization:
USDOE
Grant/Contract Number:
SC0016593
OSTI ID:
1734807
Journal Information:
Journal of Advances in Modeling Earth Systems, Journal Name: Journal of Advances in Modeling Earth Systems Journal Issue: 12 Vol. 12; ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (28)

The correlated-k method for radiation calculations in nonhomogeneous atmospheres journal December 1989
Atmospheric radiative transfer modeling: a summary of the AER codes journal March 2005
A Study on the Impact of Parameterization of Physical Processes on Prediction of Tropical Cyclones over the Bay of Bengal With NCAR/PSU Mesoscale Model journal February 2004
Radiance and Jacobian intercomparison of radiative transfer models applied to HIRS and AMSU channels journal October 2001
Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models journal January 2008
Could Machine Learning Break the Convection Parameterization Deadlock? journal June 2018
Prognostic Validation of a Neural Network Unified Physics Parameterization journal June 2018
Using Deep Neural Networks as Cost‐Effective Surrogate Models for Super‐Parameterized E3SM Radiative Transfer journal June 2019
A Flexible and Efficient Radiation Scheme for the ECMWF Model journal August 2018
Developments in the MPI‐M Earth System Model version 1.2 (MPI‐ESM1.2) and Its Response to Increasing CO 2 journal April 2019
Evaluation of Machine Learning Classifiers for Predicting Deep Convection journal June 2019
Balancing Accuracy, Efficiency, and Flexibility in Radiation Calculations for Dynamical Models journal October 2019
Initial Results From the Super‐Parameterized E3SM journal January 2020
Benchmark Calculations of Radiative Forcing by Greenhouse Gases journal December 2020
Deep learning to represent subgrid processes in climate models journal September 2018
Hyperopt: a Python library for model selection and hyperparameter optimization journal January 2015
Predicting atmospheric optical properties for radiative transfer computations using neural networks
  • Veerman, Menno A.; Pincus, Robert; Stoffer, Robin
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 379, Issue 2194 https://doi.org/10.1098/rsta.2020.0095
journal February 2021
Optimizing Weather Model Radiative Transfer Physics for Intel’s Many Integrated Core (MIC) Architecture journal December 2016
Computational investigations of low-discrepancy sequences journal June 1997
Replicated Computational Results Certified BLIS: A Framework for Rapidly Instantiating BLAS Functionality journal June 2015
A parallel Fortran framework for neural networks and deep learning journal March 2019
On the Correlated k -Distribution Method for Radiative Transfer in Nonhomogeneous Atmospheres journal November 1992
Accurate and Fast Neural Network Emulations of Model Radiation for the NCEP Coupled Climate Forecast System: Climate Simulations and Seasonal Predictions* journal May 2010
The Full-Spectrum Correlated- k Method for Longwave Atmospheric Radiative Transfer Using an Effective Planck Function journal June 2010
Leveraging Modern Artificial Intelligence for Remote Sensing and NWP: Benefits and Challenges journal December 2019
A Simulation of a Supercell Thunderstorm with Emulated Radiative Cooling beneath the Anvil journal July 2005
Smartphone Pressure Collection and Bias Correction Using Machine Learning journal March 2018
The CAMS reanalysis of atmospheric composition journal January 2019