DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: An Objective and Efficient Method for Assessing the Impact of Reduced-Precision Calculations On Solution Correctness

Journal Article · · Journal of Advances in Modeling Earth Systems

Recent studies have shown that reducing the precision of floating-point calculations in an atmospheric model can improve the models' computational performance without affecting model fidelity, but code changes are needed to accommodate lower precision, and a small number of calculations might need to retain higher precision to prevent undue round-off error. For complex and computationally expensive systems like the Energy Exascale Earth System Model (E3SM), a method is needed to objectively assess the quality of the lower-precision simulations and to quickly identify problematic code pieces This paper demonstrates that solution correctness can be evaluated through a simple and quantitative error metric based on time step convergence. The proposed test method can unambiguously detect the accumulation of precision error and objectively assess its impact on solution accuracy. Since fast physical processes are known to affect key features of the multi-year mean climate in an atmospheric model, we show that the convergence test applied to short simulations can provide useful information about the impact of reduced precision on a model’s long-term behavior. In contrast, the traditional way of climate model evaluation requires multi-year simulations and involves inspecting many physical quantities for statistical significance in the presence of natural variability. The simplicity, computational efficiency, and objectivity of the proposed method makes it very attractive for high-resolution model development. The method is also expected to be applicable to other models that numerically solve time evolution equations.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Biological and Environmental Research (BER); USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC05-76RL01830; AC52-07NA27344; AC02-05CH11231
OSTI ID:
1608761
Report Number(s):
PNNL-SA--145080
Journal Information:
Journal of Advances in Modeling Earth Systems, Journal Name: Journal of Advances in Modeling Earth Systems Journal Issue: 10 Vol. 11; ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (56)

Short‐term time step convergence in a climate model journal February 2015
On the use of programmable hardware and reduced numerical precision in earth-system modeling: REDUCED PRECISION IN GEOSCIENCE journal September 2015
A study of reduced numerical precision to make superparameterization more competitive using a hardware emulator in the OpenIFS model: REDUCED PRECISION SUPERPARAMETRIZATION journal February 2017
Evaluation of ensemble forecast uncertainty using a new proper score: Application to medium-range and seasonal forecasts
  • Christensen, H. M.; Moroz, I. M.; Palmer, T. N.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 141, Issue 687 https://doi.org/10.1002/qj.2375
journal May 2014
The ICON (ICOsahedral Non-hydrostatic) modelling framework of DWD and MPI-M: Description of the non-hydrostatic dynamical core
  • Zängl, Günther; Reinert, Daniel; Rípodas, Pilar
  • Quarterly Journal of the Royal Meteorological Society, Vol. 141, Issue 687 https://doi.org/10.1002/qj.2378
journal June 2014
On the use of scale-dependent precision in Earth System modelling: Scale-Dependent Precision in Earth System Modelling journal January 2017
A power law for reduced precision at small spatial scales: Experiments with an SQG model journal April 2018
Reliable low precision simulations in land surface models journal December 2017
One step integration methods of third-fourth order accuracy with large hyperbolic stability limits journal June 1984
A compatible and conservative spectral element method on unstructured grids journal August 2010
The use of imprecise processing to improve accuracy in weather & climate prediction journal August 2014
Optimization-based limiters for the spectral element method journal June 2014
Diagnosis of Community Atmospheric Model 2 (CAM2) in numerical weather forecast configuration at Atmospheric Radiation Measurement sites journal January 2005
Moisture and temperature balances at the Atmospheric Radiation Measurement Southern Great Plains Site in forecasts with the Community Atmosphere Model (CAM2) journal January 2005
Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models journal January 2008
Choosing the Optimal Numerical Precision for Data Assimilation in the Presence of Model Error journal September 2018
A New Number Format for Ensemble Simulations journal November 2018
The DOE E3SM Coupled Model Version 1: Overview and Evaluation at Standard Resolution journal July 2019
An Overview of the Atmospheric Component of the Energy Exascale Earth System Model journal August 2019
Climate forecasting: Build high-resolution global climate models journal November 2014
Sensitivity of climate simulations to the parameterization of cumulus convection in the Canadian climate centre general circulation model journal September 1995
Bitwise efficiency in chaotic models
  • Jeffress, Stephen; Düben, Peter; Palmer, Tim
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 473, Issue 2205 https://doi.org/10.1098/rspa.2017.0144
journal September 2017
More reliable forecasts with less precise computations: a fast-track route to cloud-resolved weather and climate simulators? journal June 2014
LAPACK Users' Guide software January 1999
A New Class of Optimal High-Order Strong-Stability-Preserving Time Discretization Methods journal January 2002
Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction Systems journal October 2000
On the Importance of Precision for Short-Range Forecasting and Climate Simulation journal December 1973
Comments “On the Importance of Precision for Short-Range Forecasting and Climate Simulation” journal August 1974
Three-Dimensional Numerical Simulations of Tropical Systems Utilizing Nested Finite Grids journal November 1973
Small-Scale and Mesoscale Variability in Cloudy Boundary Layers: Joint Probability Density Functions journal December 2002
A PDF-Based Model for Boundary Layer Clouds. Part I: Method and Model Description journal December 2002
An Energy and Angular-Momentum Conserving Vertical Finite-Difference Scheme and Hybrid Vertical Coordinates journal April 1981
A “Vertically Lagrangian” Finite-Volume Dynamical Core for Global Models journal October 2004
A New Two-Moment Bulk Stratiform Cloud Microphysics Scheme in the Community Atmosphere Model, Version 3 (CAM3). Part I: Description and Numerical Tests journal August 2008
Toward a New Generation of World Climate Research and Computing Facilities journal October 2010
Analysis and Reduction of Systematic Errors through a Seamless Approach to Modeling Weather and Climate journal November 2010
Evaluating Parameterizations in General Circulation Models: Climate Simulation Meets Weather Prediction journal December 2004
Time Step Sensitivity of Nonlinear Atmospheric Models: Numerical Convergence, Truncation Error Growth, and Ensemble Design journal January 2007
On the Correspondence between Short- and Long-Time-Scale Systematic Errors in CAM4/CAM5 for the Year of Tropical Convection journal November 2012
Metrics and Diagnostics for Precipitation-Related Processes in Climate Model Short-Range Hindcasts journal March 2013
On the Correspondence between Mean Forecast Errors and Climate Errors in CMIP5 Models journal February 2014
Advanced Two-Moment Bulk Microphysics for Global Models. Part I: Off-Line Tests and Comparison with Other Schemes journal February 2015
Single Precision in Weather Forecasting Models: An Evaluation with the IFS journal February 2017
Improving Weather Forecast Skill through Reduced-Precision Data Assimilation journal January 2018
Single Precision in the Dynamical Core of a Nonhydrostatic Global Atmospheric Model: Evaluation Using a Baroclinic Wave Test Case journal February 2018
Toward Exascale Resilience journal September 2009
CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model journal November 2011
A baroclinic instability test case for atmospheric model dynamical cores journal October 2006
Rotated Versions of the Jablonowski Steady-State and Baroclinic Wave Test Cases: A Dynamical Core Intercomparison: ROTATED TEST CASES AND DYNAMICAL CORE INTERCOMPARISONS journal April 2010
rpe v5: an emulator for reduced floating-point precision in large numerical simulations journal January 2017
A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0) journal January 2017
How to use mixed precision in ocean models: exploring a potential reduction of numerical precision in NEMO 4.0 and ROMS 3.6 journal January 2019
Toward a minimal representation of aerosols in climate models: description and evaluation in the Community Atmosphere Model CAM5 journal January 2012
The ICON-1.2 hydrostatic atmospheric dynamical core on triangular grids – Part 1: Formulation and performance of the baseline version journal January 2013
Short ensembles: an efficient method for discerning climate-relevant sensitivities in atmospheric general circulation models journal January 2014
A high-order staggered finite-element vertical discretization for non-hydrostatic atmospheric models journal January 2016

Cited By (2)

Data from Zhang et al. (2019, JAMES, DOI: 10.1029/2019MS001817) dataset January 2019
Data from Zhang et al. (2019, JAMES, DOI: 10.1029/2019MS001817) dataset January 2019