DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: An Objective and Efficient Method for Assessing the Impact of Reduced-Precision Calculations On Solution Correctness

Journal Article · · Journal of Advances in Modeling Earth Systems

Recent studies have shown that reducing the precision of floating-point calculations in an atmospheric model can improve the models' computational performance without affecting model fidelity, but code changes are needed to accommodate lower precision, and a small number of calculations might need to retain higher precision to prevent undue round-off error. For complex and computationally expensive systems like the Energy Exascale Earth System Model (E3SM), a method is needed to objectively assess the quality of the lower-precision simulations and to quickly identify problematic code pieces This paper demonstrates that solution correctness can be evaluated through a simple and quantitative error metric based on time step convergence. The proposed test method can unambiguously detect the accumulation of precision error and objectively assess its impact on solution accuracy. Since fast physical processes are known to affect key features of the multi-year mean climate in an atmospheric model, we show that the convergence test applied to short simulations can provide useful information about the impact of reduced precision on a model’s long-term behavior. In contrast, the traditional way of climate model evaluation requires multi-year simulations and involves inspecting many physical quantities for statistical significance in the presence of natural variability. The simplicity, computational efficiency, and objectivity of the proposed method makes it very attractive for high-resolution model development. The method is also expected to be applicable to other models that numerically solve time evolution equations.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Biological and Environmental Research (BER); USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC05-76RL01830; AC52‐07NA27344; AC02‐05CH11231
OSTI ID:
1608761
Alternate ID(s):
OSTI ID: 1762883
Report Number(s):
PNNL-SA-145080; LLNL-JRNL-818576
Journal Information:
Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 10; ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (55)

Climate forecasting: Build high-resolution global climate models journal November 2014
The use of imprecise processing to improve accuracy in weather & climate prediction journal August 2014
A study of reduced numerical precision to make superparameterization more competitive using a hardware emulator in the OpenIFS model: REDUCED PRECISION SUPERPARAMETRIZATION journal February 2017
Three-Dimensional Numerical Simulations of Tropical Systems Utilizing Nested Finite Grids journal November 1973
A New Two-Moment Bulk Stratiform Cloud Microphysics Scheme in the Community Atmosphere Model, Version 3 (CAM3). Part I: Description and Numerical Tests journal August 2008
Toward a minimal representation of aerosols in climate models: description and evaluation in the Community Atmosphere Model CAM5 journal January 2012
A PDF-Based Model for Boundary Layer Clouds. Part I: Method and Model Description journal December 2002
CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model journal November 2011
Sensitivity of climate simulations to the parameterization of cumulus convection in the Canadian climate centre general circulation model journal September 1995
On the Importance of Precision for Short-Range Forecasting and Climate Simulation journal December 1973
Short ensembles: an efficient method for discerning climate-relevant sensitivities in atmospheric general circulation models journal January 2014
More reliable forecasts with less precise computations: a fast-track route to cloud-resolved weather and climate simulators? journal June 2014
Small-Scale and Mesoscale Variability in Cloudy Boundary Layers: Joint Probability Density Functions journal December 2002
Diagnosis of Community Atmospheric Model 2 (CAM2) in numerical weather forecast configuration at Atmospheric Radiation Measurement sites journal January 2005
How to use mixed precision in ocean models: exploring a potential reduction of numerical precision in NEMO 4.0 and ROMS 3.6 journal January 2019
A compatible and conservative spectral element method on unstructured grids journal August 2010
Rotated Versions of the Jablonowski Steady-State and Baroclinic Wave Test Cases: A Dynamical Core Intercomparison: ROTATED TEST CASES AND DYNAMICAL CORE INTERCOMPARISONS journal April 2010
A “Vertically Lagrangian” Finite-Volume Dynamical Core for Global Models journal October 2004
Bitwise efficiency in chaotic models
  • Jeffress, Stephen; Düben, Peter; Palmer, Tim
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 473, Issue 2205 https://doi.org/10.1098/rspa.2017.0144
journal September 2017
On the Correspondence between Short- and Long-Time-Scale Systematic Errors in CAM4/CAM5 for the Year of Tropical Convection journal November 2012
LAPACK Users' Guide software January 1999
Optimization-based limiters for the spectral element method journal June 2014
Reliable low precision simulations in land surface models journal December 2017
A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0) journal January 2017
The DOE E3SM Coupled Model Version 1: Overview and Evaluation at Standard Resolution journal July 2019
Improving Weather Forecast Skill through Reduced-Precision Data Assimilation journal January 2018
Single Precision in the Dynamical Core of a Nonhydrostatic Global Atmospheric Model: Evaluation Using a Baroclinic Wave Test Case journal February 2018
Evaluating Parameterizations in General Circulation Models: Climate Simulation Meets Weather Prediction journal December 2004
Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models journal January 2008
A baroclinic instability test case for atmospheric model dynamical cores journal October 2006
An Overview of the Atmospheric Component of the Energy Exascale Earth System Model journal August 2019
A power law for reduced precision at small spatial scales: Experiments with an SQG model journal April 2018
The ICON (ICOsahedral Non-hydrostatic) modelling framework of DWD and MPI-M: Description of the non-hydrostatic dynamical core
  • Zängl, Günther; Reinert, Daniel; Rípodas, Pilar
  • Quarterly Journal of the Royal Meteorological Society, Vol. 141, Issue 687 https://doi.org/10.1002/qj.2378
journal June 2014
On the Correspondence between Mean Forecast Errors and Climate Errors in CMIP5 Models journal February 2014
Evaluation of ensemble forecast uncertainty using a new proper score: Application to medium-range and seasonal forecasts
  • Christensen, H. M.; Moroz, I. M.; Palmer, T. N.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 141, Issue 687 https://doi.org/10.1002/qj.2375
journal May 2014
Short‐term time step convergence in a climate model journal February 2015
Comments “On the Importance of Precision for Short-Range Forecasting and Climate Simulation” journal August 1974
On the use of scale-dependent precision in Earth System modelling: Scale-Dependent Precision in Earth System Modelling journal January 2017
An Energy and Angular-Momentum Conserving Vertical Finite-Difference Scheme and Hybrid Vertical Coordinates journal April 1981
A high-order staggered finite-element vertical discretization for non-hydrostatic atmospheric models journal January 2016
The ICON-1.2 hydrostatic atmospheric dynamical core on triangular grids – Part 1: Formulation and performance of the baseline version journal January 2013
Single Precision in Weather Forecasting Models: An Evaluation with the IFS journal February 2017
Advanced Two-Moment Bulk Microphysics for Global Models. Part I: Off-Line Tests and Comparison with Other Schemes journal February 2015
Moisture and temperature balances at the Atmospheric Radiation Measurement Southern Great Plains Site in forecasts with the Community Atmosphere Model (CAM2) journal January 2005
A New Class of Optimal High-Order Strong-Stability-Preserving Time Discretization Methods journal January 2002
On the use of programmable hardware and reduced numerical precision in earth-system modeling: REDUCED PRECISION IN GEOSCIENCE journal September 2015
Time Step Sensitivity of Nonlinear Atmospheric Models: Numerical Convergence, Truncation Error Growth, and Ensemble Design journal January 2007
Choosing the Optimal Numerical Precision for Data Assimilation in the Presence of Model Error journal September 2018
Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction Systems journal October 2000
Toward Exascale Resilience journal September 2009
rpe v5: an emulator for reduced floating-point precision in large numerical simulations journal January 2017
Metrics and Diagnostics for Precipitation-Related Processes in Climate Model Short-Range Hindcasts journal March 2013
Toward a New Generation of World Climate Research and Computing Facilities journal October 2010
A New Number Format for Ensemble Simulations journal November 2018
One step integration methods of third-fourth order accuracy with large hyperbolic stability limits journal June 1984

Cited By (1)

Data from Zhang et al. (2019, JAMES, DOI: 10.1029/2019MS001817) dataset January 2019