Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Separating Physics and Dynamics Grids for Improved Computational Efficiency in Spectral Element Earth System Models

Journal Article · · Journal of Advances in Modeling Earth Systems
DOI:https://doi.org/10.1029/2020ms002419· OSTI ID:1810335
Previous studies have shown that atmospheric models with a spectral element grid can benefit from putting physics calculations on a relatively coarse finite volume grid. Here we demonstrate an alternative high-order, element-based mapping approach used to implement a quasi-equal-area, finite volume physics grid in E3SM. Unlike similar methods, the new method in E3SM requires topology data purely local to each spectral element, which trivially allows for regional mesh refinement. Simulations with physics grids defined by 2 × 2, 3 × 3, and 4 × 4 divisions of each element are shown to verify that the alternative physics grid does not qualitatively alter the model solution. The model performance is substantially affected by the reduction of physics columns when using the 2 × 2 grid, which can increase the throughput of physics calculations by roughly 60%–120% depending on whether the computational resources are configured to maximize throughput or efficiency. A pair of regionally refined cases are also shown to highlight the refinement capability.
Research Organization:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC04-94AL85000; AC52-07NA27344
OSTI ID:
1810335
Alternate ID(s):
OSTI ID: 1839872
Report Number(s):
LLNL-JRNL--815602; SAND--2021-7186J; 696922
Journal Information:
Journal of Advances in Modeling Earth Systems, Journal Name: Journal of Advances in Modeling Earth Systems Journal Issue: 7 Vol. 13; ISSN 1942-2466
Publisher:
American Geophysical Union (AGU)Copyright Statement
Country of Publication:
United States
Language:
English

References (26)

The “Cubed Sphere”: A New Method for the Solution of Partial Differential Equations in Spherical Geometry journal March 1996
Spectral Methods: Evolution to Complex Geometrics and Applications to Fluid Dynamics book January 2007
A compatible and conservative spectral element method on unstructured grids journal August 2010
A multi-resolution approach to global ocean modeling journal September 2013
Understanding Cloud and Convective Characteristics in Version 1 of the E3SM Atmosphere Model journal October 2018
An Evaluation of the Ocean and Sea Ice Climate of E3SM Using MPAS and Interannual CORE‐II Forcing journal May 2019
The DOE E3SM Coupled Model Version 1: Overview and Evaluation at Standard Resolution journal July 2019
An Overview of the Atmospheric Component of the Energy Exascale Earth System Model journal August 2019
Exploring a Lower‐Resolution Physics Grid in CAM‐SE‐CSLAM journal July 2019
Initial Results From the Super‐Parameterized E3SM journal January 2020
The DOE E3SM Coupled Model Version 1: Description and Results at High Resolution journal December 2019
A mass and energy conserving spectral element atmospheric dynamical core on the cubed-sphere grid journal July 2007
Communication-Efficient Property Preservation in Tracer Transport journal January 2019
The resolution of global spectral models journal September 1992
Believable Scales and Parameterizations in a Spectral Transform Model journal February 1997
An Overview of CMIP5 and the Experiment Design journal April 2012
The Community Earth System Model: A Framework for Collaborative Research journal September 2013
Arbitrary-Order Conservative and Consistent Remapping and a Theory of Linear Maps: Part I journal June 2015
CAM-SE–CSLAM: Consistent Coupling of a Conservative Semi-Lagrangian Finite-Volume Method with Spectral Element Dynamics journal March 2017
Physics–Dynamics Coupling with Element-Based High-Order Galerkin Methods: Quasi-Equal-Area Physics Grid journal January 2019
Evaluating Mesoscale NWP Models Using Kinetic Energy Spectra journal December 2004
CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model journal November 2011
HOMMEXX 1.0: a performance-portable atmospheric dynamical core for the Energy Exascale Earth System Model journal January 2019
Regionally refined test bed in E3SM atmosphere model version 1 (EAMv1) and applications for high-resolution modeling journal January 2019
A standard test case suite for two-dimensional linear transport on the sphere journal January 2012
NCAR global model topography generation software for unstructured grids journal January 2015