skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Asynchronous communication in spectral-element and discontinuous Galerkin methods for atmospheric dynamics – a case study using the High-Order Methods Modeling Environment (HOMME-homme_dg_branch)

Journal Article · · Geoscientific Model Development (Online)
 [1];  [2]
  1. National Center for Atmospheric Research, Boulder, CO (United States). Computational Information Systems Lab.
  2. National Center for Atmospheric Research, Boulder, CO (United States). Computational Information Systems Lab.; International Research Inst. of Stavanger (Norway)

The scalability of computational applications on current and next-generation supercomputers is increasingly limited by the cost of inter-process communication. We implement non-blocking asynchronous communication in the High-Order Methods Modeling Environment for the time integration of the hydrostatic fluid equations using both the spectral-element and discontinuous Galerkin methods. This allows the overlap of computation with communication, effectively hiding some of the costs of communication. A novel detail about our approach is that it provides some data movement to be performed during the asynchronous communication even in the absence of other computations. This method produces significant performance and scalability gains in large-scale simulations.

Research Organization:
National Center for Atmospheric Research (NCAR), Boulder, CO (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER); National Science Foundation (NSF)
Grant/Contract Number:
SC0006959
OSTI ID:
1437146
Journal Information:
Geoscientific Model Development (Online), Vol. 9, Issue 8; ISSN 1991-9603
Publisher:
European Geosciences UnionCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 2 works
Citation information provided by
Web of Science

References (17)

Integrating a scalable and effcient semi-Lagrangian multi-tracer transport scheme in HOMME journal January 2012
A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0) journal January 2015
CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model journal November 2011
A conservative multi-tracer transport scheme for spectral-element spherical grids journal January 2014
The Community Climate System Model Version 4 journal October 2011
Petascale High Order Dynamic Rupture Earthquake Simulations on Heterogeneous Supercomputers
  • Heinecke, Alexander; Breuer, Alexander; Rettenberger, Sebastian
  • SC14: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2014.6
conference November 2014
A baroclinic instability test case for atmospheric model dynamical cores journal October 2006
Pracniques: further remarks on reducing truncation errors journal January 1965
Exaflop/s: The why and the how journal February 2011
Scalable rank-mapping algorithm for an icosahedral grid system on the massive parallel computer with a 3-D torus network journal August 2014
Thermosphere extension of the Whole Atmosphere Community Climate Model: WHOLE ATMOSPHERE MODEL journal December 2010
Computational aspects of a scalable high-order discontinuous Galerkin atmospheric dynamical core journal February 2009
Diffusion Experiments with a Global Discontinuous Galerkin Shallow-Water Model journal October 2009
A High-Order Multiscale Global Atmospheric Model (Invited) conference June 2016
An extreme-scale implicit solver for complex PDEs: highly heterogeneous flow in earth's mantle
  • Rudi, Johann; Ghattas, Omar; Malossi, A. Cristiano I.
  • Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '15 https://doi.org/10.1145/2807591.2807675
conference January 2015
A new synoptic scale resolving global climate simulation using the Community Earth System Model journal December 2014
A compatible and conservative spectral element method on unstructured grids journal August 2010

Similar Records

A Petascale Non-Hydrostatic Atmospheric Dynamical Core in the HOMME Framework
Technical Report · Tue Sep 15 00:00:00 EDT 2015 · OSTI ID:1437146

Scalable direct Vlasov solver with discontinuous Galerkin method on unstructured mesh.
Journal Article · Wed Dec 01 00:00:00 EST 2010 · SIAM J. Sci. Comput. · OSTI ID:1437146

A high-order discontinuous Galerkin method for wave propagation through coupled elastic-acoustic media
Journal Article · Fri Dec 10 00:00:00 EST 2010 · Journal of Computational Physics · OSTI ID:1437146