Nek5000/RS performance on advanced GPU architectures

Min, Misun; Lan, Yu-Hsiang; Fischer, Paul; Rathnayake, Thilina; Holmen, John

doi:10.3389/fhpcp.2024.1303358

Nek5000/RS performance on advanced GPU architectures

Journal Article · Thu Feb 20 00:00:00 EST 2025 · Frontiers in High Performance Computing

DOI:https://doi.org/10.3389/fhpcp.2024.1303358· OSTI ID:2522110

Min, Misun ^[1]; Lan, Yu-Hsiang ^[2]; Fischer, Paul ^[3]; Rathnayake, Thilina ^[2]; ^[4]

Argonne National Laboratory (ANL), Argonne, IL (United States)
University of Illinois at Urbana-Champaign, IL (United States)
Argonne National Laboratory (ANL), Argonne, IL (United States); University of Illinois at Urbana-Champaign, IL (United States)
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

The authors explore performance scalability of the open-source thermal-fluids code, NekRS, on the U.S. Department of Energy's leadership computers, Crusher, Frontier, Summit, Perlmutter, and Polaris. Particular attention is given to analyzing performance and time-to-solution at the strong-scale limit for a target efficiency of 80%, which is typical for production runs on the DOE's high-performance computing systems. Several examples of anomalous behavior are also discussed and analyzed.

View Journal Article

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF)

Grant/Contract Number:: AC02-06CH11357; AC05-00OR22725

OSTI ID:: 2522110

Alternate ID(s):: OSTI ID: 2538471

Journal Information:: Frontiers in High Performance Computing, Journal Name: Frontiers in High Performance Computing Vol. 2; ISSN 2813-7337

Publisher:: Frontiers Media S.A.Copyright Statement

Country of Publication:: United States

Language:: English

References (23)

An Operator-integration-factor splitting method for time-dependent problems: Application to incompressible fluid flow Maday, Y.; Patera, Anthony T.; R�nquist, Einar M. Journal of Scientific Computing, Vol. 5, Issue 4 https://doi.org/10.1007/BF01063118	journal	December 1990
Stabilization of the Spectral Element Method in Convection Dominated Flows by Recovery of Skew-Symmetry Malm, Johan; Schlatter, Philipp; Fischer, Paul F. Journal of Scientific Computing, Vol. 57, Issue 2 https://doi.org/10.1007/s10915-013-9704-1	journal	March 2013
A Characteristic-Based Spectral Element Method for Moving-Domain Problems Patel, Saumil; Fischer, Paul; Min, Misun Journal of Scientific Computing, Vol. 79, Issue 1 https://doi.org/10.1007/s10915-018-0876-6	journal	December 2018
Spectral methods for problems in complex geometries Orszag, Steven A. Journal of Computational Physics, Vol. 37, Issue 1 https://doi.org/10.1016/0021-9991(80)90005-4	journal	August 1980
A spectral element method for fluid dynamics: Laminar flow in a channel expansion Patera, Anthony T. Journal of Computational Physics, Vol. 54, Issue 3 https://doi.org/10.1016/0021-9991(84)90128-1	journal	June 1984
MFEM: A modular finite element methods library Anderson, Robert; Andrej, Julian; Barker, Andrew Computers & Mathematics with Applications, Vol. 81 https://doi.org/10.1016/j.camwa.2020.06.009	journal	January 2021
High-speed turbulent flows towards the exascale: STREAmS-2 porting and performance Sathyanarayana, Srikanth; Bernardini, Matteo; Modesti, Davide Journal of Parallel and Distributed Computing, Vol. 196 https://doi.org/10.1016/j.jpdc.2024.104993	journal	February 2025
GPU algorithms for Efficient Exascale Discretizations Abdelfattah, Ahmad; Barra, Valeria; Beams, Natalie Parallel Computing, Vol. 108 https://doi.org/10.1016/j.parco.2021.102841	journal	December 2021
NekRS, a GPU-accelerated spectral element Navier–Stokes solver Fischer, Paul; Kerkemeier, Stefan; Min, Misun Parallel Computing, Vol. 114 https://doi.org/10.1016/j.parco.2022.102982	journal	December 2022
High-Order Methods for Incompressible Fluid Flow Deville, M. O.; Fischer, P. F.; Mund, E. H. Cambridge University Press https://doi.org/10.1017/CBO9780511546792	book	January 2009
Modeling Data Movement Performance on Heterogeneous Architectures Bienz, Amanda; Olson, Luke N.; Gropp, William D. 2021 IEEE High Performance Extreme Computing Conference (HPEC) https://doi.org/10.1109/HPEC49654.2021.9622742	conference	September 2021
Optimization of Full-Core Reactor Simulations on Summit Min, Misun; Lan, Yu-Hsiang; Fischer, Paul SC22: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC41404.2022.00079	conference	November 2022
Partitioning Sparse Matrices with Eigenvectors of Graphs Pothen, Alex; Simon, Horst D.; Liou, Kang-Pu SIAM Journal on Matrix Analysis and Applications, Vol. 11, Issue 3 https://doi.org/10.1137/0611030	journal	July 1990
Multigrid for Matrix-Free High-Order Finite Element Computations on Graphics Processors Kronbichler, Martin; Ljungkvist, Karl ACM Transactions on Parallel Computing, Vol. 6, Issue 1 https://doi.org/10.1145/3322813	journal	May 2019
Scalability of high-performance PDE solvers Fischer, Paul; Min, Misun; Rathnayake, Thilina The International Journal of High Performance Computing Applications, Vol. 34, Issue 5 https://doi.org/10.1177/1094342020915762	journal	June 2020
Matrix-free approaches for GPU acceleration of a high-order finite element hydrodynamics application using MFEM, Umpire, and RAJA Vargas, Arturo; Stitt, Thomas M.; Weiss, Kenneth The International Journal of High Performance Computing Applications, Vol. 36, Issue 4 https://doi.org/10.1177/10943420221100262	journal	May 2022
Enhancing data locality of the conjugate gradient method for high-order matrix-free finite-element implementations Kronbichler, Martin; Sashko, Dmytro; Munch, Peter The International Journal of High Performance Computing Applications, Vol. 37, Issue 2 https://doi.org/10.1177/10943420221107880	journal	July 2022
HipBone: A performance-portable graphics processing unit-accelerated C++ version of the NekBone benchmark Chalmers, Noel; Mishra, Abhishek; McDougall, Damon The International Journal of High Performance Computing Applications, Vol. 37, Issue 5 https://doi.org/10.1177/10943420231178552	journal	May 2023
The deal.II library, version 8.5 Arndt, Daniel; Bangerth, Wolfgang; Davydov, Denis Journal of Numerical Mathematics, Vol. 25, Issue 3 https://doi.org/10.1515/jnma-2017-0058	journal	January 2017
Scaling Limits for PDE-Based Simulation (Invited) Fischer, Paul F. 22nd AIAA Computational Fluid Dynamics Conference https://doi.org/10.2514/6.2015-3049	conference	June 2015
OCCA: A unified approach to multi-threading languages Medina, David S.; St-Cyr, Amik; Warburton, T. arXiv https://doi.org/10.48550/arXiv.1403.0968	preprint	January 2014
NekRS, a GPU-Accelerated Spectral Element Navier-Stokes Solver Fischer, Paul; Kerkemeier, Stefan; Min, Misun arXiv https://doi.org/10.48550/arXiv.2104.05829	preprint	January 2021
paranumal/libparanumal: Introducing platform for GPU memory management & removed BLAS+LAPACK Warburton, Tim; Chalmers, Noel https://doi.org/10.5281/zenodo.4004744	software	August 2020

Similar Records

Nek5000/RS Performance on Advanced GPU Architectures

Technical Report · Fri Sep 30 00:00:00 EDT 2022 · OSTI ID:1894022

NekRS, a GPU-accelerated spectral element Navier–Stokes solver

Journal Article · Mon Oct 17 20:00:00 EDT 2022 · Parallel Computing · OSTI ID:2429555

Related Subjects

97 MATHEMATICS AND COMPUTING
Nek5000/RS
exascale
rod-bundle
small modular reactor
strong scaling

Nek5000/RS performance on advanced GPU architectures

Citation Formats

References (23)

Similar Records

Related Subjects