Toward performance-portable PETSc for GPU-based exascale systems

Mills, Richard Tran; Adams, Mark F.; Balay, Satish; Brown, Jed; Dener, Alp; Knepley, Matthew; Kruger, Scott E.; Morgan, Hannah; Munson, Todd; Rupp, Karl; Smith, Barry F.; Zampini, Stefano; Zhang, Hong; Zhang, Junchao

doi:10.1016/j.parco.2021.102831

Toward performance-portable PETSc for GPU-based exascale systems

Journal Article · Fri Sep 10 00:00:00 EDT 2021 · Parallel Computing

DOI:https://doi.org/10.1016/j.parco.2021.102831· OSTI ID:1834595

^[1]; Adams, Mark F. ^[2]; Balay, Satish ^[1]; ^[3]; ^[1]; Knepley, Matthew ^[4]; ^[5]; ^[6]; Munson, Todd ^[1]; ^[7]; Smith, Barry F. ^[8]; ^[9]; Zhang, Hong ^[1]; Zhang, Junchao ^[1]

Argonne National Lab. (ANL), Lemont, IL (United States)
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Univ. of Colorado, Boulder, CO (United States)
Univ. at Buffalo, NY (United States)
Tech-X, Boulder, CO (United States)
Univ. of Chicago, IL (United States)
Argonne National Lab. (ANL), Lemont, IL (United States); TU Wien (Austria)
Flatiron Institute, New York, NY (United States)
King Abdullah University of Science and Technology (KAUST), Thuwal (Saudi Arabia)

The Portable Extensible Toolkit for Scientific computation (PETSc) library delivers scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization. The PETSc design for performance portability addresses fundamental GPU accelerator challenges and stresses flexibility and extensibility by separating the programming model used by the application from that used by the library, and it enables application developers to use their preferred programming model, such as Kokkos, RAJA, SYCL, HIP, CUDA, or OpenCL, on upcoming exascale systems. Furthermore, a blueprint for using GPUs from PETSc-based codes is provided, and case studies emphasize the flexibility and high performance achieved on current GPU-based systems.

Research Organization:: Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)

Sponsoring Organization:: USDOE Office of Science (SC); USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC02-05CH11231

OSTI ID:: 1834595

Journal Information:: Parallel Computing, Journal Name: Parallel Computing Vol. 108; ISSN 0167-8191

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (13)

A performance spectrum for parallel computational frameworks that solve PDEs: A performance spectrum for parallel computational frameworks that solve PDEs Chang, J.; Nakshatrala, K. B.; Knepley, M. G. Concurrency and Computation: Practice and Experience, Vol. 30, Issue 11 https://doi.org/10.1002/cpe.4401	journal	December 2017
KSPHPDDM and PCHPDDM: Extending PETSc with advanced Krylov methods and robust multilevel overlapping Schwarz preconditioners Jolivet, Pierre; Roman, Jose E.; Zampini, Stefano Computers & Mathematics with Applications, Vol. 84 https://doi.org/10.1016/j.camwa.2021.01.003	journal	February 2021
Accelerating sparse matrix–matrix multiplication with GPU Tensor Cores Zachariadis, Orestis; Satpute, Nitin; Gómez-Luna, Juan Computers & Electrical Engineering, Vol. 88 https://doi.org/10.1016/j.compeleceng.2020.106848	journal	December 2020
An investigation of the performance portability of OpenCL Pennycook, S. J.; Hammond, S. D.; Wright, S. A. Journal of Parallel and Distributed Computing, Vol. 73, Issue 11 https://doi.org/10.1016/j.jpdc.2012.07.005	journal	November 2013
Kokkos: Enabling manycore performance portability through polymorphic memory access patterns Carter Edwards, H.; Trott, Christian R.; Sunderland, Daniel Journal of Parallel and Distributed Computing, Vol. 74, Issue 12 https://doi.org/10.1016/j.jpdc.2014.07.003	journal	December 2014
Preparing sparse solvers for exascale computing Anzt, Hartwig; Boman, Erik; Falgout, Rob Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 378, Issue 2166 https://doi.org/10.1098/rsta.2019.0053	journal	January 2020
OpenCL: A Parallel Programming Standard for Heterogeneous Computing Systems Stone, John E.; Gohara, David; Shi, Guochun Computing in Science & Engineering, Vol. 12, Issue 3, p. 66-73 https://doi.org/10.1109/MCSE.2010.69	journal	May 2010
ViennaCL---Linear Algebra Library for Multi- and Many-Core Architectures Rupp, Karl; Tillet, Philippe; Rudolf, Florian SIAM Journal on Scientific Computing, Vol. 38, Issue 5 https://doi.org/10.1137/15M1026419	journal	January 2016
Landau Collision Integral Solver with Adaptive Mesh Refinement on Emerging Architectures Adams, Mark F.; Hirvijoki, Eero; Knepley, Matthew G. SIAM Journal on Scientific Computing, Vol. 39, Issue 6 https://doi.org/10.1137/17M1118828	journal	January 2017
Comparative Study of Finite Element Methods Using the Time-Accuracy-Size(TAS) Spectrum Analysis Chang, Justin; Fabien, Maurice S.; Knepley, Matthew G. SIAM Journal on Scientific Computing, Vol. 40, Issue 6 https://doi.org/10.1137/18M1172260	journal	January 2018
Mixed Precision Block Fused Multiply-Add: Error Analysis and Application to GPU Tensor Cores Blanchard, Pierre; Higham, Nicholas J.; Lopez, Florent SIAM Journal on Scientific Computing, Vol. 42, Issue 3 https://doi.org/10.1137/19M1289546	journal	January 2020
Sparse Matrix-Vector Multiplication on GPGPUs Filippone, Salvatore; Cardellini, Valeria; Barbieri, Davide ACM Transactions on Mathematical Software, Vol. 43, Issue 4 https://doi.org/10.1145/3017994	journal	January 2017
Supporting Mixed-domain Mixed-precision Matrix Multiplication within the BLIS Framework Van Zee, Field G.; Parikh, Devangi N.; Geijn, Robert A. Van De ACM Transactions on Mathematical Software, Vol. 47, Issue 2 https://doi.org/10.1145/3402225	journal	April 2021

Similar Records

PETSc/TAO developments for GPU-based early exascale systems

Journal Article · Fri Jan 17 23:00:00 EST 2025 · The International Journal of High Performance Computing Applications · OSTI ID:2997026

Case Study of Using Kokkos and SYCLs Performance-Portable Frameworks for Milc-Dslash Benchmark on NVIDIA, AMD and Intel GPUs

Conference · Thu Dec 31 23:00:00 EST 2020 · OSTI ID:1892057

Related Subjects

97 MATHEMATICS AND COMPUTING
Exascale
GPU acceleration
High-performance computing
Many-core
Numerical software
Performance portability

Toward performance-portable PETSc for GPU-based exascale systems

Citation Formats

References (13)

Similar Records

Related Subjects