MAGMA (Matrix Algebra for GPU and Multicore Architectures) is a pivotal open-source library in the landscape of GPU-enabled dense and sparse linear algebra computations. With a repertoire of approximately 750 numerical routines across four precisions, MAGMA is deeply ingrained in the DOE software stack, playing a crucial role in high-performance computing. Notable projects such as ExaConstit, HiOP, MARBL, and STRUMPACK, among others, directly harness the capabilities of MAGMA. In addition, the MAGMA development team has been acknowledged multiple times for contributing to the vendors’ numerical software stacks. Looking back over the time of the Exascale Computing Project (ECP), we highlight how MAGMA has adapted to recent changes in modern HPC systems, especially the growing gap between CPU and GPU compute capabilities, as well as the introduction of low precision arithmetic in modern GPUs. We also describe MAGMA’s direct impact on several ECP projects. Maintaining portable performance across NVIDIA and AMD GPUs, and with current efforts toward supporting Intel GPUs, MAGMA ensures its adaptability and relevance in the ever-evolving landscape of GPU architectures.
Abdelfattah, Ahmad, et al. "MAGMA: Enabling exascale performance with accelerated BLAS and LAPACK for diverse GPU architectures." International Journal of High Performance Computing Applications, Jun. 2024. https://doi.org/10.1177/10943420241261960
Abdelfattah, Ahmad, Beams, Natalie, Carson, Robert, et al., "MAGMA: Enabling exascale performance with accelerated BLAS and LAPACK for diverse GPU architectures," International Journal of High Performance Computing Applications (2024), https://doi.org/10.1177/10943420241261960
@article{osti_2375895,
author = {Abdelfattah, Ahmad and Beams, Natalie and Carson, Robert and Ghysels, Pieter and Kolev, Tzanio and Stitt, Thomas and Vargas, Arturo and Tomov, Stanimire and Dongarra, Jack},
title = {MAGMA: Enabling exascale performance with accelerated BLAS and LAPACK for diverse GPU architectures},
annote = {MAGMA (Matrix Algebra for GPU and Multicore Architectures) is a pivotal open-source library in the landscape of GPU-enabled dense and sparse linear algebra computations. With a repertoire of approximately 750 numerical routines across four precisions, MAGMA is deeply ingrained in the DOE software stack, playing a crucial role in high-performance computing. Notable projects such as ExaConstit, HiOP, MARBL, and STRUMPACK, among others, directly harness the capabilities of MAGMA. In addition, the MAGMA development team has been acknowledged multiple times for contributing to the vendors’ numerical software stacks. Looking back over the time of the Exascale Computing Project (ECP), we highlight how MAGMA has adapted to recent changes in modern HPC systems, especially the growing gap between CPU and GPU compute capabilities, as well as the introduction of low precision arithmetic in modern GPUs. We also describe MAGMA’s direct impact on several ECP projects. Maintaining portable performance across NVIDIA and AMD GPUs, and with current efforts toward supporting Intel GPUs, MAGMA ensures its adaptability and relevance in the ever-evolving landscape of GPU architectures.},
doi = {10.1177/10943420241261960},
url = {https://www.osti.gov/biblio/2375895},
journal = {International Journal of High Performance Computing Applications},
issn = {ISSN 1094-3420},
place = {United States},
publisher = {SAGE Publications},
year = {2024},
month = {06}}
International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications; ISSN 1094-3420
Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 378, Issue 2166https://doi.org/10.1098/rsta.2019.0056
Anderson, Michael J.; Sheffield, David; Keutzer, Kurt
2012 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2012 IEEE 26th International Parallel and Distributed Processing Symposiumhttps://doi.org/10.1109/IPDPS.2012.11
Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysishttps://doi.org/10.1145/3624062.3624103