ECP libraries and tools: An overview

Journal Article · Fri Sep 13 00:00:00 EDT 2024 · International Journal of High Performance Computing Applications

DOI:https://doi.org/10.1177/10943420241271005· OSTI ID:2530262

Heroux, Michael A. ^[1]; McInnes, Lois Curfman ^[2]; Ahrens, James ^[3]; Gamblin, Todd ^[4]; Germann, Timothy C. ^[3]; Li, Xiaoye Sherry ^[5]; Mohror, Kathryn ^[4]; Munson, Todd ^[2]; Shende, Sameer ^[6]; Thakur, Rajeev ^[2]; Vetter, Jeffrey ^[7]; Willenbring, James ^[1]

---

1. Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
2. Argonne National Laboratory (ANL), Argonne, IL (United States)
3. Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
4. Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
5. Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
6. Univ. of Oregon, Eugene, OR (United States)
7. Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

The Exascale Computing Project (ECP) Software Technology and Co-Design teams addressed the growing complexities in high-performance computing (HPC) by developing scalable software libraries and tools that leverage exascale system capabilities. As we enter the exascale era, the need for reusable, optimized software solutions that can handle the unique challenges posed by these systems becomes increasingly important. The primary challenges the ECP teams faced were to create software libraries and tools that are performant on exascale architectures and portable and usable across diverse hardware platforms. Efforts addressed issues related to concurrent execution, memory management, and the integration of heterogeneous computing resources, such as GPUs from multiple vendors. The ECP’s strategy involved a structured development process encompassing the creation, optimization, and deployment of software in collaboration with industry, academia, and national laboratories. The project was organized into several technical areas: co-design of domain-specific suites with target applications, programming models and runtimes, development tools, mathematical libraries, data and visualization tools, and software ecosystem and delivery mechanisms. ECP has successfully developed a large portfolio of software libraries and tools that demonstrate significant improvements in performance and scalability on exascale systems. These products have been integrated into the Department of Energy’s computing facilities, supporting various scientific applications and ensuring robust performance across different hardware setups. ECP advancements in software development for exascale computing highlight the importance of a collaborative and adaptive approach to handling next-generation HPC systems complexities. The lessons learned emphasize the need for continuous engagement with end-users and vendors, and the importance of maintaining a balance between innovation and practical implementation. Future efforts will focus on ensuring scalability, keeping pace with rapid hardware advancements, and further enhancing the interoperability and usability of the software ecosystem. In conclusion, subsequent articles in this special issue provide in-depth discussions and case studies into specific library and tool efforts.

• Research Organization: Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
• Sponsoring Organization: USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC)
• Grant/Contract Number: AC52-07NA27344
• OSTI ID: 2530262
• Report Number(s): LLNL--JRNL-872481; 1110804
• Journal Information: International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications Journal Issue: 5 Vol. 38; ISSN 1094-3420
• Publisher: SAGE
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING
ECP
libraries
software
software ecosystem
tools