Revealing power, energy and thermal dynamics of a 200PF pre-exascale supercomputer

Conference · Mon Nov 01 04:00:00 EDT 2021

DOI:https://doi.org/10.1145/3458817.3476188· OSTI ID:1833956

Shin, Woong ^[1]; Oles, Vlad ^[1]; Karimi, Ahmad Maroof ^[1]; Ellis, Austin ^[1]; Wang, Feiyi ^[1]

---

1. ORNL

As we approach the exascale computing era, the focused understanding of power consumption and its overall constraint on HPC architectures and applications are becoming increasingly paramount. Summit, located at the Oak Ridge Leadership Computing Facility (OLCF), is one of the fastest and largest pre-exascale platforms in operation today. This paper provides a first-order examination and analysis of power consumption at the component-level, node-level, and system-level, from all 4,626 Summit compute nodes, each with over 100 metrics at 1Hz frequency over the entire year of 2020. We also investigate the power characteristics and energy efficiency of over 840k Summit jobs and 250k GPU failure logs for further operational insights. To the best of our knowledge, this is the first systematic analysis of power data of HPC system at this scale.

• Research Organization: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1833956
• Country of Publication: United States
• Language: English