OLCF Summit Supercomputer GPU Snapshots During Double-Bit Errors and Normal Operations

Dataset · Thu Apr 20 04:00:00 EDT 2023

DOI:https://doi.org/10.13139/OLCF/1970187· OSTI ID:1970187

Shin, Woong ^[1]; Oles, Vladyslav; Schmedding, Anna; Ostrouchov, George; Smirni, Evgenia; Engelmann, Christian; Wang, Feiyi

---

1. ORNL-OLCF

As we move into the exascale era, the power and energy footprints of high-performance computing (HPC) systems have grown significantly larger. Due to the harsh power and thermal conditions the system, components are exposed to extreme operating conditions. Operation of such modern HPC systems requires deep insights into long term system behavior to maintain its efficiency as well as its longevity. To help the HPC community to gain such insights, we provide double-bit errors using system telemetry data and logs collected from the Summit supercomputer, equipped with 27,648 Tesla V100 GPUs with 2nd-generation high-bandwidth memory (HBM2). The dataset relies on Nvidia XID records internally collected by GPU firmware at the time of failure occurrence, on the reboot-time logs of each Summit node, on node-level job scheduler records collected after each job termination, and on a 1Hz data rate from the baseboard management controllers (BMCs) of each Summit compute node using the OpenBMC event subscription protocol.

• Research Organization: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: Office of Science (SC)
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1970187
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING
99 GENERAL AND MISCELLANEOUS
High-performance Computing
system power and thermal
reliability
HBM2e
GPUs
medium temperature water cooling
direct liquid cooling