HPC Digital Twins for Evaluating Scheduling Policies, Incentive Structures and their Impact on Power and Cooling
- ORNL
- Texas State University
- Colorado State University, Fort Collins
- National Renewable Energy Laboratory (NREL)
- Lawrence Livermore National Laboratory (LLNL)
Schedulers are critical for optimal resource utilization in high-performance computing. Traditional methods to evaluate sched- ulers are limited to post-deployment analysis, or simulators, which do not model associated infrastructure. In this work, we present the first-of-its-kind integration of scheduling and digital twins in HPC. This enables what-if studies to understand the impact of parameter configurations and scheduling decisions on the physical assets, even before deployment, or regarching changes not easily realizable in production. We (1) provide the first digital twin framework extended with scheduling capabilities, (2) integrate various top-tier HPC systems given their publicly available datasets, (3) implement extensions to integrate external scheduling simulators. Finally, we show how to (4) implement and evaluate incentive structures, as- well-as (5) evaluate machine learning based scheduling, in such novel digital-twin based meta-framework to prototype scheduling. Our work enables what-if scenarios of HPC systems to evaluate sustainability, and the impact on the simulated system.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21); USDOE
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 3004292
- Country of Publication:
- United States
- Language:
- English
Similar Records
A Digital Twin Framework for Liquid-cooled Supercomputers as Demonstrated at Exascale
A Three-Tier Incremental Approach for Development of Smart Corridor Digital Twins
Immersive Digital Twins and Decision Making
Conference
·
Fri Nov 01 00:00:00 EDT 2024
·
OSTI ID:2479037
A Three-Tier Incremental Approach for Development of Smart Corridor Digital Twins
Conference
·
Mon May 01 00:00:00 EDT 2023
·
OSTI ID:1994666
Immersive Digital Twins and Decision Making
Conference
·
Mon Aug 07 00:00:00 EDT 2023
·
OSTI ID:1994800