Dynamic Resource Management for Parallel Tasks in an Oversubscribed Energy-Constrained Heterogeneous Environment
Conference
·
OSTI ID:1337509
- ORNL
- Colorado State University, Fort Collins
- Colorado State University
- Department of Defense
Abstract: The worth of completing parallel tasks is modeled using utility functions, which monotonically-decrease with time and represent the importance and urgency of a task. These functions define the utility earned by a task at the time of its completion. The performance of such a system is measured as the total utility earned by all completed tasks over some interval of time (e.g., 24 hours). To maximize system performance when scheduling dynamically arriving parallel tasks onto a high performance computing (HPC) system that is oversubscribed and energy-constrained, we have designed, analyzed, and compared different heuristic techniques. Four utility-aware heuristics (i.e., Max Utility, Max Utility-per-Time, Max Utility-per-Resource, and Max Utility-per-Energy), three FCFS-based heuristics (Conservative Backfilling, EASY Backfilling, and FCFS with Multiple Queues), and a Random heuristic were examined in this study. A technique that is often used with the FCFS-based heuristics is the concept of a permanent reservation. We compare the performance of permanent reservations with temporary place-holders to demonstrate the advantages that place-holders can provide. We also present a novel energy filtering technique that constrains the maximum energy-per-resource used by each task. We conducted a simulation study to evaluate the performance of these heuristics and techniques in an energy-constrained oversubscribed HPC environment. With place-holders, energy filtering, and dropping tasks with low potential utility, our utility-aware heuristics are able to significantly outperform the existing FCFS-based techniques.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1337509
- Country of Publication:
- United States
- Language:
- English
Similar Records
Preemptive Resource Management for Dynamically Arriving Tasks in an Oversubscribed Heterogeneous Computing System
Preemptive resource management for dynamically arriving tasks in an oversubscribed heterogeneous computing system
Utility maximizing dynamic resource management in an oversubscribed energy-constrained heterogeneous computing system
Conference
·
Mon May 01 00:00:00 EDT 2017
·
OSTI ID:1400166
Preemptive resource management for dynamically arriving tasks in an oversubscribed heterogeneous computing system
Conference
·
Mon May 01 00:00:00 EDT 2017
·
OSTI ID:1567462
Utility maximizing dynamic resource management in an oversubscribed energy-constrained heterogeneous computing system
Journal Article
·
Sat Feb 28 19:00:00 EST 2015
· Sustainable Computing
·
OSTI ID:1565312