Utility functions and resource management in an oversubscribed heterogeneous computing environment

Khemka, Bhavesh; Friese, Ryan; Briceno, Luis Diego; Siegel, Howard Jay; Maciejewski, Anthony A.; Koenig, Gregory A.; Groer, Christopher S.; Hilton, Marcia M.; Poole, Stephen W.; Okonski, G.; Rambharos, R.

doi:10.1109/TC.2014.2360513

Title: Utility functions and resource management in an oversubscribed heterogeneous computing environment

Full Record
Other Related Research

Abstract

We model an oversubscribed heterogeneous computing system where tasks arrive dynamically and a scheduler maps the tasks to machines for execution. The environment and workloads are based on those being investigated by the Extreme Scale Systems Center at Oak Ridge National Laboratory. Utility functions that are designed based on specifications from the system owner and users are used to create a metric for the performance of resource allocation heuristics. Each task has a time-varying utility (importance) that the enterprise will earn based on when the task successfully completes execution. We design multiple heuristics, which include a technique to drop low utility-earning tasks, to maximize the total utility that can be earned by completing tasks. The heuristics are evaluated using simulation experiments with two levels of oversubscription. The results show the benefit of having fast heuristics that account for the importance of a task and the heterogeneity of the environment when making allocation decisions in an oversubscribed environment. Furthermore, the ability to drop low utility-earning tasks allow the heuristics to tolerate the high oversubscription as well as earn significant utility.

Authors:

Khemka, Bhavesh ^[1]; Friese, Ryan ^[1]; Briceno, Luis Diego ^[1]; Siegel, Howard Jay ^[1]; Maciejewski, Anthony A. ^[1]; Koenig, Gregory A. ^[2]; Groer, Christopher S. ^[3]; Hilton, Marcia M. ^[4]; Poole, Stephen W. ^[2]; Okonski, G. ^[4]; Rambharos, R. ^[4]

Colorado State Univ., Fort Collins, CO (United States)
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Link Analytics, Atlanta, GA (United States)
DoD, Washington, D.C. (United States)

Publication Date:: Fri Sep 26 00:00:00 EDT 2014

Research Org.:: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Org.:: USDOE Office of Science (SC)

OSTI Identifier:: 1261249

Grant/Contract Number:: AC05-00OR22725

Resource Type:: Accepted Manuscript

Journal Name:: IEEE Transactions on Computers

Additional Journal Information:: Journal Volume: 64; Journal Issue: 8; Journal ID: ISSN 0018-9340

Publisher:: IEEE

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING; utility function; resource management heuristics; heterogeneous computing

Citation Formats


                    Khemka, Bhavesh, Friese, Ryan, Briceno, Luis Diego, Siegel, Howard Jay, Maciejewski, Anthony A., Koenig, Gregory A., Groer, Christopher S., Hilton, Marcia M., Poole, Stephen W., Okonski, G., and Rambharos, R. Utility functions and resource management in an oversubscribed heterogeneous computing environment.  United States: N. p., 2014. 
Web.  doi:10.1109/TC.2014.2360513.

Copy to clipboard


                    Khemka, Bhavesh, Friese, Ryan, Briceno, Luis Diego, Siegel, Howard Jay, Maciejewski, Anthony A., Koenig, Gregory A., Groer, Christopher S., Hilton, Marcia M., Poole, Stephen W., Okonski, G., & Rambharos, R. Utility functions and resource management in an oversubscribed heterogeneous computing environment.  United States.  https://doi.org/10.1109/TC.2014.2360513

Copy to clipboard


                    Khemka, Bhavesh, Friese, Ryan, Briceno, Luis Diego, Siegel, Howard Jay, Maciejewski, Anthony A., Koenig, Gregory A., Groer, Christopher S., Hilton, Marcia M., Poole, Stephen W., Okonski, G., and Rambharos, R. Fri .  
"Utility functions and resource management in an oversubscribed heterogeneous computing environment".  United States.  https://doi.org/10.1109/TC.2014.2360513.  https://www.osti.gov/servlets/purl/1261249.

Copy to clipboard


                    
@article{osti_1261249,

  title        = {Utility functions and resource management in an oversubscribed heterogeneous computing environment},

  author       = {Khemka, Bhavesh and Friese, Ryan and Briceno, Luis Diego and Siegel, Howard Jay and Maciejewski, Anthony A. and Koenig, Gregory A. and Groer, Christopher S. and Hilton, Marcia M. and Poole, Stephen W. and Okonski, G. and Rambharos, R.},

  abstractNote = {We model an oversubscribed heterogeneous computing system where tasks arrive dynamically and a scheduler maps the tasks to machines for execution. The environment and workloads are based on those being investigated by the Extreme Scale Systems Center at Oak Ridge National Laboratory. Utility functions that are designed based on specifications from the system owner and users are used to create a metric for the performance of resource allocation heuristics. Each task has a time-varying utility (importance) that the enterprise will earn based on when the task successfully completes execution. We design multiple heuristics, which include a technique to drop low utility-earning tasks, to maximize the total utility that can be earned by completing tasks. The heuristics are evaluated using simulation experiments with two levels of oversubscription. The results show the benefit of having fast heuristics that account for the importance of a task and the heterogeneity of the environment when making allocation decisions in an oversubscribed environment. Furthermore, the ability to drop low utility-earning tasks allow the heuristics to tolerate the high oversubscription as well as earn significant utility.},

  doi          = {10.1109/TC.2014.2360513},

  journal      = {IEEE Transactions on Computers},

  number       = 8,

  volume       = 64,

  place        = {United States},

  year         = {Fri Sep 26 00:00:00 EDT 2014},

  month        = {Fri Sep 26 00:00:00 EDT 2014}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1109/TC.2014.2360513

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 25 works

Citation information provided by
Web of Science

Save / Share:

Export Metadata

Save to My Library

Similar Records in DOE PAGES and OSTI.GOV collections:

Dynamic Resource Management for Parallel Tasks in an Oversubscribed Energy-Constrained Heterogeneous Environment

Conference Imam, Neena ; Koenig, Gregory A ; Machovec, Dylan ; ...

Abstract: The worth of completing parallel tasks is modeled using utility functions, which monotonically-decrease with time and represent the importance and urgency of a task. These functions define the utility earned by a task at the time of its completion. The performance of such a system is measured as the total utility earned by all completed tasks over some interval of time (e.g., 24 hours). To maximize system performance when scheduling dynamically arriving parallel tasks onto a high performance computing (HPC) system that is oversubscribed and energy-constrained, we have designed, analyzed, and compared different heuristic techniques. Four utility-aware heuristics (i.e.,more »« less
Preemptive resource management for dynamically arriving tasks in an oversubscribed heterogeneous computing system

Conference Machovec, Dylan ; Pasricha, Sudeep ; Maciejewski, Anthony A. ; ...

We design resource management heuristics that assign serial tasks to the nodes of a heterogeneous high performance computing (HPC) system. The value of completing these tasks is modeled using monotonically decreasing utility functions that represent the time-varying importance of the task. The value of completing a task is equal to its utility function at the time of its completion. The overall performance of this system is measured using the total utility earned by all tasks during some interval of time. To maximize the performance of such a system where the preemption of tasks is possible, we have designed, analyzed, andmore »« less
https://doi.org/10.1109/IPDPSW.2017.158
Preemptive Resource Management for Dynamically Arriving Tasks in an Oversubscribed Heterogeneous Computing System

Conference Machovec, Dylan ; Pasricha, Sudeep ; Maciejewski, Anthony A. ; ...

We design resource management heuristics that assign serial tasks to the nodes of a heterogeneous high performance computing (HPC) system. The value of completing these tasks is modeled using monotonically decreasing utility functions that represent the time-varying importance of the task. The value of completing a task is equal to its utility function at the time of its completion. The overall performance of this system is measured using the total utility earned by all tasks during some interval of time. To maximize the performance of such a system where the preemption of tasks is possible, we have designed, analyzed, andmore »« less
https://doi.org/10.1109/IPDPSW.2017.158

Full Text Available
Utility maximizing dynamic resource management in an oversubscribed energy-constrained heterogeneous computing system

Journal Article Khemka, Bhavesh ; Friese, Ryan ; Pasricha, Sudeep ; ... - Sustainable Computing

The need for greater performance in high performance computing systems combined with rising costs of electricity to power these systems motivates the need for energy-efficient resource management. Driven by the requirements of the Extreme Scale Systems Center at Oak Ridge National Laboratory, our study addresses the problem of scheduling dynamically-arriving tasks to machines in an oversubscribed and energy-constrained heterogeneous distributed computing environment. Our goal is to maximize total “utility” earned by the system, where the utility of a task is defined by a monotonically-decreasing function that represents the value of completing that task at different times. To address this problem,more »« less
Cited by 28
https://doi.org/10.1016/j.suscom.2014.08.001

Full Text Available
Time Utility Functions for Modeling and Evaluating Resource Allocations in a Heterogeneous Computing System

Journal Article Briceno, Luis Diego ; Khemka, Bhavesh ; Siegel, Howard Jay ; ... - Parallel and Distributed Processing Symposium

This study considers a heterogeneous computing system and corresponding workload being investigated by the Extreme Scale Systems Center (ESSC) at Oak Ridge National Laboratory (ORNL). The ESSC is part of a collaborative effort between the Department of Energy (DOE) and the Department of Defense (DoD) to deliver research, tools, software, and technologies that can be integrated, deployed, and used in both DOE and DoD environments. The heterogeneous system and workload described here are representative of a prototypical computing environment being studied as part of this collaboration. Each task can exhibit a time-varying importance or utility to the overall enterprise. Inmore »« less
https://doi.org/10.1109/IPDPS.2011.123

Similar Records