Predicting Runtime and Resource Utilization of Jobs on Integrated Cloud and HPC Systems
- Queensborough Community College, CUNY; Rutgers University - Busch Campus
This is a time series data set of resource utilizations and runtime for jobs run on both HPC systems (IC2 at Brookhaven Naional Lab, Polaris at Argonne National Lab and Amazon Web Services. The data set can be used for machine learning models to predict runtime and resource utilization of jobs on a variety of systems.
- Research Organization:
- Brookhaven National Laboratory (BNL), Upton, NY (United States)
- Sponsoring Organization:
- U.S. National Science Foundation; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Office of Workforce Development for Teachers & Scientists (WDTS)
- DOE Contract Number:
- SC0012704; AC02-06CH11357
- OSTI ID:
- 3005909
- Country of Publication:
- United States
- Language:
- English
Similar Records
Tandem Predictions for HPC Jobs
Mastering HPC Runtime Prediction: From Observing Patterns to a Methodological Approach
Mastering HPC Runtime Prediction: From Observing Patterns to a Methodological Approach: Preprint
Conference
·
Wed Jul 17 00:00:00 EDT 2024
·
OSTI ID:2447811
Mastering HPC Runtime Prediction: From Observing Patterns to a Methodological Approach
Conference
·
Sun Sep 10 00:00:00 EDT 2023
·
OSTI ID:2246634
Mastering HPC Runtime Prediction: From Observing Patterns to a Methodological Approach: Preprint
Conference
·
Mon Jun 26 00:00:00 EDT 2023
·
OSTI ID:1988023