DOE CODE   /    Search Results   /    JobQueue-PG: A Task Queue for Coordinating Varied Tasks Across Multiple HPC Resources and HPC Jobs

JobQueue-PG: A Task Queue for Coordinating Varied Tasks Across Multiple HPC Resources and HPC Jobs

RESOURCE

Publicly Accessible Repository
https://github.com/NREL/E-Queue-HPC
https://doi.org/10.11578/dc.20220608.1

SAVE / SHARE



NREL Badge

Abstract

The software allows for queueing and dispatch of tasks of small, varied, or uncertain runtimes across multiple HPC jobs, resources, and other computing systems. The software was designed to allow scientists to enqueue, run, and accumulate results from computational experiments in an efficient, manageable manner. For example, the software can be used to enqueue many small computational experiments and run them using several long-running multi-node HPC jobs that may or may not run simultaneously.
Developers:
Tripp, Charles [1] ;  Perr-Sauer, Jordan [1] ;  Lunacek, Monte [1] ;  Hayne, Lucas [1]
  1. National Renewable Energy Lab. (NREL), Golden, CO (United States)
Release Date:
2022-05-13
Project Type:
Open Source, Publicly Available Repository
Software Type:
Scientific
Programming Languages:
python
Licenses:
MIT License
Sponsoring Org.:
Code ID:
74434
Site Accession Number:
NREL SWR-22-41
Research Org.:
National Renewable Energy Laboratory (NREL), Golden, CO (United States)
Country of Origin:
United States

RESOURCE

Publicly Accessible Repository
https://github.com/NREL/E-Queue-HPC
https://doi.org/10.11578/dc.20220608.1

SAVE / SHARE



NREL Badge

Citation Formats

Tripp, Charles, Perr-Sauer, Jordan, Lunacek, Monte, and Hayne, Lucas. JobQueue-PG: A Task Queue for Coordinating Varied Tasks Across Multiple HPC Resources and HPC Jobs. Computer Software. https://github.com/NREL/E-Queue-HPC. USDOE Laboratory Directed Research and Development (LDRD) Program. 13 May. 2022. Web. doi:10.11578/dc.20220608.1.
Tripp, Charles, Perr-Sauer, Jordan, Lunacek, Monte, & Hayne, Lucas. (2022, May 13). JobQueue-PG: A Task Queue for Coordinating Varied Tasks Across Multiple HPC Resources and HPC Jobs. [Computer software]. https://github.com/NREL/E-Queue-HPC. https://doi.org/10.11578/dc.20220608.1.
Tripp, Charles, Perr-Sauer, Jordan, Lunacek, Monte, and Hayne, Lucas. "JobQueue-PG: A Task Queue for Coordinating Varied Tasks Across Multiple HPC Resources and HPC Jobs." Computer software. May 13, 2022. https://github.com/NREL/E-Queue-HPC. https://doi.org/10.11578/dc.20220608.1.
@misc{ doecode_74434,
title = {JobQueue-PG: A Task Queue for Coordinating Varied Tasks Across Multiple HPC Resources and HPC Jobs},
author = {Tripp, Charles and Perr-Sauer, Jordan and Lunacek, Monte and Hayne, Lucas},
abstractNote = {The software allows for queueing and dispatch of tasks of small, varied, or uncertain runtimes across multiple HPC jobs, resources, and other computing systems. The software was designed to allow scientists to enqueue, run, and accumulate results from computational experiments in an efficient, manageable manner. For example, the software can be used to enqueue many small computational experiments and run them using several long-running multi-node HPC jobs that may or may not run simultaneously.},
doi = {10.11578/dc.20220608.1},
url = {https://doi.org/10.11578/dc.20220608.1},
howpublished = {[Computer Software] \url{https://doi.org/10.11578/dc.20220608.1}},
year = {2022},
month = {may}
}