U.S. Department of EnergyOffice of Scientific and Technical Information
April 2020 Darshan counters from the Summit supercomputer
Abstract
This dataset is the Darshan counters collected from the Summit supercomputer in a month of April 2020. 1. Description of methods used for collection/generation of data: Job submitted on Summit HPC system when completed successfully and has made I/O calls (captured by Darshan tool) writes a Darshan log file on alpine filesystem. One job can have multiple `jsrun` commands and Darshan will generate separate logs each log corresponding to an `jsrun` command, so a job can have one or more Darshan logs associated with it. 2. Methods for processing the data: To process the data, we first use `darshan-util` tool to parse the Darshan logs. Then we restructure the logs and merge data from multiple Darshan logs if they belong to the same Summit job.
- Authors:
-
- ORNL-OLCF
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Org.:
- Office of Science (SC)
- Subject:
- 97 MATHEMATICS AND COMPUTING; Supercomputer I/O subsystem, Summit supercomputer, Access Patterns, Darshan log
- OSTI Identifier:
- 1865904
- DOI:
- https://doi.org/10.13139/OLCF/1865904
Citation Formats
Karimi, Ahmad Maroof, Xie, Bing, Paul, Arnab K., Oral, Sarp, and Wang, Feiyi. April 2020 Darshan counters from the Summit supercomputer. United States: N. p., 2022.
Web. doi:10.13139/OLCF/1865904.
Karimi, Ahmad Maroof, Xie, Bing, Paul, Arnab K., Oral, Sarp, & Wang, Feiyi. April 2020 Darshan counters from the Summit supercomputer. United States. doi:https://doi.org/10.13139/OLCF/1865904
Karimi, Ahmad Maroof, Xie, Bing, Paul, Arnab K., Oral, Sarp, and Wang, Feiyi. 2022.
"April 2020 Darshan counters from the Summit supercomputer". United States. doi:https://doi.org/10.13139/OLCF/1865904. https://www.osti.gov/servlets/purl/1865904. Pub date:Tue May 03 00:00:00 EDT 2022
@article{osti_1865904,
title = {April 2020 Darshan counters from the Summit supercomputer},
author = {Karimi, Ahmad Maroof and Xie, Bing and Paul, Arnab K. and Oral, Sarp and Wang, Feiyi},
abstractNote = {This dataset is the Darshan counters collected from the Summit supercomputer in a month of April 2020. 1. Description of methods used for collection/generation of data: Job submitted on Summit HPC system when completed successfully and has made I/O calls (captured by Darshan tool) writes a Darshan log file on alpine filesystem. One job can have multiple `jsrun` commands and Darshan will generate separate logs each log corresponding to an `jsrun` command, so a job can have one or more Darshan logs associated with it. 2. Methods for processing the data: To process the data, we first use `darshan-util` tool to parse the Darshan logs. Then we restructure the logs and merge data from multiple Darshan logs if they belong to the same Summit job.},
doi = {10.13139/OLCF/1865904},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue May 03 00:00:00 EDT 2022},
month = {Tue May 03 00:00:00 EDT 2022}
}