skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: High-Performance I/O: HDF5 for Lattice QCD

Abstract

Practitioners of lattice QCD/QFT have been some of the primary pioneer users of the state-of-the-art high-performance-computing systems, and contribute towards the stress tests of such new machines as soon as they become available. As with all aspects of high-performance-computing, I/O is becoming an increasingly specialized component of these systems. In order to take advantage of the latest available high-performance I/O infrastructure, to ensure reliability and backwards compatibility of data files, and to help unify the data structures used in lattice codes, we have incorporated parallel HDF5 I/O into the SciDAC supported USQCD software stack. Here we present the design and implementation of this I/O framework. Our HDF5 implementation outperforms optimized QIO at the 10-20% level and leaves room for further improvement by utilizing appropriate dataset chunking.

Authors:
; ; ; ;
Publication Date:
Research Org.:
Thomas Jefferson National Accelerator Facility, Newport News, VA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
OSTI Identifier:
1183734
Report Number(s):
JLAB-THY-15-2007; DOE/OR/23177-3292; arxiv:1501.06992; NT@WM-15-02
FG02-94ER40818
DOE Contract Number:  
AC05-06OR23177; AC02-05CH11231
Resource Type:
Conference
Resource Relation:
Journal Name: PoS LATTICE2014; Conference: Lattice 2014, 23-28 Jun 2014. Brookhaven, NY, USA
Country of Publication:
United States
Language:
English

Citation Formats

Kurth, Thorsten, Pochinsky, Andrew, Sarje, Abhinav, Syritsyn, Sergey, and Walker-Loud, Andre. High-Performance I/O: HDF5 for Lattice QCD. United States: N. p., 2015. Web.
Kurth, Thorsten, Pochinsky, Andrew, Sarje, Abhinav, Syritsyn, Sergey, & Walker-Loud, Andre. High-Performance I/O: HDF5 for Lattice QCD. United States.
Kurth, Thorsten, Pochinsky, Andrew, Sarje, Abhinav, Syritsyn, Sergey, and Walker-Loud, Andre. Thu . "High-Performance I/O: HDF5 for Lattice QCD". United States. doi:. https://www.osti.gov/servlets/purl/1183734.
@article{osti_1183734,
title = {High-Performance I/O: HDF5 for Lattice QCD},
author = {Kurth, Thorsten and Pochinsky, Andrew and Sarje, Abhinav and Syritsyn, Sergey and Walker-Loud, Andre},
abstractNote = {Practitioners of lattice QCD/QFT have been some of the primary pioneer users of the state-of-the-art high-performance-computing systems, and contribute towards the stress tests of such new machines as soon as they become available. As with all aspects of high-performance-computing, I/O is becoming an increasingly specialized component of these systems. In order to take advantage of the latest available high-performance I/O infrastructure, to ensure reliability and backwards compatibility of data files, and to help unify the data structures used in lattice codes, we have incorporated parallel HDF5 I/O into the SciDAC supported USQCD software stack. Here we present the design and implementation of this I/O framework. Our HDF5 implementation outperforms optimized QIO at the 10-20% level and leaves room for further improvement by utilizing appropriate dataset chunking.},
doi = {},
journal = {PoS LATTICE2014},
number = ,
volume = ,
place = {United States},
year = {Thu Jan 01 00:00:00 EST 2015},
month = {Thu Jan 01 00:00:00 EST 2015}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: