skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: An Optimizing Compiler for Petascale I/O on Leadership Class Architectures

Abstract

In high-performance computing systems, parallel I/O architectures usually have very complex hierarchies with multiple layers that collectively constitute an I/O stack, including high-level I/O libraries such as PnetCDF and HDF5, I/O middleware such as MPI-IO, and parallel file systems such as PVFS and Lustre. Our project explored automated instrumentation and compiler support for I/O intensive applications. Our project made significant progress towards understanding the complex I/O hierarchies of high-performance storage systems (including storage caches, HDDs, and SSDs), and designing and implementing state-of-the-art compiler/runtime system technology that targets I/O intensive HPC applications that target leadership class machine. This final report summarizes the major achievements of the project and also points out promising future directions.

Authors:
 [1];  [2]
  1. Northwestern Univ., Evanston, IL (United States)
  2. Pennsylvania State Univ., State College, PA (United States)
Publication Date:
Research Org.:
Northwestern Univ., Evanston, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
OSTI Identifier:
1172903
Report Number(s):
DOE-NWU-0001283
DOE Contract Number:  
SC0001283
Resource Type:
Technical Report
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; parallel I/O, high-performance computing

Citation Formats

Choudhary, Alok, and Kandemir, Mahmut. An Optimizing Compiler for Petascale I/O on Leadership Class Architectures. United States: N. p., 2015. Web. doi:10.2172/1172903.
Choudhary, Alok, & Kandemir, Mahmut. An Optimizing Compiler for Petascale I/O on Leadership Class Architectures. United States. doi:10.2172/1172903.
Choudhary, Alok, and Kandemir, Mahmut. Wed . "An Optimizing Compiler for Petascale I/O on Leadership Class Architectures". United States. doi:10.2172/1172903. https://www.osti.gov/servlets/purl/1172903.
@article{osti_1172903,
title = {An Optimizing Compiler for Petascale I/O on Leadership Class Architectures},
author = {Choudhary, Alok and Kandemir, Mahmut},
abstractNote = {In high-performance computing systems, parallel I/O architectures usually have very complex hierarchies with multiple layers that collectively constitute an I/O stack, including high-level I/O libraries such as PnetCDF and HDF5, I/O middleware such as MPI-IO, and parallel file systems such as PVFS and Lustre. Our project explored automated instrumentation and compiler support for I/O intensive applications. Our project made significant progress towards understanding the complex I/O hierarchies of high-performance storage systems (including storage caches, HDDs, and SSDs), and designing and implementing state-of-the-art compiler/runtime system technology that targets I/O intensive HPC applications that target leadership class machine. This final report summarizes the major achievements of the project and also points out promising future directions.},
doi = {10.2172/1172903},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Wed Mar 18 00:00:00 EDT 2015},
month = {Wed Mar 18 00:00:00 EDT 2015}
}

Technical Report:

Save / Share: