An Optimizing Compiler for Petascale I/O on Leadership Class Architectures
- Northwestern Univ., Evanston, IL (United States)
- Pennsylvania State Univ., State College, PA (United States)
In high-performance computing systems, parallel I/O architectures usually have very complex hierarchies with multiple layers that collectively constitute an I/O stack, including high-level I/O libraries such as PnetCDF and HDF5, I/O middleware such as MPI-IO, and parallel file systems such as PVFS and Lustre. Our project explored automated instrumentation and compiler support for I/O intensive applications. Our project made significant progress towards understanding the complex I/O hierarchies of high-performance storage systems (including storage caches, HDDs, and SSDs), and designing and implementing state-of-the-art compiler/runtime system technology that targets I/O intensive HPC applications that target leadership class machine. This final report summarizes the major achievements of the project and also points out promising future directions.
- Research Organization:
- Northwestern Univ., Evanston, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- DOE Contract Number:
- SC0001283
- OSTI ID:
- 1172903
- Report Number(s):
- DOE-NWU-0001283
- Country of Publication:
- United States
- Language:
- English
Similar Records
PETASCALE DATA STORAGE INSTITUTE (PDSI) Final Report
...And Eat it Too: High Read Performance in Write-Optimized HPC I/O Middleware File Formats