An Optimizing Compiler for Petascale I/O on Leadership-Class Architectures

Technical Report · Sat Mar 01 00:00:00 EST 2014

DOI:https://doi.org/10.2172/1123486· OSTI ID:1123486

Kandemir, Mahmut Taylan ^[1]; Choudary, Alok ^[2]; Thakur, Rajeev ^[3]

---

1. PSU
2. Northwestern
3. ANL

In high-performance computing (HPC), parallel I/O architectures usually have very complex hierarchies with multiple layers that collectively constitute an I/O stack, including high-level I/O libraries such as PnetCDF and HDF5, I/O middleware such as MPI-IO, and parallel file systems such as PVFS and Lustre. Our DOE project explored automated instrumentation and compiler support for I/O intensive applications. Our project made significant progress towards understanding the complex I/O hierarchies of high-performance storage systems (including storage caches, HDDs, and SSDs), and designing and implementing state-of-the-art compiler/runtime system technology that targets I/O intensive HPC applications that target leadership class machine. This final report summarizes the major achievements of the project and also points out promising future directions Two new sections in this report compared to the previous report are IOGenie and SSD/NVM-specific optimizations.

• Research Organization: Pennsylvania State Univ., University Park, PA (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: SC0002156
• OSTI ID: 1123486
• Report Number(s): DOE-PSU-02156
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING