Non-collective Parallel I/O for Global Address Space Programming Models
Achieving high performance for out-of-core applications typically involves explicit management of the movement of data between the disk and the physical memory. We are developing a programming environment in which the different levels of the memory hierarchy are handled efficiently in a unified transparent framework. In this paper, we present our experiences with implementing efficient non-collective I/O (GPC-IO) as part of this framework. As a generalization of the Remote Procedure Call (RPC) that was used as a foundation for the Sun NFS system, we developed a global procedure call (GPC) to invoke procedures on a remote node to handle non-collective I/O. We consider alternative approaches that can be employed in implementing this functionality. The approaches are evaluated using a representative computation from quantum chemistry. The results demonstrate that GPC-IO achieves better absolute execution times, strong-scaling, and weakscaling than the alternatives considered.
- Research Organization:
- Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-76RL01830
- OSTI ID:
- 990148
- Report Number(s):
- PNNL-SA-57215; KJ0402000; TRN: US201020%%152
- Resource Relation:
- Conference: IEEE International Conference on Cluster Computing: IEEE CLUSTER'2007, 41-49
- Country of Publication:
- United States
- Language:
- English
Similar Records
Proactive Data Containers for Scientific Storage (Final Report)
On implementing MPI-IO portably and with high performance.