skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Making resonance a common case: a high-performance implementation of collective I/O on parallel file systems

Abstract

Collective I/O is a widely used technique to improve I/O performance in parallel computing. It can be implemented as a client-based or server-based scheme. The client-based implementation is more widely adopted in MPI-IO software such as ROMIO because of its independence from the storage system configuration and its greater portability. However, existing implementations of client-side collective I/O do not take into account the actual pattern offile striping over multiple I/O nodes in the storage system. This can cause a significant number of requests for non-sequential data at I/O nodes, substantially degrading I/O performance. Investigating the surprisingly high I/O throughput achieved when there is an accidental match between a particular request pattern and the data striping pattern on the I/O nodes, we reveal the resonance phenomenon as the cause. Exploiting readily available information on data striping from the metadata server in popular file systems such as PVFS2 and Lustre, we design a new collective I/O implementation technique, resonant I/O, that makes resonance a common case. Resonant I/O rearranges requests from multiple MPI processes to transform non-sequential data accesses on I/O nodes into sequential accesses, significantly improving I/O performance without compromising the independence ofa client-based implementation. We have implemented our design inmore » ROMIO. Our experimental results show that the scheme can increase I/O throughput for some commonly used parallel I/O benchmarks such as mpi-io-test and ior-mpi-io over the existing implementation of ROMIO by up to 157%, with no scenario demonstrating significantly decreased performance.« less

Authors:
 [1];  [2];  [2]
  1. Los Alamos National Laboratory
  2. WAYNE STATE UNIV
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
956499
Report Number(s):
LA-UR-09-00201; LA-UR-09-201
TRN: US201013%%197
DOE Contract Number:  
AC52-06NA25396
Resource Type:
Conference
Resource Relation:
Conference: IEEE International Parallel & Distributed Processing Symposium ; May 25, 2009 ; Rome, Italy
Country of Publication:
United States
Language:
English
Subject:
42; BENCHMARKS; CONFIGURATION; DESIGN; IMPLEMENTATION; PERFORMANCE; PROCESSING; RESONANCE; STORAGE; COMPUTERS; PARALLEL PROCESSING

Citation Formats

Davis, Marion Kei, Zhang, Xuechen, and Jiang, Song. Making resonance a common case: a high-performance implementation of collective I/O on parallel file systems. United States: N. p., 2009. Web.
Davis, Marion Kei, Zhang, Xuechen, & Jiang, Song. Making resonance a common case: a high-performance implementation of collective I/O on parallel file systems. United States.
Davis, Marion Kei, Zhang, Xuechen, and Jiang, Song. Thu . "Making resonance a common case: a high-performance implementation of collective I/O on parallel file systems". United States. https://www.osti.gov/servlets/purl/956499.
@article{osti_956499,
title = {Making resonance a common case: a high-performance implementation of collective I/O on parallel file systems},
author = {Davis, Marion Kei and Zhang, Xuechen and Jiang, Song},
abstractNote = {Collective I/O is a widely used technique to improve I/O performance in parallel computing. It can be implemented as a client-based or server-based scheme. The client-based implementation is more widely adopted in MPI-IO software such as ROMIO because of its independence from the storage system configuration and its greater portability. However, existing implementations of client-side collective I/O do not take into account the actual pattern offile striping over multiple I/O nodes in the storage system. This can cause a significant number of requests for non-sequential data at I/O nodes, substantially degrading I/O performance. Investigating the surprisingly high I/O throughput achieved when there is an accidental match between a particular request pattern and the data striping pattern on the I/O nodes, we reveal the resonance phenomenon as the cause. Exploiting readily available information on data striping from the metadata server in popular file systems such as PVFS2 and Lustre, we design a new collective I/O implementation technique, resonant I/O, that makes resonance a common case. Resonant I/O rearranges requests from multiple MPI processes to transform non-sequential data accesses on I/O nodes into sequential accesses, significantly improving I/O performance without compromising the independence ofa client-based implementation. We have implemented our design in ROMIO. Our experimental results show that the scheme can increase I/O throughput for some commonly used parallel I/O benchmarks such as mpi-io-test and ior-mpi-io over the existing implementation of ROMIO by up to 157%, with no scenario demonstrating significantly decreased performance.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2009},
month = {1}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: