Initial Characterization of Parallel NFS Implementations
Conference
·
OSTI ID:982407
- ORNL
Parallel NFS (pNFS) is touted as an emergent standard protocol for parallel I/O access in various storage environments. Several pNFS prototypes have been implemented for initial validation and protocol examination. Previous efforts have focused on realizing the pNFS protocol to expose the best bandwidth potential from underlying file and storage systems. In this presentation, we provide an initial characterization of two pNFS prototype implementations, lpNFS (a Lustre-based parallel NFS implementation) and spNFS (another reference implementation from Network Appliance, Inc.). We show that both lpNFS and spNFS can faithfully achieve the primary goal of pNFS, i.e., aggregating I/O bandwidth from many storage servers. However, they both face the challenge of scalable metadata management. Particularly, the throughput of sp-NFS metadata operations degrades significanlty with an increasing number of data servers. Even for the better-performing lpNFS, we discuss its architecture and propose a direct I/O request flow protocol to improve its performance.
- Research Organization:
- Oak Ridge National Laboratory (ORNL)
- Sponsoring Organization:
- SC USDOE - Office of Science (SC)
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 982407
- Country of Publication:
- United States
- Language:
- English
Similar Records
Making resonance a common case: a high-performance implementation of collective I/O on parallel file systems
Petascale Data Storage Institute (Final Report)
I/O load balancing for big data HPC applications
Conference
·
Wed Dec 31 23:00:00 EST 2008
·
OSTI ID:956499
Petascale Data Storage Institute (Final Report)
Technical Report
·
Fri Jul 27 00:00:00 EDT 2012
·
OSTI ID:1176902
I/O load balancing for big data HPC applications
Conference
·
Sun Dec 31 23:00:00 EST 2017
·
OSTI ID:1415911