skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Wide Area Fileystem Performance using Lustre on the TeraGrid

Abstract

Today s scientific applications demand computational resources that can be provided only by parallel clusters of computers. Storage subsystems have responded to the increased demand for high-throughput disk access by moving to network attached storage. Emerging Cyberinfrastructure strategies are leading to geographically distributed computing resources such as the National Science Foundation s TeraGrid. One feature of the TeraGrid is a dedicated national network with WAN bandwidth on the same scale as machine room bandwidth. A natural next step for storage is to export file systems across wide area networks to be available on diverse resources. In this paper we detail our testing with the Lustre file system across the TeraGrid network. On a single 10 Gbps WAN link we achieved single host performance approaching 700 MB/s for single file writes and 1GB/s for two simultaneous file writes with minimal tuning.

Authors:
 [1];  [2];  [3]
  1. Indiana University
  2. ORNL
  3. Pittsburgh Supercomputing Center
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
Work for Others (WFO)
OSTI Identifier:
1154758
DOE Contract Number:
DE-AC05-00OR22725
Resource Type:
Conference
Resource Relation:
Conference: TeraGrid '07, Madison, WI, USA, 20070604, 20070608
Country of Publication:
United States
Language:
English

Citation Formats

Simms, Stephen, Pike, Gregory, and Balog, Douglas. Wide Area Fileystem Performance using Lustre on the TeraGrid. United States: N. p., 2007. Web.
Simms, Stephen, Pike, Gregory, & Balog, Douglas. Wide Area Fileystem Performance using Lustre on the TeraGrid. United States.
Simms, Stephen, Pike, Gregory, and Balog, Douglas. Mon . "Wide Area Fileystem Performance using Lustre on the TeraGrid". United States. doi:.
@article{osti_1154758,
title = {Wide Area Fileystem Performance using Lustre on the TeraGrid},
author = {Simms, Stephen and Pike, Gregory and Balog, Douglas},
abstractNote = {Today s scientific applications demand computational resources that can be provided only by parallel clusters of computers. Storage subsystems have responded to the increased demand for high-throughput disk access by moving to network attached storage. Emerging Cyberinfrastructure strategies are leading to geographically distributed computing resources such as the National Science Foundation s TeraGrid. One feature of the TeraGrid is a dedicated national network with WAN bandwidth on the same scale as machine room bandwidth. A natural next step for storage is to export file systems across wide area networks to be available on diverse resources. In this paper we detail our testing with the Lustre file system across the TeraGrid network. On a single 10 Gbps WAN link we achieved single host performance approaching 700 MB/s for single file writes and 1GB/s for two simultaneous file writes with minimal tuning.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Mon Jan 01 00:00:00 EST 2007},
month = {Mon Jan 01 00:00:00 EST 2007}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: