Wide Area Fileystem Performance using Lustre on the TeraGrid

Conference · Mon Jan 01 04:00:00 EST 2007

OSTI ID:1154758

Simms, Stephen ^[1]; Pike, Gregory ^[2]; Balog, Douglas ^[3]

---

1. Indiana University
2. ORNL
3. Pittsburgh Supercomputing Center

Today s scientific applications demand computational resources that can be provided only by parallel clusters of computers. Storage subsystems have responded to the increased demand for high-throughput disk access by moving to network attached storage. Emerging Cyberinfrastructure strategies are leading to geographically distributed computing resources such as the National Science Foundation s TeraGrid. One feature of the TeraGrid is a dedicated national network with WAN bandwidth on the same scale as machine room bandwidth. A natural next step for storage is to export file systems across wide area networks to be available on diverse resources. In this paper we detail our testing with the Lustre file system across the TeraGrid network. On a single 10 Gbps WAN link we achieved single host performance approaching 700 MB/s for single file writes and 1GB/s for two simultaneous file writes with minimal tuning.

• Research Organization: Oak Ridge National Laboratory (ORNL)
• Sponsoring Organization: ORNL work for others
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1154758
• Country of Publication: United States
• Language: English