A High-Performance GriFTP Server at Desktop Cost

Conference · Sun Dec 31 23:00:00 EST 2006

OSTI ID:962604

Al-Kiswany, Samer ^[1]; Bahramshahry, Armin ^[1]; Ghasemi, Hesam ^[1]; Ripeanu, Matei ^[1]; Vazhkudai, Sudharshan S ^[2]

---

1. University of British Columbia, Vancouver
2. ORNL

We prototype a storage system that provides the access performance of a well-endowed GridFTP deployment (e.g., using a cluster and a parallel file-system) at the modest cost of single desktop. To this end, we integrate GridFTP and a combination of dedicated but low-bandwidth (thus cheap) storage nodes and scavenged storage from LAN-connected desktops that participate intermittently to the storage pool. The main advantage of this setup is that it alleviates the server I/O access bottleneck. Additionally, the specific data access pattern of GridFTP, that is, the fact that data accesses are mostly sequential, allows for optimizations that result in a high-performance storage system. To provide data durability when facing intermittent participation of the storage resources, we use an intelligent replication scheme that minimizes the volume of internal transfers that impact the low-bandwidth storage nodes.

• Research Organization: Oak Ridge National Laboratory (ORNL); Center for Computational Sciences
• Sponsoring Organization: ORNL LDRD Director's R&D
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 962604
• Country of Publication: United States
• Language: English

Related Subjects

97 MATHEMATICS AND COMPUTING
99 GENERAL AND MISCELLANEOUS
COST
DATA TRANSMISSION
Grid data movement
GridFTP
MEMORY DEVICES
PERFORMANCE
distributed storage
striped storage