XGet: a highly scalable and efficient file transfer tool for clusters
Conference
·
OSTI ID:960932
- Los Alamos National Laboratory
- SNL
As clusters rapidly grow in size, transferring files between nodes can no longer be solved by the traditional transfer utilities due to their inherent lack of scalability. In this paper, we describe a new file transfer utility called XGet, which was designed to address the scalability problem of standard tools. We compared XGet against four transfer tools: Bittorrent, Rsync, TFTP, and Udpcast and our results show that XGet's performance is superior to the these utilities in many cases.
- Research Organization:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC52-06NA25396
- OSTI ID:
- 960932
- Report Number(s):
- LA-UR-08-06574; LA-UR-08-6574; TRN: US201008%%837
- Resource Relation:
- Conference: LCI conference on High Performance Clustered Computing ; March 10, 2009 ; Bolder, CO
- Country of Publication:
- United States
- Language:
- English
Similar Records
FCP: A Fast and Scalable Data Copy Tool for High Performance Parallel File Systems
Detailed Modeling, Design, and Evaluation of a Scalable Multi-level Checkpointing System
Durango: Scalable Synthetic Workload Generation for Extreme-Scale Application Performance Modeling and Simulation
Conference
·
Sun May 01 00:00:00 EDT 2016
·
OSTI ID:960932
+1 more
Detailed Modeling, Design, and Evaluation of a Scalable Multi-level Checkpointing System
Technical Report
·
Fri Apr 09 00:00:00 EDT 2010
·
OSTI ID:960932
+1 more
Durango: Scalable Synthetic Workload Generation for Extreme-Scale Application Performance Modeling and Simulation
Conference
·
Mon May 01 00:00:00 EDT 2017
·
OSTI ID:960932
+4 more