skip to main content

Title: XGet: a highly scalable and efficient file transfer tool for clusters

As clusters rapidly grow in size, transferring files between nodes can no longer be solved by the traditional transfer utilities due to their inherent lack of scalability. In this paper, we describe a new file transfer utility called XGet, which was designed to address the scalability problem of standard tools. We compared XGet against four transfer tools: Bittorrent, Rsync, TFTP, and Udpcast and our results show that XGet's performance is superior to the these utilities in many cases.
Authors:
 [1] ;  [1] ;  [2]
  1. Los Alamos National Laboratory
  2. SNL
Publication Date:
OSTI Identifier:
960932
Report Number(s):
LA-UR-08-06574; LA-UR-08-6574
TRN: US201008%%837
DOE Contract Number:
AC52-06NA25396
Resource Type:
Conference
Resource Relation:
Conference: LCI conference on High Performance Clustered Computing ; March 10, 2009 ; Bolder, CO
Research Org:
Los Alamos National Laboratory (LANL)
Sponsoring Org:
DOE
Country of Publication:
United States
Language:
English
Subject:
97; COMPUTER CODES; COMPUTER NETWORKS; DATA PROCESSING; DATA TRANSMISSION; DISTRIBUTED DATA PROCESSING; INFORMATION SYSTEMS