skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: XGet: a highly scalable and efficient file transfer tool for clusters

Abstract

As clusters rapidly grow in size, transferring files between nodes can no longer be solved by the traditional transfer utilities due to their inherent lack of scalability. In this paper, we describe a new file transfer utility called XGet, which was designed to address the scalability problem of standard tools. We compared XGet against four transfer tools: Bittorrent, Rsync, TFTP, and Udpcast and our results show that XGet's performance is superior to the these utilities in many cases.

Authors:
 [1];  [1];  [2]
  1. Los Alamos National Laboratory
  2. SNL
Publication Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
960932
Report Number(s):
LA-UR-08-06574; LA-UR-08-6574
TRN: US201008%%837
DOE Contract Number:  
AC52-06NA25396
Resource Type:
Conference
Resource Relation:
Conference: LCI conference on High Performance Clustered Computing ; March 10, 2009 ; Bolder, CO
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; COMPUTER CODES; COMPUTER NETWORKS; DATA PROCESSING; DATA TRANSMISSION; DISTRIBUTED DATA PROCESSING; INFORMATION SYSTEMS

Citation Formats

Greenberg, Hugh, Ionkov, Latchesar, and Minnich, Ronald. XGet: a highly scalable and efficient file transfer tool for clusters. United States: N. p., 2008. Web.
Greenberg, Hugh, Ionkov, Latchesar, & Minnich, Ronald. XGet: a highly scalable and efficient file transfer tool for clusters. United States.
Greenberg, Hugh, Ionkov, Latchesar, and Minnich, Ronald. 2008. "XGet: a highly scalable and efficient file transfer tool for clusters". United States. https://www.osti.gov/servlets/purl/960932.
@article{osti_960932,
title = {XGet: a highly scalable and efficient file transfer tool for clusters},
author = {Greenberg, Hugh and Ionkov, Latchesar and Minnich, Ronald},
abstractNote = {As clusters rapidly grow in size, transferring files between nodes can no longer be solved by the traditional transfer utilities due to their inherent lack of scalability. In this paper, we describe a new file transfer utility called XGet, which was designed to address the scalability problem of standard tools. We compared XGet against four transfer tools: Bittorrent, Rsync, TFTP, and Udpcast and our results show that XGet's performance is superior to the these utilities in many cases.},
doi = {},
url = {https://www.osti.gov/biblio/960932}, journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Jan 01 00:00:00 EST 2008},
month = {Tue Jan 01 00:00:00 EST 2008}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: