XGet: a highly scalable and efficient file transfer tool for clusters
Abstract
As clusters rapidly grow in size, transferring files between nodes can no longer be solved by the traditional transfer utilities due to their inherent lack of scalability. In this paper, we describe a new file transfer utility called XGet, which was designed to address the scalability problem of standard tools. We compared XGet against four transfer tools: Bittorrent, Rsync, TFTP, and Udpcast and our results show that XGet's performance is superior to the these utilities in many cases.
- Authors:
-
- Los Alamos National Laboratory
- SNL
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 960932
- Report Number(s):
- LA-UR-08-06574; LA-UR-08-6574
TRN: US201008%%837
- DOE Contract Number:
- AC52-06NA25396
- Resource Type:
- Conference
- Resource Relation:
- Conference: LCI conference on High Performance Clustered Computing ; March 10, 2009 ; Bolder, CO
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; COMPUTER CODES; COMPUTER NETWORKS; DATA PROCESSING; DATA TRANSMISSION; DISTRIBUTED DATA PROCESSING; INFORMATION SYSTEMS
Citation Formats
Greenberg, Hugh, Ionkov, Latchesar, and Minnich, Ronald. XGet: a highly scalable and efficient file transfer tool for clusters. United States: N. p., 2008.
Web.
Greenberg, Hugh, Ionkov, Latchesar, & Minnich, Ronald. XGet: a highly scalable and efficient file transfer tool for clusters. United States.
Greenberg, Hugh, Ionkov, Latchesar, and Minnich, Ronald. 2008.
"XGet: a highly scalable and efficient file transfer tool for clusters". United States. https://www.osti.gov/servlets/purl/960932.
@article{osti_960932,
title = {XGet: a highly scalable and efficient file transfer tool for clusters},
author = {Greenberg, Hugh and Ionkov, Latchesar and Minnich, Ronald},
abstractNote = {As clusters rapidly grow in size, transferring files between nodes can no longer be solved by the traditional transfer utilities due to their inherent lack of scalability. In this paper, we describe a new file transfer utility called XGet, which was designed to address the scalability problem of standard tools. We compared XGet against four transfer tools: Bittorrent, Rsync, TFTP, and Udpcast and our results show that XGet's performance is superior to the these utilities in many cases.},
doi = {},
url = {https://www.osti.gov/biblio/960932},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Jan 01 00:00:00 EST 2008},
month = {Tue Jan 01 00:00:00 EST 2008}
}
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.