skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Peer-to-Peer Computing for Secure High Performance Data Copying

Abstract

The BaBar Copy Program (bbcp) is an excellent representative of peer-to-peer (P2P) computing. It is also a pioneering application of its type in the P2P arena. Built upon the foundation of its predecessor, Secure Fast Copy (sfcp), bbcp incorporates significant improvements performance and usability. As with sfcp, bbcp uses ssh for authentication; providing an elegant and simple working model--if you can ssh to a location, you can copy files to or from that location. To fully support this notion, bbcp transparently supports 3rd party copy operations. The program also incorporates several mechanism to deal with firewall security; the bane of P2P computing. To achieve high performance in a wide area network, bbcp allows a user to independently specify, the number of parallel network streams, tcp window size, and the file I/O blocking factor. Using these parameters, data is pipelined from source to target to provide a uniform traffic pattern that maximizes router efficiency. For improved recoverability, bbcp also keeps track of copy operations so that an operation can be restarted from the point of failure at a later time; minimizing the amount of network traffic in the event of a copy failure. Here, we preset the bbcp architecture, it's variousmore » features, and the reasons for their inclusion.« less

Authors:
Publication Date:
Research Org.:
Stanford Linear Accelerator Center, Menlo Park, CA (US)
Sponsoring Org.:
USDOE Office of Energy Research (ER) (US)
OSTI Identifier:
799054
Report Number(s):
SLAC-PUB-9173
TRN: US0206057
DOE Contract Number:  
AC03-76SF00515
Resource Type:
Technical Report
Resource Relation:
Other Information: PBD: 30 Apr 2002
Country of Publication:
United States
Language:
English
Subject:
99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; COMPUTER ARCHITECTURE; EFFICIENCY; PERFORMANCE; SECURITY; DATA TRANSMISSION; COMPUTER NETWORKS; STANFORD LINEAR ACCELERATOR CENTER

Citation Formats

Hanushevsky, Andrew B. Peer-to-Peer Computing for Secure High Performance Data Copying. United States: N. p., 2002. Web. doi:10.2172/799054.
Hanushevsky, Andrew B. Peer-to-Peer Computing for Secure High Performance Data Copying. United States. doi:10.2172/799054.
Hanushevsky, Andrew B. Tue . "Peer-to-Peer Computing for Secure High Performance Data Copying". United States. doi:10.2172/799054. https://www.osti.gov/servlets/purl/799054.
@article{osti_799054,
title = {Peer-to-Peer Computing for Secure High Performance Data Copying},
author = {Hanushevsky, Andrew B},
abstractNote = {The BaBar Copy Program (bbcp) is an excellent representative of peer-to-peer (P2P) computing. It is also a pioneering application of its type in the P2P arena. Built upon the foundation of its predecessor, Secure Fast Copy (sfcp), bbcp incorporates significant improvements performance and usability. As with sfcp, bbcp uses ssh for authentication; providing an elegant and simple working model--if you can ssh to a location, you can copy files to or from that location. To fully support this notion, bbcp transparently supports 3rd party copy operations. The program also incorporates several mechanism to deal with firewall security; the bane of P2P computing. To achieve high performance in a wide area network, bbcp allows a user to independently specify, the number of parallel network streams, tcp window size, and the file I/O blocking factor. Using these parameters, data is pipelined from source to target to provide a uniform traffic pattern that maximizes router efficiency. For improved recoverability, bbcp also keeps track of copy operations so that an operation can be restarted from the point of failure at a later time; minimizing the amount of network traffic in the event of a copy failure. Here, we preset the bbcp architecture, it's various features, and the reasons for their inclusion.},
doi = {10.2172/799054},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2002},
month = {4}
}

Technical Report:

Save / Share: