Applied techniques for high bandwidth data transfers across wide area networks
Large distributed systems such as Computational/Data Grids require large amounts of data to be co-located with the computing facilities for processing. Ensuring that the data is there in time for the computation in today's Internet is a massive problem. From our work developing a scalable distributed network cache, we have gained experience with techniques necessary to achieve high data throughput over high bandwidth Wide Area Networks (WAN). In this paper, we discuss several hardware and software design techniques and issues, and then describe their application to an implementation of an enhanced FTP protocol called GridFTP. We also describe results from two applications using these techniques, which were obtained at the Supercomputing 2000 conference.
- Research Organization:
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Sponsoring Organization:
- USDOE Director, Office of Science. Office of Advanced Scientific Computing Research. Mathematical, Information, and Computational Sciences Division (US)
- DOE Contract Number:
- AC03-76SF00098
- OSTI ID:
- 789141
- Report Number(s):
- LBNL-47183; R&D Project: 4296; TRN: US0111398
- Resource Relation:
- Conference: Computing in High Energy and Nuclear Physics, Beijing (CN), 09/03/2000--09/07/2000; Other Information: PBD: 30 Apr 2001
- Country of Publication:
- United States
- Language:
- English
Similar Records
IP storage : a performance and security study, LDRD 04-1021.
Evaluation of replacement protocols and modifications to TCP to enhance ASC Wide Area Network performance.