Re-architecting flow-control adaptation for grid environments
- Adam
- Mark K.
- Wu-Chun
The performance of TCP in wide-area networks (WANs) is becoming increasingly important with the deployment of computational and data grids. At WAN speeds, TCP does not provide good performance for data-intensive applications without the tuning of flow-control buffer sizes. Manual adjustment of buffer sizes is tedious even for network experts. For scientists, tuning is often an impediment to getting work done. Thus, buffer tuning should be automated. Existing techniques for automatic buffer tuning only measure the bandwidth-delay product (BDP) during connection establishment. This ignores the (large) fluctuation of the BDP over the lifetime of the connection. In contrast, the Dynamic Right-Sizing algorithm dynamically changes buffer sizes in response to changing network conditions. In this paper, we describe a new user-space implementation of Dynamic Right-Sizing in FTP (drsFTP) that supports third-party data transfers, a mainstay of scientific computing. In addition to comparing the performance of the new implementation with the old, we give performance results over a live WAN. The new implementation gives transfer rates of up to five times higher than untuned FTP.
- Research Organization:
- Los Alamos National Laboratory
- Sponsoring Organization:
- DOE
- OSTI ID:
- 977426
- Report Number(s):
- LA-UR-04-0494; LA-UR-04-494
- Country of Publication:
- United States
- Language:
- English
Similar Records
DYNAMIC RIGHT-SIZING IN TCP.
Comparison of TCP automatic tuning techniques for distributed computing