Measurement-based performance profiles and dynamics of UDT over dedicated connections

Conference · Tue Nov 01 00:00:00 EDT 2016

OSTI ID:1399538

Foster, Ian ^[1]; Kettimuthu, R. ^[2]; Wu, Qishi ^[3]; Yun, Daqing ^[4]; Rao, Nageswara S.  ^[5]; Liu, Qiang  ^[5]

---

1. University of Chicago
2. Argonne National Laboratory (ANL)
3. University of Memphis
4. Harrisburg University
5. ORNL

Wide-area data transfers in high-performance computing and big data scenarios are increasingly being carried over dedicated network connections that provide high capacities at low loss rates. UDP-based transport protocols are expected to be particularly well-suited for such transfers but their performance is relatively unexplored over a wide range of connection lengths, compared to TCP over shared connections. We present extensive throughput measurements of UDP-based Data Transfer (UDT) over a suite of physical and emulated 10 Gbps connections. In sharp contrast to current UDT analytical models, these measurements indicate much more complex throughput dynamics that are sensitive to the connection modality, protocol parameters, and round-trip times. Lyapunov exponents estimated from the Poincare maps of UDT traces clearly indicate regions of instability and complex dynamics. We propose a simple model based on the ramp-up and sustainment regimes of a generic transport protocol, which qualitatively illustrates the dominant monotonicity and concavity properties of throughput profiles and relates them to Lyapunov exponents. These measurements and analytical results together enable us to comprehensively evaluate UDT performance and select parameters to achieve high throughput, and they also provide guidelines for designing effective transport protocols for dedicated connections.

• Research Organization: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1399538
• Resource Relation: Conference: 24th International Conference on Network Protocols (ICNP) - Singapore, , Singapore - 11/8/2016 5:00:00 AM-11/11/2016 5:00:00 AM
• Country of Publication: United States
• Language: English