skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Profiling optimization for big data transfer over dedicated channels

Abstract

The transfer of big data is increasingly supported by dedicated channels in high-performance networks, where transport protocols play an important role in maximizing applicationlevel throughput and link utilization. The performance of transport protocols largely depend on their control parameter settings, but it is prohibitively time consuming to conduct an exhaustive search in a large parameter space to find the best set of parameter values. We propose FastProf, a stochastic approximation-based transport profiler, to quickly determine the optimal operational zone of a given data transfer protocol/method over dedicated channels. We implement and test the proposed method using both emulations based on real-life performance measurements and experiments over physical connections with short (2 ms) and long (380 ms) delays. Both the emulation and experimental results show that FastProf significantly reduces the profiling overhead while achieving a comparable level of end-to-end throughput performance with the exhaustive search-based approach.

Authors:
 [1];  [2];  [3];  [4];  [4]
  1. New Jersey Institute of Technology
  2. University of Memphis
  3. ORNL
  4. Argonne National Laboratory (ANL)
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1327736
DOE Contract Number:  
AC05-00OR22725
Resource Type:
Conference
Resource Relation:
Conference: 25th International Conference on Computer Communication and Networks (ICCCN), Waokoloa, HI, USA, 20160801, 20160804
Country of Publication:
United States
Language:
English

Citation Formats

Yun, D., Wu, Qishi, Rao, Nageswara S, Kettimuthu, R., and Jung, E. S. Profiling optimization for big data transfer over dedicated channels. United States: N. p., 2016. Web. doi:10.1109/ICCCN.2016.7568562.
Yun, D., Wu, Qishi, Rao, Nageswara S, Kettimuthu, R., & Jung, E. S. Profiling optimization for big data transfer over dedicated channels. United States. https://doi.org/10.1109/ICCCN.2016.7568562
Yun, D., Wu, Qishi, Rao, Nageswara S, Kettimuthu, R., and Jung, E. S. 2016. "Profiling optimization for big data transfer over dedicated channels". United States. https://doi.org/10.1109/ICCCN.2016.7568562.
@article{osti_1327736,
title = {Profiling optimization for big data transfer over dedicated channels},
author = {Yun, D. and Wu, Qishi and Rao, Nageswara S and Kettimuthu, R. and Jung, E. S.},
abstractNote = {The transfer of big data is increasingly supported by dedicated channels in high-performance networks, where transport protocols play an important role in maximizing applicationlevel throughput and link utilization. The performance of transport protocols largely depend on their control parameter settings, but it is prohibitively time consuming to conduct an exhaustive search in a large parameter space to find the best set of parameter values. We propose FastProf, a stochastic approximation-based transport profiler, to quickly determine the optimal operational zone of a given data transfer protocol/method over dedicated channels. We implement and test the proposed method using both emulations based on real-life performance measurements and experiments over physical connections with short (2 ms) and long (380 ms) delays. Both the emulation and experimental results show that FastProf significantly reduces the profiling overhead while achieving a comparable level of end-to-end throughput performance with the exhaustive search-based approach.},
doi = {10.1109/ICCCN.2016.7568562},
url = {https://www.osti.gov/biblio/1327736}, journal = {},
number = ,
volume = ,
place = {United States},
year = {Fri Jan 01 00:00:00 EST 2016},
month = {Fri Jan 01 00:00:00 EST 2016}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: