skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: End-System Aware Peak Link Utilization Transport for Big Data Transfer over Dedicated Connections

Abstract

High-performance networks provisioning 10/40-Gbps dedicated channels have been rapidly developed andincreasingly deployed to support big data transfers on the order of terabytes or petabytes in large-scale network-intensiveapplications. However, end users have not seen corresponding increase in application throughput mainly because traditional end-to-end transport methods are not optimized for such connections. New congestion or flow control mechanisms are desirable to meet the challenges brought to transport protocol design by dedicated connections. The advent and proliferation of multi-core processors make it now possible to improve application throughput by providing multiple processing and network resources to a single data transfer. Based on the existing PLUT method, we proposed a new dynamic buffer management scheme and an automatic parallelism tuning mechanism to achieve the maximal bottleneck rate. The performance superiority of PLUT is justified by the experimental results collected over a local 10Gbps dedicated connection.

Authors:
ORCiD logo [1];  [2];  [3]
  1. ORNL
  2. Tianjin UNiversity, China
  3. New Jersey Institute of Technology
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
OSTI Identifier:
1476411
DOE Contract Number:  
AC05-00OR22725
Resource Type:
Conference
Resource Relation:
Conference: 27th International Conference on Computer Communications and Networks (ICCCN 2018) - Hangzhou, , China - 7/30/2018 8:00:00 AM-8/2/2018 8:00:00 AM
Country of Publication:
United States
Language:
English

Citation Formats

Rao, Nageswara S., Lyu, Xukang, and Wu, Chase Qishi. End-System Aware Peak Link Utilization Transport for Big Data Transfer over Dedicated Connections. United States: N. p., 2018. Web.
Rao, Nageswara S., Lyu, Xukang, & Wu, Chase Qishi. End-System Aware Peak Link Utilization Transport for Big Data Transfer over Dedicated Connections. United States.
Rao, Nageswara S., Lyu, Xukang, and Wu, Chase Qishi. Sun . "End-System Aware Peak Link Utilization Transport for Big Data Transfer over Dedicated Connections". United States. https://www.osti.gov/servlets/purl/1476411.
@article{osti_1476411,
title = {End-System Aware Peak Link Utilization Transport for Big Data Transfer over Dedicated Connections},
author = {Rao, Nageswara S. and Lyu, Xukang and Wu, Chase Qishi},
abstractNote = {High-performance networks provisioning 10/40-Gbps dedicated channels have been rapidly developed andincreasingly deployed to support big data transfers on the order of terabytes or petabytes in large-scale network-intensiveapplications. However, end users have not seen corresponding increase in application throughput mainly because traditional end-to-end transport methods are not optimized for such connections. New congestion or flow control mechanisms are desirable to meet the challenges brought to transport protocol design by dedicated connections. The advent and proliferation of multi-core processors make it now possible to improve application throughput by providing multiple processing and network resources to a single data transfer. Based on the existing PLUT method, we proposed a new dynamic buffer management scheme and an automatic parallelism tuning mechanism to achieve the maximal bottleneck rate. The performance superiority of PLUT is justified by the experimental results collected over a local 10Gbps dedicated connection.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2018},
month = {7}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: