Improving network performance on multicore systems: Impact of core affinities on high throughput flows

Hanford, Nathan; Ahuja, Vishal; Farrens, Matthew; Ghosal, Dipak; Balman, Mehmet; Pouyoul, Eric; Tierney, Brian

doi:10.1016/j.future.2015.09.012

Title: Improving network performance on multicore systems: Impact of core affinities on high throughput flows

Authors:

; Ahuja, Vishal; Farrens, Matthew; Ghosal, Dipak; Balman, Mehmet; Pouyoul, Eric; Tierney, Brian

Publication Date:: Tue Mar 01 00:00:00 EST 2016

Sponsoring Org.:: USDOE

OSTI Identifier:: 1359143

Grant/Contract Number:: AC02-05CH11231

Resource Type:: Publisher's Accepted Manuscript

Journal Name:: Future Generations Computer Systems

Additional Journal Information:: Journal Name: Future Generations Computer Systems Journal Volume: 56 Journal Issue: C; Journal ID: ISSN 0167-739X

Publisher:: Elsevier

Country of Publication:: Netherlands

Language:: English

Citation Formats


                    Hanford, Nathan, Ahuja, Vishal, Farrens, Matthew, Ghosal, Dipak, Balman, Mehmet, Pouyoul, Eric, and Tierney, Brian. Improving network performance on multicore systems: Impact of core affinities on high throughput flows.  Netherlands: N. p., 2016. 
Web.  doi:10.1016/j.future.2015.09.012.

Copy to clipboard


                    Hanford, Nathan, Ahuja, Vishal, Farrens, Matthew, Ghosal, Dipak, Balman, Mehmet, Pouyoul, Eric, & Tierney, Brian. Improving network performance on multicore systems: Impact of core affinities on high throughput flows.  Netherlands.  https://doi.org/10.1016/j.future.2015.09.012

Copy to clipboard


                    Hanford, Nathan, Ahuja, Vishal, Farrens, Matthew, Ghosal, Dipak, Balman, Mehmet, Pouyoul, Eric, and Tierney, Brian. Tue .  
"Improving network performance on multicore systems: Impact of core affinities on high throughput flows".  Netherlands.  https://doi.org/10.1016/j.future.2015.09.012.

Copy to clipboard


                    
@article{osti_1359143,

  title        = {Improving network performance on multicore systems: Impact of core affinities on high throughput flows},

  author       = {Hanford, Nathan and Ahuja, Vishal and Farrens, Matthew and Ghosal, Dipak and Balman, Mehmet and Pouyoul, Eric and Tierney, Brian},

  abstractNote = {},

  doi          = {10.1016/j.future.2015.09.012},

  journal      = {Future Generations Computer Systems},

  number       = C,

  volume       = 56,

  place        = {Netherlands},

  year         = {Tue Mar 01 00:00:00 EST 2016},

  month        = {Tue Mar 01 00:00:00 EST 2016}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (Publisher)

Publisher's Version of Record
https://doi.org/10.1016/j.future.2015.09.012

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 10 works

Citation information provided by
Web of Science

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

The performance analysis of linux networking – Packet receiving
journal, March 2007

Wu, Wenji; Crawford, Matt; Bowden, Mark
Computer Communications, Vol. 30, Issue 5, p. 1044-1057
DOI: 10.1016/j.comcom.2006.11.001

Eliminating receive livelock in an interrupt-driven kernel
journal, August 1997

Mogul, Jeffrey C.; Ramakrishnan, K. K.
ACM Transactions on Computer Systems, Vol. 15, Issue 3, p. 217-252
DOI: 10.1145/263326.263335

A Transport-Friendly NIC for Multicore/Multiprocessor Systems
journal, April 2012

Wu, W.; Demar, P.; Crawford, M.
IEEE Transactions on Parallel and Distributed Systems, Vol. 23, Issue 4, p. 607-615
DOI: 10.1109/TPDS.2011.195

TCP Offload to the Rescue: Getting a toehold on TCP offload engines—and why we need them
journal, May 2004

Currid, Andy
Queue, Vol. 2, Issue 3
DOI: 10.1145/1005062.1005069

Dynamic Adaptation of Parallelism Level in Data Transfer Scheduling
conference, March 2009

Balman, Mehmet; Kosar, Tevfik
2009 International Conference on Complex, Intelligent and Software Intensive Systems (CISIS)
DOI: 10.1109/CISIS.2009.15

Architectural Breakdown of End-to-End Latency in a TCP/IP Network
journal, June 2009

Larsen, Steen; Sarangam, Parthasarathy; Huggahalli, Ram
International Journal of Parallel Programming, Vol. 37, Issue 6
DOI: 10.1007/s10766-009-0109-6

Potential performance bottleneck in Linux TCP
journal, January 2007

Wu, Wenji; Crawford, Matt
International Journal of Communication Systems, Vol. 20, Issue 11
DOI: 10.1002/dac.872

Impact of the end-system and affinities on the throughput of high-speed flows
conference, October 2014

Hanford, Nathan; Ahuja, Vishal; Farrens, Matthew K.
ANCS '14: Symposium on Architectures for Networking and Communications Systems, Proceedings of the tenth ACM/IEEE symposium on Architectures for networking and communications systems
DOI: 10.1145/2658260.2661772

Evaluating the Performance of Network Protocol Processing on Multi-core Systems
conference, May 2009

Faulkner, Matthew; Brampton, Andrew; Pink, Stephen
2009 International Conference on Advanced Information Networking and Applications
DOI: 10.1109/AINA.2009.91

UDT: UDP-based data transfer for high-speed wide area networks
journal, May 2007

Gu, Yunhong; Grossman, Robert L.
Computer Networks, Vol. 51, Issue 7
DOI: 10.1016/j.comnet.2006.11.009

Similar Records in DOE PAGES and OSTI.GOV collections:

Investigating the effectiveness of many-core network processors for high performance cyber protection systems. Part I, FY2011.

Technical Report Wheeler, Kyle Bruce ; Naegle, John Hunt ; Wright, Brian J ; ...

This report documents our first year efforts to address the use of many-core processors for high performance cyber protection. As the demands grow for higher bandwidth (beyond 1 Gbits/sec) on network connections, the need to provide faster and more efficient solution to cyber security grows. Fortunately, in recent years, the development of many-core network processors have seen increased interest. Prior working experiences with many-core processors have led us to investigate its effectiveness for cyber protection tools, with particular emphasis on high performance firewalls. Although advanced algorithms for smarter cyber protection of high-speed network traffic are being developed, these advanced analysismore »« less
https://doi.org/10.2172/1029789

Full Text Available
Algorithms for high-throughput disk-to-disk sorting, In: SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

Conference Sundar, Hari ; Malhotra, Dhairya ; Schulz, Karl W. - 2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC)

In this paper, we present a new out-of-core sort algorithm, designed for problems that are too large to fit into the aggregate RAM available on modern supercomputers. We analyze the performance including the cost of IO and demonstrate the fastest (to the best of our knowledge) reported throughput using the canonical sortBenchmark on a general-purpose, production HPC resource running Lustre. By clever use of available storage and a formulation of asynchronous data transfer mechanisms, we are able to almost completely hide the computation (sorting) behind the IO latency. This latency hiding enables us to achieve comparable execution times, including themore »« less
https://doi.org/10.1145/2503210.2503259
High-Performance Sparse Matrix-Matrix Products on Intel KNL and Multicore Architectures

Conference Nagasaka, Yusuke ; Matsuoka, Satoshi ; Azad, Ariful ; ...

Sparse matrix-matrix multiplication (SpGEMM) is a computational primitive that is vastly used in areas ranging from traditional numerical applications to recent big data analysis and machine learning. While many SpGEMM algorithms have been proposed, hardware specific optimizations for multi- and many-core processors are lacking and a detailed analysis of their performance under various use cases and matrices is not available. We firstly identify and mitigate multiple bottlenecks with memory management and thread scheduling on Intel Xeon Phi (Knights Landing or KNL). Specifically targeting multi- and many-core processors, we develop a hash-table-based algorithm and optimize a heap-based shared-memory SpGEMM algorithm. Wemore »« less
https://doi.org/10.1145/3229710.3229720

Full Text Available
PGP: parallel prokaryotic proteogenomics pipeline for MPI clusters, high-throughput batch clusters and multicore workstations

Journal Article Tovchigrechko, A. ; Venepally, P. ; Payne, S. H. - Bioinformatics

Summary: We present the first public release of our proteogenomic annotation pipeline. We have previously used our original unreleased implementation to improve the annotation of 46 diverse prokaryotic genomes by discovering novel genes, post-translational modifications and correcting the erroneous annotations by analyzing proteomic mass-spectrometry data. This public version has been redesigned to run in a wide range of parallel Linux computing environments and provided with the automated configuration, build and testing facilities for easy deployment and portability.
https://doi.org/10.1093/bioinformatics/btu051

Full Text Available
Co-scheduling of network resource provisioning and host-to-host bandwidth reservation on high-performance network and storage systems

Patent Yu, Dantong ; Katramatos, Dimitrios ; Sim, Alexander ; ...

A cross-domain network resource reservation scheduler configured to schedule a path from at least one end-site includes a management plane device configured to monitor and provide information representing at least one of functionality, performance, faults, and fault recovery associated with a network resource; a control plane device configured to at least one of schedule the network resource, provision local area network quality of service, provision local area network bandwidth, and provision wide area network bandwidth; and a service plane device configured to interface with the control plane device to reserve the network resource based on a reservation request and themore »« less
Full Text Available

Similar Records

Title: Improving network performance on multicore systems: Impact of core affinities on high throughput flows

Citation Formats

The performance analysis of linux networking – Packet receiving journal, March 2007

Eliminating receive livelock in an interrupt-driven kernel journal, August 1997

A Transport-Friendly NIC for Multicore/Multiprocessor Systems journal, April 2012

TCP Offload to the Rescue: Getting a toehold on TCP offload engines—and why we need them journal, May 2004

Dynamic Adaptation of Parallelism Level in Data Transfer Scheduling conference, March 2009

Architectural Breakdown of End-to-End Latency in a TCP/IP Network journal, June 2009

Potential performance bottleneck in Linux TCP journal, January 2007

Impact of the end-system and affinities on the throughput of high-speed flows conference, October 2014

Evaluating the Performance of Network Protocol Processing on Multi-core Systems conference, May 2009

UDT: UDP-based data transfer for high-speed wide area networks journal, May 2007

The performance analysis of linux networking – Packet receiving
journal, March 2007

Eliminating receive livelock in an interrupt-driven kernel
journal, August 1997

A Transport-Friendly NIC for Multicore/Multiprocessor Systems
journal, April 2012

TCP Offload to the Rescue: Getting a toehold on TCP offload engines—and why we need them
journal, May 2004

Dynamic Adaptation of Parallelism Level in Data Transfer Scheduling
conference, March 2009

Architectural Breakdown of End-to-End Latency in a TCP/IP Network
journal, June 2009

Potential performance bottleneck in Linux TCP
journal, January 2007

Impact of the end-system and affinities on the throughput of high-speed flows
conference, October 2014

Evaluating the Performance of Network Protocol Processing on Multi-core Systems
conference, May 2009

UDT: UDP-based data transfer for high-speed wide area networks
journal, May 2007