skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: UCX: An Open Source Framework for HPC Network APIs and Beyond, In: 2015 IEEE 23rd Annual Symposium on High-Performance Interconnects

Abstract

This paper presents Unified Communication X (UCX), a set of network APIs and their implementations for high throughput computing. UCX comes from the combined effort of national laboratories, industry, and academia to design and implement a high-performing and highly-scalable network stack for next generation applications and systems. UCX design provides the ability to tailor its APIs and network functionality to suit a wide variety of application domains and hardware. We envision these APIs to satisfy the networking needs of many programming models such as Message Passing Interface (MPI), OpenSHMEM, Partitioned Global Address Space (PGAS) languages, task-based paradigms and I/O bound applications. To evaluate the design we implement the APIs and protocols, and measure the performance of overhead-critical network primitives fundamental for implementing many parallel programming models and system libraries. Our results show that the latency, bandwidth, and message rate achieved by the portable UCX prototype is very close to that of the underlying driver. With UCX, we achieved a message exchange latency of 0.89 us, a bandwidth of 6138.5 MB/s, and a message rate of 14 million messages per second. As far as we know, this is the highest bandwidth and message rate achieved by any network stack (publicly known)more » on this hardware.« less

Authors:
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1567394
Resource Type:
Conference
Journal Name:
PROCEEDINGS 2015 IEEE 23RD ANNUAL SYMPOSIUM ON HIGH-PERFORMANCE INTERCONNECTS - HOTI 2015
Additional Journal Information:
Conference: 23rd Annual Symposium on High-Performance Interconnects. Santa Clara, CA, August 26-28, 2015
Country of Publication:
United States
Language:
English
Subject:
Computer Science; Engineering

Citation Formats

Shamis, Pavel, Venkata, Manjunath Gorentla, Lopez, M. Graham, Baker, Matthew B., Hernandez, Oscar, Itigin, Yossi, Dubman, Mike, Shainer, Gilad, Graham, Richard L., Liss, Liran, Shahar, Yiftah, Potluri, Sreeram, Rossetti, Davide, Becker, Donald, Poole, Duncan, Lamb, Christopher, Kumar, Sameer, Stunkel, Craig, Bosilca, George, and Bouteiller, Aurelien. UCX: An Open Source Framework for HPC Network APIs and Beyond, In: 2015 IEEE 23rd Annual Symposium on High-Performance Interconnects. United States: N. p., 2015. Web. doi:10.1109/HOTI.2015.13.
Shamis, Pavel, Venkata, Manjunath Gorentla, Lopez, M. Graham, Baker, Matthew B., Hernandez, Oscar, Itigin, Yossi, Dubman, Mike, Shainer, Gilad, Graham, Richard L., Liss, Liran, Shahar, Yiftah, Potluri, Sreeram, Rossetti, Davide, Becker, Donald, Poole, Duncan, Lamb, Christopher, Kumar, Sameer, Stunkel, Craig, Bosilca, George, & Bouteiller, Aurelien. UCX: An Open Source Framework for HPC Network APIs and Beyond, In: 2015 IEEE 23rd Annual Symposium on High-Performance Interconnects. United States. https://doi.org/10.1109/HOTI.2015.13
Shamis, Pavel, Venkata, Manjunath Gorentla, Lopez, M. Graham, Baker, Matthew B., Hernandez, Oscar, Itigin, Yossi, Dubman, Mike, Shainer, Gilad, Graham, Richard L., Liss, Liran, Shahar, Yiftah, Potluri, Sreeram, Rossetti, Davide, Becker, Donald, Poole, Duncan, Lamb, Christopher, Kumar, Sameer, Stunkel, Craig, Bosilca, George, and Bouteiller, Aurelien. 2015. "UCX: An Open Source Framework for HPC Network APIs and Beyond, In: 2015 IEEE 23rd Annual Symposium on High-Performance Interconnects". United States. https://doi.org/10.1109/HOTI.2015.13.
@article{osti_1567394,
title = {UCX: An Open Source Framework for HPC Network APIs and Beyond, In: 2015 IEEE 23rd Annual Symposium on High-Performance Interconnects},
author = {Shamis, Pavel and Venkata, Manjunath Gorentla and Lopez, M. Graham and Baker, Matthew B. and Hernandez, Oscar and Itigin, Yossi and Dubman, Mike and Shainer, Gilad and Graham, Richard L. and Liss, Liran and Shahar, Yiftah and Potluri, Sreeram and Rossetti, Davide and Becker, Donald and Poole, Duncan and Lamb, Christopher and Kumar, Sameer and Stunkel, Craig and Bosilca, George and Bouteiller, Aurelien},
abstractNote = {This paper presents Unified Communication X (UCX), a set of network APIs and their implementations for high throughput computing. UCX comes from the combined effort of national laboratories, industry, and academia to design and implement a high-performing and highly-scalable network stack for next generation applications and systems. UCX design provides the ability to tailor its APIs and network functionality to suit a wide variety of application domains and hardware. We envision these APIs to satisfy the networking needs of many programming models such as Message Passing Interface (MPI), OpenSHMEM, Partitioned Global Address Space (PGAS) languages, task-based paradigms and I/O bound applications. To evaluate the design we implement the APIs and protocols, and measure the performance of overhead-critical network primitives fundamental for implementing many parallel programming models and system libraries. Our results show that the latency, bandwidth, and message rate achieved by the portable UCX prototype is very close to that of the underlying driver. With UCX, we achieved a message exchange latency of 0.89 us, a bandwidth of 6138.5 MB/s, and a message rate of 14 million messages per second. As far as we know, this is the highest bandwidth and message rate achieved by any network stack (publicly known) on this hardware.},
doi = {10.1109/HOTI.2015.13},
url = {https://www.osti.gov/biblio/1567394}, journal = {PROCEEDINGS 2015 IEEE 23RD ANNUAL SYMPOSIUM ON HIGH-PERFORMANCE INTERCONNECTS - HOTI 2015},
number = ,
volume = ,
place = {United States},
year = {2015},
month = {8}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: