Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

OpenSHMEM-UCX: Evaluation of UCX for Implementing OpenSHMEM Programming Model, In: OpenSHMEM 2016: OpenSHMEM and Related Technologies. Enhancing OpenSHMEM for Hybrid Environments

Conference · · OPENSHMEM AND RELATED TECHNOLOGIES: ENHANCING OPENSHMEM FOR HYBRID ENVIRONMENTS
 [1];  [1];  [1];  [2]
  1. Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, TN (United States)
  2. ARM Research Cambridge, UK

The OpenSHMEM reference implementation was developed towards the goal of developing an open source and high-performing OpenSHMEM implementation. To achieve portability and performance across various networks, the OpenSHMEM reference implementation uses GASNet and UCCS for network operations. Recently, new network layers have emerged with the promise of providing high-performance, scalability, and portability for HPC applications. In this paper, we implement the OpenSHMEM reference implementation to use the UCX framework for network operations. Then, we evaluate its performance and scalability on Cray XK systems to understand UCX’s suitability for developing the OpenSHMEM programming model. Further, we develop a benchmark called SHOMS for evaluating the OpenSHMEM implementation. Our experimental results show that OpenSHMEM-UCX outperforms the vendor supplied OpenSHMEM implementation in most cases on the Cray XK system by up to 40% with respect to message rate and up to 70% for the execution of application kernels.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Organization:
USDOE Office of Science (SC)
OSTI ID:
1567413
Journal Information:
OPENSHMEM AND RELATED TECHNOLOGIES: ENHANCING OPENSHMEM FOR HYBRID ENVIRONMENTS, Journal Name: OPENSHMEM AND RELATED TECHNOLOGIES: ENHANCING OPENSHMEM FOR HYBRID ENVIRONMENTS Vol. 10007; ISSN 0302-9743
Country of Publication:
United States
Language:
English

References (5)

Designing a High Performance OpenSHMEM Implementation Using Universal Common Communication Substrate as a Communication Middleware book January 2014
Enhanced Support for OpenSHMEM Communication in Portals
  • Barrett, Brian W.; Brigthwell, Ron; Hemmert, K. Scott
  • 2011 IEEE 19th Annual Symposium on High-Performance Interconnects (HOTI), 2011 IEEE 19th Annual Symposium on High Performance Interconnects https://doi.org/10.1109/HOTI.2011.18
conference August 2011
Parallelizing the Smith-Waterman Algorithm Using OpenSHMEM and MPI-3 One-Sided Interfaces
  • Baker, Matthew; Welch, Aaron; Gorentla Venkata, Manjunath
  • OpenSHMEM and Related Technologies. Experiences, Implementations, and Technologies: Second Workshop, OpenSHMEM 2015, Annapolis, MD, USA, August 4-6, 2015. Revised Selected Papers https://doi.org/10.1007/978-3-319-26428-8_12
book January 2015
UCX: An Open Source Framework for HPC Network APIs and Beyond conference August 2015
Implementing OpenSHMEM Using MPI-3 One-Sided Communication book January 2014