skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Balancing Performance and Portability with Containers in HPC: An OpenSHMEM Example

Abstract

There is a growing interest in using Linux containers to streamline software development and application deployment. A container enables the user to bundle the salient elements of the software stack from an application’s perspective. In this paper, we discuss initial experiences in using the Open MPI implementation of OpenSHMEM with containers on HPC resources. We provide a brief overview of two container runtimes, Docker & Singularity, highlighting elements that are of interest for HPC users. The Docker platform offers a rich set of services that are widely used in enterprise environments, whereas Singularity is an emerging container runtime that is specifically written for use on HPC systems. We describe our procedure for container assembly and deployment that strives to maintain the portability of the container-based application. We show performance results for the Graph500 benchmark running along the typical continuum of development testbed up to full production supercomputer (ORNL’s Titan). The results show consistent performance between the native and Singularity (container) tests. The results also showed an unexplained drop in performance when using the Cray Gemini network with Open MPI’s OpenSHMEM, which was unrelated to the container usage.

Authors:
ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]
  1. ORNL
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1468263
DOE Contract Number:  
AC05-00OR22725
Resource Type:
Conference
Resource Relation:
Journal Volume: 10679; Conference: OpenSHMEM 2017: Fourth workshop on OpenSHMEM and Related Technologies - Annapolis, Maryland, United States of America - 8/7/2017 8:00:00 AM-8/9/2017 8:00:00 AM
Country of Publication:
United States
Language:
English

Citation Formats

Naughton III, Thomas J., Sorrillo, Lawrence, Simpson, Adam B., and Imam, Neena. Balancing Performance and Portability with Containers in HPC: An OpenSHMEM Example. United States: N. p., 2019. Web. doi:10.1007/978-3-319-73814-7_9.
Naughton III, Thomas J., Sorrillo, Lawrence, Simpson, Adam B., & Imam, Neena. Balancing Performance and Portability with Containers in HPC: An OpenSHMEM Example. United States. doi:10.1007/978-3-319-73814-7_9.
Naughton III, Thomas J., Sorrillo, Lawrence, Simpson, Adam B., and Imam, Neena. Tue . "Balancing Performance and Portability with Containers in HPC: An OpenSHMEM Example". United States. doi:10.1007/978-3-319-73814-7_9. https://www.osti.gov/servlets/purl/1468263.
@article{osti_1468263,
title = {Balancing Performance and Portability with Containers in HPC: An OpenSHMEM Example},
author = {Naughton III, Thomas J. and Sorrillo, Lawrence and Simpson, Adam B. and Imam, Neena},
abstractNote = {There is a growing interest in using Linux containers to streamline software development and application deployment. A container enables the user to bundle the salient elements of the software stack from an application’s perspective. In this paper, we discuss initial experiences in using the Open MPI implementation of OpenSHMEM with containers on HPC resources. We provide a brief overview of two container runtimes, Docker & Singularity, highlighting elements that are of interest for HPC users. The Docker platform offers a rich set of services that are widely used in enterprise environments, whereas Singularity is an emerging container runtime that is specifically written for use on HPC systems. We describe our procedure for container assembly and deployment that strives to maintain the portability of the container-based application. We show performance results for the Graph500 benchmark running along the typical continuum of development testbed up to full production supercomputer (ORNL’s Titan). The results show consistent performance between the native and Singularity (container) tests. The results also showed an unexplained drop in performance when using the Cray Gemini network with Open MPI’s OpenSHMEM, which was unrelated to the container usage.},
doi = {10.1007/978-3-319-73814-7_9},
journal = {},
number = ,
volume = 10679,
place = {United States},
year = {Tue Jan 01 00:00:00 EST 2019},
month = {Tue Jan 01 00:00:00 EST 2019}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: