Evaluation of PETSc on a Heterogeneous Architecture, the OLCF Summit System: Part II - Basic Communication Performance

Zhang, Junchao; Mills, Richard Tran; Smith, Barry F.

doi:10.2172/1721624

Title: Evaluation of PETSc on a Heterogeneous Architecture, the OLCF Summit System: Part II - Basic Communication Performance

Full Record
Other Related Research

Abstract

Nearest-neighbor communication is at the heart of many high-performance parallel computations. We report on the performance of such communication on the Oak Ridge Leadership Computing Facility system Summit in the context of the PETSc communication module. The analysis in this report includes basic Ping-Pong point-to-point communication and regular and irregular nearest-neighbor communication.

Authors:

Zhang, Junchao ^[1]; Mills, Richard Tran ^[1]; Smith, Barry F. ^[1]

Argonne National Lab. (ANL), Argonne, IL (United States)

Publication Date:: 2020-10-01

Research Org.:: Argonne National Lab. (ANL), Argonne, IL (United States)

Sponsoring Org.:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Exascale Computing Project

OSTI Identifier:: 1721624

Report Number(s):: ANL-20/76
160569

DOE Contract Number:: AC02-06CH11357

Resource Type:: Technical Report

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING; PETSc; GPU; MPI communication; CUDA-aware MPI

Citation Formats


                    Zhang, Junchao, Mills, Richard Tran, and Smith, Barry F. Evaluation of PETSc on a Heterogeneous Architecture, the OLCF Summit System: Part II - Basic Communication Performance.  United States: N. p., 2020. 
        Web.  doi:10.2172/1721624.

Copy to clipboard


                    Zhang, Junchao, Mills, Richard Tran, & Smith, Barry F. Evaluation of PETSc on a Heterogeneous Architecture, the OLCF Summit System: Part II - Basic Communication Performance.  United States.  https://doi.org/10.2172/1721624

Copy to clipboard


                    Zhang, Junchao, Mills, Richard Tran, and Smith, Barry F. 2020.  
        "Evaluation of PETSc on a Heterogeneous Architecture, the OLCF Summit System: Part II - Basic Communication Performance".  United States.  https://doi.org/10.2172/1721624.  https://www.osti.gov/servlets/purl/1721624.

Copy to clipboard


                    
@article{osti_1721624,

  title        = {Evaluation of PETSc on a Heterogeneous Architecture, the OLCF Summit System: Part II - Basic Communication Performance},

  author       = {Zhang, Junchao and Mills, Richard Tran and Smith, Barry F.},

  abstractNote = {Nearest-neighbor communication is at the heart of many high-performance parallel computations. We report on the performance of such communication on the Oak Ridge Leadership Computing Facility system Summit in the context of the PETSc communication module. The analysis in this report includes basic Ping-Pong point-to-point communication and regular and irregular nearest-neighbor communication.},

  doi          = {10.2172/1721624},

  url          = {https://www.osti.gov/biblio/1721624},
  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {2020},

  month        = {10}

}

Copy to clipboard

Technical Report:

View Technical Report

https://doi.org/10.2172/1721624

Save / Share:

Export Metadata

Save to My Library

Similar records in OSTI.GOV collections:

Evaluation of PETSc on a Heterogeneous Architecture, the OLCF Summit System: Part 1: Vector Node Performance

Technical Report Morgan, Hannah; Mills, Richard; Smith, Barry

Our goal is to report on the basic performance of PETSc vector operations on a single node of the Oak Ridge Leadership Facility System Summit. We describe the Summit system and present data collected from several vector operations. Limited analysis is also presented.
https://doi.org/10.2172/1614879

Full Text Available
Pseudonymization at Scale: OLCF’s Summit Usage Data Case Study

Conference Maheshwari, Ketan; Wilkinson, Sean; May, Alex; ...

The analysis of vast amounts of data and the processing of complex computational jobs have traditionally relied upon high performance computing (HPC) systems, which offer reliable and efficient management of large-scale computational and data resources. Understanding these analyses’ needs is paramount for designing solutions that can lead to better science, and similarly, understanding the characteristics of the user behavior on those systems is important for improving user experiences on HPC systems. A common approach to gathering data about user behavior is to extract workload characteristics from system log data available only to system administrators. Recently at Oak Ridge Leadership Computingmore »« less
https://doi.org/10.1109/BigData55660.2022.10020380

Full Text Available
Long Term Per-Component Power and Thermal Measurements of the OLCF Summit System

Dataset Shin, Woong; Ellis, J. Austin; Karimi, Ahmad Maroof; ...

As we move into the exascale era, the power and energy footprints of high-performance computing (HPC) systems have grown significantly larger. Due to the harsh power and thermal conditions the system, components are exposed to extreme operating conditions. Operation of such modern HPC systems requires deep insights into long term system behavior to maintain its efficiency as well as its longevity. To help the HPC community to gain such insights, we provide a dataset that records the long-term power and thermal behavior of the 200PF pre-exascale supercomputer at the Oak Ridge Leadership Computing Facility (OLCF), Summit. This system is anmore »« less
https://doi.org/10.13139/OLCF/1861393

View Dataset
Accelerating DCA++ (Dynamical Cluster Approximation) Scientific Application on the Summit supercomputer

Conference Balduzzi, Giovanni; Chatterjee, Ronnie; Li, Ying Wai; ...

Optimizing scientific applications on today’s accelerator-based high performance computing systems can be challenging, especially when multiple GPUs and CPUs with heterogeneous memories and persistent non-volatile memories are present. An example is Summit, an accelerator-based system at the Oak Ridge Leadership Computing Facility (OLCF) that is rated as the world’s fastest supercomputer to-date. New strategies are thus needed to expose the parallelism in legacy applications, while being amenable to efficient mapping to the underlying architecture.In this paper we discuss our experiences and strategies to port a scientific application, DCA++, to Summit. DCA++ is a highperformance research application that solves quantum manybodymore »« less
https://doi.org/10.1109/PACT.2019.00041

Full Text Available
Strategies to Deploy and Scale Deep Learning on the Summit Supercomputer

Conference Yin, Junqi; Gahlot, Shubhankar; Laanait, Nouamane; ...

The rapid growth and wide applicability of Deep Learning (DL) frameworks poses challenges to computing centers which need to deploy and support the software, and also to domain scientists who have to keep up with the system environment and scale up scientific exploration through DL. We offer recommendations for deploying and scaling DL frameworks on the Summit supercomputer, currently atop the Top500 list, at the Oak Ridge National Laboratory Leadership Computing Facility (OLCF). We discuss DL software deployment in the form of containers, and compare performance of native-built frameworks and containerized deployment. Software containers show no noticeable negative performance impactmore »« less
https://doi.org/10.1109/DLS49591.2019.00016

Similar Records