Hardware Evaluation Analytical Modeling and Node Simulation: Benefits of Tighter GPU Integration

Austin, Brian; Bair, Ray; Barker, Kevin; Cabrera, Anthony; Chien, Andrew; Ding, Nan; Firoz, Jesun; Ibrahim, Khaled; Manzano, Joseph; Morozov, Vitali; Nguyen, Tan; Oliker, Leonid; Suetterlein, Joshua; Tang, Li; Vetter, Jeffrey; Williams, Samuel; Yoshii, Kazutomo; Young, Aaron

doi:10.2172/1841724

Title: Hardware Evaluation Analytical Modeling and Node Simulation: Benefits of Tighter GPU Integration

Full Record
Other Related Research

Abstract

In this report, we examine several emerging technologies of interest to the Department of Energy and its computational centers. These include: 1) quantifying the benefit of tighter CPU-GPU integration, 2) quantifying the appropriate CPU core:GPU ratio, 3) quantifying the penalty for CPU-GPU disaggregation, 4) quantifying the benefits of tighter GPU-GPU integration, 5) quantifying the benefits of unified memory, and 6) quantifying the benefits of tighter FPGA-GPU integration.

Authors:

Austin, Brian ^[1]; Bair, Ray ^[2]; Barker, Kevin ^[3]; Cabrera, Anthony ^[4]; Chien, Andrew ^[5]; Ding, Nan ^[1]; Firoz, Jesun ^[3]; Ibrahim, Khaled ^[1]; Manzano, Joseph ^[3]; Morozov, Vitali ^[2]; Nguyen, Tan ^[1]; Oliker, Leonid ^[1]; Suetterlein, Joshua ^[3]; Tang, Li ^[6]; Vetter, Jeffrey ^[4]; Williams, Samuel ^[1]; Yoshii, Kazutomo ^[2]; Young, Aaron ^[4]

Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Argonne National Lab. (ANL), Argonne, IL (United States)
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Argonne National Lab. (ANL), Argonne, IL (United States); Univ. of Chicago, IL (United States)
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Publication Date:: 2021-09-30

Research Org.:: Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

Sponsoring Org.:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)

OSTI Identifier:: 1841724

Report Number(s):: ECP-HIHE01-35
ark:/13030/qt8h57b16g

DOE Contract Number:: AC02-05CH11231; AC05-00OR22725; AC02-06CH11357

Resource Type:: Technical Report

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING

Citation Formats


                    Austin, Brian, Bair, Ray, Barker, Kevin, Cabrera, Anthony, Chien, Andrew, Ding, Nan, Firoz, Jesun, Ibrahim, Khaled, Manzano, Joseph, Morozov, Vitali, Nguyen, Tan, Oliker, Leonid, Suetterlein, Joshua, Tang, Li, Vetter, Jeffrey, Williams, Samuel, Yoshii, Kazutomo, and Young, Aaron. Hardware Evaluation Analytical Modeling and Node Simulation: Benefits of Tighter GPU Integration.  United States: N. p., 2021. 
        Web.  doi:10.2172/1841724.

Copy to clipboard


                    Austin, Brian, Bair, Ray, Barker, Kevin, Cabrera, Anthony, Chien, Andrew, Ding, Nan, Firoz, Jesun, Ibrahim, Khaled, Manzano, Joseph, Morozov, Vitali, Nguyen, Tan, Oliker, Leonid, Suetterlein, Joshua, Tang, Li, Vetter, Jeffrey, Williams, Samuel, Yoshii, Kazutomo, & Young, Aaron. Hardware Evaluation Analytical Modeling and Node Simulation: Benefits of Tighter GPU Integration.  United States.  https://doi.org/10.2172/1841724

Copy to clipboard


                    Austin, Brian, Bair, Ray, Barker, Kevin, Cabrera, Anthony, Chien, Andrew, Ding, Nan, Firoz, Jesun, Ibrahim, Khaled, Manzano, Joseph, Morozov, Vitali, Nguyen, Tan, Oliker, Leonid, Suetterlein, Joshua, Tang, Li, Vetter, Jeffrey, Williams, Samuel, Yoshii, Kazutomo, and Young, Aaron. 2021.  
        "Hardware Evaluation Analytical Modeling and Node Simulation: Benefits of Tighter GPU Integration".  United States.  https://doi.org/10.2172/1841724.  https://www.osti.gov/servlets/purl/1841724.

Copy to clipboard


                    
@article{osti_1841724,

  title        = {Hardware Evaluation Analytical Modeling and Node Simulation: Benefits of Tighter GPU Integration},

  author       = {Austin, Brian and Bair, Ray and Barker, Kevin and Cabrera, Anthony and Chien, Andrew and Ding, Nan and Firoz, Jesun and Ibrahim, Khaled and Manzano, Joseph and Morozov, Vitali and Nguyen, Tan and Oliker, Leonid and Suetterlein, Joshua and Tang, Li and Vetter, Jeffrey and Williams, Samuel and Yoshii, Kazutomo and Young, Aaron},

  abstractNote = {In this report, we examine several emerging technologies of interest to the Department of Energy and its computational centers. These include: 1) quantifying the benefit of tighter CPU-GPU integration, 2) quantifying the appropriate CPU core:GPU ratio, 3) quantifying the penalty for CPU-GPU disaggregation, 4) quantifying the benefits of tighter GPU-GPU integration, 5) quantifying the benefits of unified memory, and 6) quantifying the benefits of tighter FPGA-GPU integration.},

  doi          = {10.2172/1841724},

  url          = {https://www.osti.gov/biblio/1841724},
  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {2021},

  month        = {9}

}

Copy to clipboard

Technical Report:

View Technical Report

https://doi.org/10.2172/1841724

Save / Share:

Export Metadata

Save to My Library

Similar records in OSTI.GOV collections:

Population Count on Intel® CPU, GPU, and FPGA

Conference Jin, Zheming; Finkel, Hal

Population count is a primitive used in many applications. Commodity processors have dedicated instructions for achieving high-performance population count. Motivated by the productivity of high-level synthesis and the importance of population count, in this paper we investigated the OpenCL implementations of population count algorithms, and evaluated their performance and resource utilizations on an FPGA. Based on the results, we select the most efficient implementation. Then we derived a reduction pattern from a representative application of population count. We parallelized the reduction with atomic functions, and optimized it with vectorized memory accesses, tree reduction, and compute-unit duplication. We evaluated the performancemore »« less
https://doi.org/10.1109/IPDPSW50202.2020.00081
Parallelization and checkpointing of GPU applications through program transformation

Thesis/Dissertation Solano-Quinde, Lizandro

GPUs have emerged as a powerful tool for accelerating general-purpose applications. The availability of programming languages that makes writing general-purpose applications for running on GPUs tractable have consolidated GPUs as an alternative for accelerating general purpose applications. Among the areas that have benefited from GPU acceleration are: signal and image processing, computational fluid dynamics, quantum chemistry, and, in general, the High Performance Computing (HPC) Industry. In order to continue to exploit higher levels of parallelism with GPUs, multi-GPU systems are gaining popularity. In this context, single-GPU applications are parallelized for running in multi-GPU systems. Furthermore, multi-GPU systems help to solvemore »« less
https://doi.org/10.2172/1082971

Full Text Available
Computational Benefit of GPU Optimization for the Atmospheric Chemistry Modeling

Journal Article Sun, Jian; Fu, Joshua; Drake, John; ... - Journal of Advances in Modeling Earth Systems

Global chemistry–climate models are computationally burdened as the chemical mechanisms become more complex and realistic. Optimization for graphics processing units (GPU) may make longer global simulation with regional detail possible, but limited study has been done to explore the potential benefit for the atmospheric chemistry modeling. Hence, in this study, the second–order Rosenbrock solver of the chemistry module of CAM4–Chem is ported to the GPU to gauge potential speed–up. We find that on the CPU, the fastest performance is achieved using the Intel compiler with a block interleaved memory layout. Different combinations of compiler and memory layout lead to ~11.02×more »« less
Cited by 3
https://doi.org/10.1029/2018MS001276
Indicator-directed Dynamic Power Management for Iterative Workloads on GPU-Accelerated Systems

Conference Zou, Pengfei; Li, Ang; Barker, Kevin; ...

Modern high-performance and warehouse computing centers show strong interest in minimizing system power consumption while satisfying customers’ quality of service (QoS). Dynamic voltage and frequency scaling (DVFS) is effective for achieving this goal. Nevertheless, automating the process online and making it transparent to users must address three major challenges: (1) Complexity — today’s hardware components (e.g., CPUs, GPUs, memory, network, etc.) can be configured in several or dozens of frequency/voltage states for satisfying divergent system demands. Given their combination and the emergence of heterogeneity, searching the optimal configuration in the design space online can be timing consuming. (2) QoS guaranteemore »« less
https://doi.org/10.1109/CCGrid49817.2020.00-37
Redesigning combustion modelingnext term algorithms for the Graphics Processing Unit (GPU): Chemical kinetic rate evaluation and ordinary differential equation integration

Journal Article Shi, Y.; Green, W.; Wong, H.; ...

Detailed modeling of complex combustion kinetics remains challenging and often intractable, due to prohibitive computational costs incurred when solving the associated large kinetic mechanisms. The Graphics Processing Unit (GPU), originally designed for graphics rendering on computer and gaming systems, has recently emerged as a powerful, cost-effective supplement to the Central Processing Unit (CPU) for dramatically accelerating scientific computations. Complex scientific computations are now being performed on the GPU in several research fields, such as quantum chemistry, molecular dynamics, and atmospheric modeling. Here, we present methods for exploiting the highly parallel structure of GPUs for combustion modeling. This paper outlines simplemore »« less
https://doi.org/10.1016/j.combustflame.2011.01.024

Similar Records