Domain-specific virtual processors as a portable programming and execution model for parallel computational workloads on modern heterogeneous high-performance computing architectures

Lyakh, Dmitry I.

doi:10.1002/qua.25926

Domain-specific virtual processors as a portable programming and execution model for parallel computational workloads on modern heterogeneous high-performance computing architectures

Journal Article · Tue Mar 12 00:00:00 EDT 2019 · International Journal of Quantum Chemistry

DOI:https://doi.org/10.1002/qua.25926· OSTI ID:1509576

^[1]

Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

We advocate domain-specific virtual processors (DSVP) as a portability layer for expressing and executing domain-specific computational workloads on modern heterogeneous HPC architectures, with applications in quantum chemistry. Specifically, in this article we extend, generalize and better formalize the concept of a domain-specific virtual processor as applied to scientific high-performance computing. In particular, we introduce a system-wide recursive (hierarchical) hardware encapsulation mechanism into the DSVP architecture and specify a concrete microarchitectural design of an abstract DSVP from which specialized DSVP implementations can be derived for specific scientific domains. Furthermore, we demonstrate, an example of a domain-specific virtual processor specialized to numerical tensor algebra workloads, which is implemented in the ExaTENSOR library developed by the author with a primary focus on the quantum many-body computational workloads on large-scale GPU-accelerated HPC platforms.

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)

Grant/Contract Number:: AC05-00OR22725

OSTI ID:: 1509576

Journal Information:: International Journal of Quantum Chemistry, Journal Name: International Journal of Quantum Chemistry Journal Issue: 12 Vol. 119; ISSN 0020-7608

Publisher:: WileyCopyright Statement

Country of Publication:: United States

Language:: English

References (13)

General atomic and molecular electronic structure system Schmidt, Michael W.; Baldridge, Kim K.; Boatz, Jerry A. Journal of Computational Chemistry, Vol. 14, Issue 11, p. 1347-1363 https://doi.org/10.1002/jcc.540141112	journal	November 1993
Exploiting GPUs with the Super Instruction Architecture Jindal, Nakul; Lotrich, Victor; Deumens, Erik International Journal of Parallel Programming, Vol. 44, Issue 2 https://doi.org/10.1007/s10766-014-0319-4	journal	August 2014
Automatic Task-Based Code Generation for High Performance Domain Specific Embedded Language Tran Tan, Antoine; Falcou, Joel; Etiemble, Daniel International Journal of Parallel Programming, Vol. 44, Issue 3 https://doi.org/10.1007/s10766-015-0354-9	journal	March 2015
Heterogeneous parallel and distributed computing Sunderam, V. S.; Geist, G. A. Parallel Computing, Vol. 25, Issue 13-14 https://doi.org/10.1016/S0167-8191(99)00088-5	journal	December 1999
NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations Valiev, M.; Bylaska, E. J.; Govind, N. Computer Physics Communications, Vol. 181, Issue 9, p. 1477-1489 https://doi.org/10.1016/j.cpc.2010.04.018	journal	September 2010
A massively parallel tensor contraction framework for coupled-cluster computations Solomonik, Edgar; Matthews, Devin; Hammond, Jeff R. Journal of Parallel and Distributed Computing, Vol. 74, Issue 12 https://doi.org/10.1016/j.jpdc.2014.06.002	journal	December 2014
Many – Body Methods in Chemistry and Physics Shavitt, Isaiah; Bartlett, Rodney J. https://doi.org/10.1017/CBO9780511596834	book	January 2009
Parallel implementation of electronic structure energy, gradient, and Hessian calculations Lotrich, V.; Flocke, N.; Ponton, M. The Journal of Chemical Physics, Vol. 128, Issue 19 https://doi.org/10.1063/1.2920482	journal	May 2008
Super instruction architecture of petascale electronic structure software: the story Lotrich, V. F.; Ponton, J. M.; Perera, A. S. Molecular Physics, Vol. 108, Issue 21-23 https://doi.org/10.1080/00268976.2010.512566	journal	November 2010
The ELPA library: scalable parallel eigenvalue solutions for electronic structure theory and computational science Marek, A.; Blum, V.; Johanni, R. Journal of Physics: Condensed Matter, Vol. 26, Issue 21 https://doi.org/10.1088/0953-8984/26/21/213201	journal	May 2014
Numerical linear algebra on emerging architectures: The PLASMA and MAGMA projects Agullo, Emmanuel; Demmel, Jim; Dongarra, Jack Journal of Physics: Conference Series, Vol. 180 https://doi.org/10.1088/1742-6596/180/1/012037	journal	July 2009
The Open Community Runtime: A runtime system for extreme scale computing Mattson, Timothy G.; Cledat, Romain; Cave, Vincent 2016 IEEE High Performance Extreme Computing Conference (HPEC) https://doi.org/10.1109/HPEC.2016.7761580	conference	September 2016
Replicated Computational Results Certified BLIS: A Framework for Rapidly Instantiating BLAS Functionality Zee, Field G. VAN; Geijn, Robert A. VAN DE ACM Transactions on Mathematical Software, Vol. 41, Issue 3 https://doi.org/10.1145/2764454	journal	June 2015

Cited By (1)

Establishing the Quantum Supremacy Frontier with a 281 Pflop/s Simulation Villalonga, Benjamin; Lyakh, Dmitry; Boixo, Sergio arXiv https://doi.org/10.48550/arxiv.1905.00444	text	January 2019

Similar Records

ExaTENSOR

Software · Wed Mar 20 20:00:00 EDT 2019 · OSTI ID:code-45756

Performance Analysis of Scientific Computing Workloads on Trusted Execution Environments

Technical Report · Sun Oct 25 00:00:00 EDT 2020 · OSTI ID:1768054

Uniprocessor Performance Analysis of a Representative Workload of Sandia National Laboratories' Scientific Applications.

Technical Report · Sat Oct 01 00:00:00 EDT 2005 · OSTI ID:1143329

Related Subjects

97 MATHEMATICS AND COMPUTING
heterogeneous node architecture
high‐performance computing
numerical tensor algebra
scientific computing
virtual machine

Domain-specific virtual processors as a portable programming and execution model for parallel computational workloads on modern heterogeneous high-performance computing architectures

Citation Formats

References (13)

Cited By (1)

Similar Records

Related Subjects