DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Enabling Multireference Calculations on Multimetallic Systems with Graphic Processing Units

Journal Article · · Journal of Chemical Theory and Computation

Modeling multimetallic systems efficiently enables faster prediction of desirable chemical properties and the design of new materials. This work describes an initial implementation for performing multireference wave function method localized active-space self-consistent field (LASSCF) calculations through the use of multiple graphics processing units (GPUs) to accelerate time-to-solution. Density fitting is leveraged to reduce memory requirements, and we demonstrate the ability to fully utilize multi-GPU compute nodes. Performance improvements of 5–10x in total application runtime were observed in LASSCF calculations for multimetallic catalyst systems up to 1200 AOs and an active space of (22e,40o) using up to four NVIDIA A100 GPUs. Furthermore, written with performance portability in mind, a comparable performance is also observed in early runs on the Aurora exascale system using Intel Max Series GPUs.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), Basic Energy Sciences (BES). Chemical Sciences, Geosciences & Biosciences Division (CSGB); USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF)
Grant/Contract Number:
AC02-06CH11357; SC0023382
OSTI ID:
2587376
Journal Information:
Journal of Chemical Theory and Computation, Journal Name: Journal of Chemical Theory and Computation Journal Issue: 15 Vol. 21; ISSN 1549-9626; ISSN 1549-9618
Publisher:
American Chemical Society (ACS)Copyright Statement
Country of Publication:
United States
Language:
English

References (86)

On the Use of the Cluster Expansion and the Technique of Diagrams in Calculations of Correlation Effects in Atoms and Molecules book January 2007
Principles for a direct SCF approach to LICAO - MO ab - initio calculations : Direct journal September 1982
Recent advances in multireference second order perturbation CI: The CIPSI method revisited journal January 1987
Correlation problems in atomic and molecular systems III. Rederivation of the coupled-pair many-electron theory using the traditional quantum chemical methodst journal July 1971
TeraChem : A graphical processing unit ‐accelerated electronic structure package for large‐scale ab initio molecular dynamics journal July 2020
Accelerating GPU Kernels for Dense Linear Algebra book January 2011
A complete active space SCF method (CASSCF) using a density matrix formulated super-CI approach journal May 1980
Specific CI calculation of energy differences: Transition energies and bond energies journal May 1993
Efficient, approximate and parallel Hartree–Fock and hybrid DFT calculations. A ‘chain-of-spheres’ algorithm for the Hartree–Fock exchange journal February 2009
The analysis of a plane wave pseudopotential density functional theory code on a GPU machine journal January 2013
PyBEST: Improved functionality and enhanced performance journal April 2024
Kokkos: Enabling manycore performance portability through polymorphic memory access patterns journal December 2014
Well-Defined, Silica-Supported Homobimetallic Nickel Hydride Hydrogenation Catalyst journal April 2021
Ab Initio Study of the Adsorption of Small Molecules on Metal–Organic Frameworks with Oxo-centered Trimetallic Building Units: The Role of the Undercoordinated Metal Ion journal August 2015
Variational Localized Active Space Self-Consistent Field Method journal June 2020
Localized Active Space-State Interaction: a Multireference Method for Chemical Insight journal October 2022
Accelerating Pythonic Coupled-Cluster Implementations: A Comparison Between CPUs and GPUs journal February 2024
Distributed Implementation of Full Configuration Interaction for One Trillion Determinants journal February 2024
Distributed Multi-GPU Ab Initio Density Matrix Renormalization Group Algorithm with Applications to the P-Cluster of Nitrogenase journal January 2024
High-Performance Multi-GPU Analytic RI-MP2 Energy Gradients journal March 2024
Automatic State Interaction with Large Localized Active Spaces for Multimetallic Systems journal May 2024
An Efficient RI-MP2 Algorithm for Distributed Many-GPU Architectures journal October 2024
Parallel Implementation of the Density Matrix Renormalization Group Method Achieving a Quarter petaFLOPS Performance on a Single DGX-H100 GPU Node journal September 2024
Reducing Numerical Precision Requirements in Quantum Chemistry Calculations journal December 2024
Acceleration of the Relativistic Dirac–Kohn–Sham Method with GPU: A Pre-Exascale Implementation of BERTHA and PyBERTHA journal March 2025
Systematic Expansion of Active Spaces beyond the CASSCF Limit: A GASSCF/SplitGAS Benchmark Study journal June 2015
Localized Active Space State Interaction Singles journal June 2025
Orbital Optimization of Large Active Spaces via AI-Accelerators journal June 2025
Heat-Bath Configuration Interaction: An Efficient Selected Configuration Interaction Algorithm Inspired by Heat-Bath Sampling journal August 2016
Employing OpenCL to Accelerate Ab Initio Calculations on Graphics Processing Units journal May 2017
Double Precision Is Not Needed for Many-Body Calculations: Emergent Conventional Wisdom journal June 2018
Multiconfigurational Self-Consistent Field Theory with Density Matrix Embedding: The Localized Active Space Self-Consistent Field Method journal November 2018
Heterogeneous CPU + GPU Algorithm for Variational Two-Electron Reduced-Density Matrix-Driven Complete Active-Space Self-Consistent Field Theory journal September 2019
Highly Efficient, Linear-Scaling Seminumerical Exact-Exchange Method for Graphic Processing Units journal February 2020
Introducing GPU Acceleration into the Python-Based Simulations of Chemistry Framework journal January 2025
Exploring the Computational Aspects of Propylene Oligomerization Catalysis Using M′2M Type Trimetallic MOF Nodes journal September 2024
Quantum Chemical Characterization of Structural Single Fe(II) Sites in MIL-Type Metal–Organic Frameworks for the Oxidation of Methane to Methanol and Ethane to Ethanol journal January 2019
Coupled Cluster Theory on Graphics Processing Units I. The Coupled Cluster Doubles Method journal April 2011
GPU-Based Implementations of the Noniterative Regularized-CCSD(T) Corrections: Applications to Strongly Correlated Systems journal April 2011
Determining the Numerical Stability of Quantum Chemistry Algorithms journal July 2011
New Multithreaded Hybrid CPU/GPU Approach to Hartree–Fock journal September 2012
Real-Space Density Functional Theory on Graphical Processing Units: Computational Approach and Comparison to Gaussian Basis Set Methods journal September 2013
Quantum Chemistry on Graphical Processing Units. 1. Strategies for Two-Electron Integral Evaluation journal January 2008
Accelerating Density Functional Calculations with Graphics Processing Unit journal July 2008
Accelerating Correlated Quantum Chemistry Calculations Using Graphical Processing Units and a Mixed Precision Matrix Multiplication Library journal December 2009
The restricted active space self-consistent-field method, implemented with a split graph unitary group approach journal July 1990
Magnetic Coupling in a Tris-hydroxo-Bridged Chromium Dimer Occurs through Ligand Mediated Superexchange in Conjunction with Through-Space Coupling journal September 2020
Structure and Site Evolution of Framework Ni Species in MIL-127 MOFs for Propylene Oligomerization Catalysis journal February 2023
Accelerating Resolution-of-the-Identity Second-Order Møller−Plesset Quantum Chemistry Calculations with Graphical Processing Units journal March 2008
Entangled quantum electronic wavefunctions of the Mn4CaO5 cluster in photosystem II journal June 2013
Quantum simulations of materials on near-term quantum computers journal July 2020
Separated-pair approximation and separated-pair pair-density functional theory journal January 2016
Reduced scaling in electronic structure calculations using Cholesky decompositions journal June 2003
A spectroscopy oriented configuration interaction procedure journal November 2003
Iterative perturbation calculations of ground and excited state energies from multiconfigurational zeroth‐order wavefunctions journal June 1973
On the Correlation Problem in Atomic and Molecular Systems. Calculation of Wavefunction Components in Ursell‐Type Expansion Using Quantum‐Field Theoretical Methods journal December 1966
The generalized active space concept in multiconfigurational self-consistent field methods journal July 2011
A quadratically convergent multiconfiguration–self‐consistent field method with simultaneous optimization of orbitals and CI coefficients journal September 1980
A second order multiconfiguration SCF procedure with optimum convergence journal June 1985
Determinant based configuration interaction algorithms for complete and restricted configuration interaction spaces journal August 1988
Gaussian basis sets for use in correlated molecular calculations. I. The atoms boron through neon and hydrogen journal January 1989
An atomic orbital-based formulation of the complete active space self-consistent field method on graphical processing units journal June 2015
Analytic first derivatives of floating occupation molecular orbital-complete active space configuration interaction on graphical processing units journal July 2015
An atomic orbital-based formulation of analytical gradients and nonadiabatic coupling vector elements for the state-averaged complete active space self-consistent field method on graphical processing units journal October 2015
A deterministic alternative to the full configuration interaction quantum Monte Carlo method journal July 2016
Massively parallel GPU-accelerated minimization of classical density functional theory journal August 2017
GronOR: Massively parallel and GPU-accelerated non-orthogonal configuration interaction for large molecular systems journal February 2020
Recent developments in the P y SCF program package journal July 2020
Sparse tensor based nuclear gradients for periodic Hartree–Fock and low-scaling correlated wave function methods in the CP2K software package: A massively parallel and GPU accelerated implementation journal April 2023
Distributed memory, GPU accelerated Fock construction for hybrid, Gaussian basis density functional theory journal June 2023
Toward an extreme-scale electronic structure system journal July 2023
A hybrid CPU/GPU method for Hartree–Fock self-consistent-field calculation journal September 2023
LibERI—A portable and performant multi-GPU accelerated library for electron repulsion integrals via OpenMP offloading and standard language parallelism journal August 2024
Self-Consistent Equations Including Exchange and Correlation Effects journal November 1965
Note on an Approximation Treatment for Many-Electron Systems journal October 1934
Density Matrix Embedding: A Simple Alternative to Dynamical Mean-Field Theory journal November 2012
Density matrix formulation for quantum renormalization groups journal November 1992
Coupled-cluster theory in quantum chemistry journal February 2007
Cluster-based mean-field and perturbative description of strongly correlated fermion systems: Application to the one- and two-dimensional Hubbard model journal August 2015
Distributed-memory multi-GPU block-sparse tensor contraction for electronic structure conference May 2021
The Kokkos EcoSystem: Comprehensive Performance Portability For High Performance Computing journal January 2021
phiGEMM: A CPU-GPU Library for Porting Quantum ESPRESSO on Hybrid Systems conference February 2012
Scaling the Hartree-Fock Matrix Build on Summit conference November 2020
Kokkos 3: Programming Model Extensions for the Exascale Era journal January 2021
Enhancing GPU-acceleration in the Python-based Simulations of Chemistry Framework preprint January 2024
GPU-accelerated Auxiliary-field quantum Monte Carlo with multi-Slater determinant trial states preprint January 2024