Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction
Abstract
In this study, we have extended our graphical processing unit (GPU)-accelerated direct configuration interaction program to multiple devices, reducing iteration times for configuration spaces of 165 million determinants to only 3 s using NVIDIA P100 GPUs. Similar improvements in the one- and two-particle reduced density matrix formation allow for fast analytical energy gradients and electronic properties. Our parallel algorithm enables the calculation of arbitrarily large configuration spaces (limited only by available system memory), with iteration times of 13 min for an active space of 18 electrons in 18 orbitals (2.4 billion determinants) using six consumer grade NVIDIA 1080Ti GPUs. These advances enable routine molecular dynamics simulations, geometry optimizations, and absorption spectrum calculations for molecules with large configuration spaces, a task that has heretofore required massive computational effort. In this work, we demonstrate the utility of our program by generating the absorption spectrum for diphenyl acetylene at the floating occupation molecular orbital complete active space configuration interaction level of theory. Lastly, several active spaces were investigated to assess the dependence of spectral features on orbital space dimension.
- Authors:
-
- Stanford Univ., CA (United States); SLAC National Accelerator Lab., Menlo Park, CA (United States)
- Publication Date:
- Research Org.:
- SLAC National Accelerator Lab., Menlo Park, CA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR). Scientific Discovery through Advanced Computing (SciDAC); Extreme Science and Engineering Discovery Environment; National Science Foundation (NSF)
- OSTI Identifier:
- 1617039
- Grant/Contract Number:
- AC02-76SF00515; TG-CHE140101; ACI-1429830
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Chemical Theory and Computation
- Additional Journal Information:
- Journal Volume: 16; Journal Issue: 3; Journal ID: ISSN 1549-9618
- Publisher:
- American Chemical Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY
Citation Formats
Fales, B. Scott, and Martínez, Todd J. Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction. United States: N. p., 2020.
Web. doi:10.1021/acs.jctc.9b01165.
Fales, B. Scott, & Martínez, Todd J. Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction. United States. https://doi.org/10.1021/acs.jctc.9b01165
Fales, B. Scott, and Martínez, Todd J. Wed .
"Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction". United States. https://doi.org/10.1021/acs.jctc.9b01165. https://www.osti.gov/servlets/purl/1617039.
@article{osti_1617039,
title = {Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction},
author = {Fales, B. Scott and Martínez, Todd J.},
abstractNote = {In this study, we have extended our graphical processing unit (GPU)-accelerated direct configuration interaction program to multiple devices, reducing iteration times for configuration spaces of 165 million determinants to only 3 s using NVIDIA P100 GPUs. Similar improvements in the one- and two-particle reduced density matrix formation allow for fast analytical energy gradients and electronic properties. Our parallel algorithm enables the calculation of arbitrarily large configuration spaces (limited only by available system memory), with iteration times of 13 min for an active space of 18 electrons in 18 orbitals (2.4 billion determinants) using six consumer grade NVIDIA 1080Ti GPUs. These advances enable routine molecular dynamics simulations, geometry optimizations, and absorption spectrum calculations for molecules with large configuration spaces, a task that has heretofore required massive computational effort. In this work, we demonstrate the utility of our program by generating the absorption spectrum for diphenyl acetylene at the floating occupation molecular orbital complete active space configuration interaction level of theory. Lastly, several active spaces were investigated to assess the dependence of spectral features on orbital space dimension.},
doi = {10.1021/acs.jctc.9b01165},
journal = {Journal of Chemical Theory and Computation},
number = 3,
volume = 16,
place = {United States},
year = {Wed Jan 29 00:00:00 EST 2020},
month = {Wed Jan 29 00:00:00 EST 2020}
}
Web of Science
Works referenced in this record:
Generalized valence bond description of bonding in low-lying states of molecules
journal, November 1973
- Goddard, William A.; Dunning, Thom H.; Hunt, William J.
- Accounts of Chemical Research, Vol. 6, Issue 11
The half-projected Hartree-Fock method: I. Eigenvalue formulation and simple applications
journal, December 1976
- Cox, P. Anthony; Wood, Melvyn H.
- Theoretica Chimica Acta, Vol. 41, Issue 4
A complete active space SCF method (CASSCF) using a density matrix formulated super-CI approach
journal, May 1980
- Roos, Björn O.; Taylor, Peter R.; Sigbahn, Per E. M.
- Chemical Physics, Vol. 48, Issue 2
Are atoms intrinsic to molecular electronic wavefunctions? I. The FORS model
journal, September 1982
- Ruedenberg, Klaus; Schmidt, Michael W.; Gilbert, Mary M.
- Chemical Physics, Vol. 71, Issue 1
Molecular gradients for semiempirical CI wavefunctions with floating occupation molecular orbitals
journal, July 2000
- Granucci, Giovanni; Toniolo, Alessandro
- Chemical Physics Letters, Vol. 325, Issue 1-3
Ab initio floating occupation molecular orbital-complete active space configuration interaction: An efficient approximation to CASSCF
journal, June 2010
- Slavíček, Petr; Martínez, Todd J.
- The Journal of Chemical Physics, Vol. 132, Issue 23
Configuration interaction singles natural orbitals: An orbital basis for an efficient and size intensive multireference description of electronic excited states
journal, January 2015
- Shu, Yinan; Hohenstein, Edward G.; Levine, Benjamin G.
- The Journal of Chemical Physics, Vol. 142, Issue 2
High-Multiplicity Natural Orbitals in Multireference Configuration Interaction for Excited State Potential Energy Surfaces
journal, May 2013
- Lu, Zhen; Matsika, Spiridoula
- The Journal of Physical Chemistry A, Vol. 117, Issue 32
The unrestricted natural orbital–complete active space (UNO–CAS) method: An inexpensive alternative to the complete active space–self‐consistent‐field (CAS–SCF) method
journal, April 1989
- Bofill, Josep M.; Pulay, Peter
- The Journal of Chemical Physics, Vol. 90, Issue 7
Determinant based configuration interaction algorithms for complete and restricted configuration interaction spaces
journal, August 1988
- Olsen, Jeppe; Roos, Björn O.; Jo/rgensen, Poul
- The Journal of Chemical Physics, Vol. 89, Issue 4
The restricted active space self-consistent-field method, implemented with a split graph unitary group approach
journal, July 1990
- Malmqvist, Per Aake.; Rendell, Alistair.; Roos, Bjoern O.
- The Journal of Physical Chemistry, Vol. 94, Issue 14
The generalized active space concept in multiconfigurational self-consistent field methods
journal, July 2011
- Ma, Dongxia; Li Manni, Giovanni; Gagliardi, Laura
- The Journal of Chemical Physics, Vol. 135, Issue 4
Direct configuration interaction and multiconfigurational self-consistent-field method for multiple active spaces with variable occupations. I. Method
journal, November 2003
- Ivanic, Joseph
- The Journal of Chemical Physics, Vol. 119, Issue 18
Iterative perturbation calculations of ground and excited state energies from multiconfigurational zeroth‐order wavefunctions
journal, June 1973
- Huron, B.; Malrieu, J. P.; Rancurel, P.
- The Journal of Chemical Physics, Vol. 58, Issue 12
Selected versus complete configuration interaction expansions
journal, August 1991
- Illas, F.; Rubio, J.; Ricart, J. M.
- The Journal of Chemical Physics, Vol. 95, Issue 3
Communication: An adaptive configuration interaction approach for strongly correlated electrons with tunable accuracy
journal, April 2016
- Schriber, Jeffrey B.; Evangelista, Francesco A.
- The Journal of Chemical Physics, Vol. 144, Issue 16
Adaptive Configuration Interaction for Computing Challenging Electronic Excited States with Tunable Accuracy
journal, October 2017
- Schriber, Jeffrey B.; Evangelista, Francesco A.
- Journal of Chemical Theory and Computation, Vol. 13, Issue 11
A deterministic alternative to the full configuration interaction quantum Monte Carlo method
journal, July 2016
- Tubman, Norm M.; Lee, Joonho; Takeshita, Tyler Y.
- The Journal of Chemical Physics, Vol. 145, Issue 4
Heat-Bath Configuration Interaction: An Efficient Selected Configuration Interaction Algorithm Inspired by Heat-Bath Sampling
journal, August 2016
- Holmes, Adam A.; Tubman, Norm M.; Umrigar, C. J.
- Journal of Chemical Theory and Computation, Vol. 12, Issue 8
Ab initio quantum chemistry using the density matrix renormalization group
journal, March 1999
- White, Steven R.; Martin, Richard L.
- The Journal of Chemical Physics, Vol. 110, Issue 9
Computation of determinant expansion coefficients within the graphically contracted function method
journal, November 2009
- Gidofalvi, Gergely; Shepard, Ron
- Journal of Computational Chemistry, Vol. 30, Issue 15
A General Nonlinear Expansion Form for Electronic Wave Functions †
journal, December 2005
- Shepard, Ron
- The Journal of Physical Chemistry A, Vol. 109, Issue 50
Large-Scale Electron Correlation Calculations: Rank-Reduced Full Configuration Interaction
journal, June 2018
- Fales, B. Scott; Seritan, Stefan; Settje, Nick F.
- Journal of Chemical Theory and Computation, Vol. 14, Issue 8
Incremental full configuration interaction
journal, March 2017
- Zimmerman, Paul M.
- The Journal of Chemical Physics, Vol. 146, Issue 10
Machine Learning Configuration Interaction
journal, October 2018
- Coe, J. P.
- Journal of Chemical Theory and Computation, Vol. 14, Issue 11
Fermion Monte Carlo without fixed nodes: A game of life, death, and annihilation in Slater determinant space
journal, January 2009
- Booth, George H.; Thom, Alex J. W.; Alavi, Ali
- The Journal of Chemical Physics, Vol. 131, Issue 5
Nanoscale Multireference Quantum Chemistry: Full Configuration Interaction on Graphical Processing Units
journal, September 2015
- Fales, B. Scott; Levine, Benjamin G.
- Journal of Chemical Theory and Computation, Vol. 11, Issue 10
An efficient implementation of the full-CI method using an (n–2)-electron projection space
journal, June 1989
- Harrison, Robert J.; Zarrabian, Sohrab
- Chemical Physics Letters, Vol. 158, Issue 5
A new method for large-scale Cl calculations
journal, August 1972
- Roos, B.
- Chemical Physics Letters, Vol. 15, Issue 2
The direct CI method: A detailed analysis
journal, April 1983
- Saunders, V. R.; van Lenthe, J. H.
- Molecular Physics, Vol. 48, Issue 5
The iterative calculation of a few of the lowest eigenvalues and corresponding eigenvectors of large real-symmetric matrices
journal, January 1975
- Davidson, Ernest R.
- Journal of Computational Physics, Vol. 17, Issue 1
Systematic Study of Selected Diagonalization Methods for Configuration Interaction Matrices
journal, January 2001
- Leininger, Matthew L.; Sherrill, C. David; Allen, Wesley D.
- Journal of Computational Chemistry, Vol. 22, Issue 13
A direct method to transform between expansions in the configuration state function and Slater determinant bases
journal, July 2014
- Olsen, Jeppe
- The Journal of Chemical Physics, Vol. 141, Issue 3
Computation and analysis of the full configuration interaction wave function of some simple systems
journal, March 1993
- Bendazzoli, Gian Luigi; Evangelisti, Stefano
- International Journal of Quantum Chemistry, Vol. 48, Issue S27
Pushing configuration-interaction to the limit: Towards massively parallel MCSCF calculations
journal, November 2017
- Vogiatzis, Konstantinos D.; Ma, Dongxia; Olsen, Jeppe
- The Journal of Chemical Physics, Vol. 147, Issue 18
A determinant based full configuration interaction program
journal, April 1989
- Knowles, Peter J.; Handy, Nicholas C.
- Computer Physics Communications, Vol. 54, Issue 1
P y SCF: the Python-based simulations of chemistry framework : The PySCF program
journal, September 2017
- Sun, Qiming; Berkelbach, Timothy C.; Blunt, Nick S.
- Wiley Interdisciplinary Reviews: Computational Molecular Science, Vol. 8, Issue 1
Complete active space configuration interaction from state-averaged configuration interaction singles natural orbitals: Analytic first derivatives and derivative coupling vectors
journal, September 2017
- Fales, B. Scott; Shu, Yinan; Levine, Benjamin G.
- The Journal of Chemical Physics, Vol. 147, Issue 9
Analytic first derivatives of floating occupation molecular orbital-complete active space configuration interaction on graphical processing units
journal, July 2015
- Hohenstein, Edward G.; Bouduban, Marine E. F.; Song, Chenchen
- The Journal of Chemical Physics, Vol. 143, Issue 1
An atomic orbital-based formulation of the complete active space self-consistent field method on graphical processing units
journal, June 2015
- Hohenstein, Edward G.; Luehr, Nathan; Ufimtsev, Ivan S.
- The Journal of Chemical Physics, Vol. 142, Issue 22
“Balancing” the Block Davidson–Liu Algorithm
journal, June 2016
- Parrish, Robert M.; Hohenstein, Edward G.; Martínez, Todd J.
- Journal of Chemical Theory and Computation, Vol. 12, Issue 7
Quantum Chemistry on Graphical Processing Units. 2. Direct Self-Consistent-Field Implementation
journal, March 2009
- Ufimtsev, Ivan S.; Martinez, Todd J.
- Journal of Chemical Theory and Computation, Vol. 5, Issue 4
Quantum Chemistry on Graphical Processing Units. 3. Analytical Energy Gradients, Geometry Optimization, and First Principles Molecular Dynamics
journal, August 2009
- Ufimtsev, Ivan S.; Martinez, Todd J.
- Journal of Chemical Theory and Computation, Vol. 5, Issue 10
Quantum Chemistry on Graphical Processing Units. 1. Strategies for Two-Electron Integral Evaluation
journal, January 2008
- Ufimtsev, Ivan S.; Martínez, Todd J.
- Journal of Chemical Theory and Computation, Vol. 4, Issue 2
Variable Electronic Coupling in Phenylacetylene Dendrimers: The Role of Förster, Dexter, and Charge-Transfer Interactions
journal, January 2004
- Thompson, Alexis L.; Gaab, Kevin M.; Xu, Jianjun
- The Journal of Physical Chemistry A, Vol. 108, Issue 4
Comprehensive Look at the Photochemistry of Tolane
journal, January 2017
- Krämer, Maximilian; Bunz, Uwe H. F.; Dreuw, Andreas
- The Journal of Physical Chemistry A, Vol. 121, Issue 5
Theoretical Study on the Photochemical Behavior of Diphenylacetylene in the Low-Lying Excited States
journal, October 2004
- Amatatsu, Yoshiaki; Hosokawa, Masaru
- The Journal of Physical Chemistry A, Vol. 108, Issue 46
Complex time dependent wave packet technique for thermal equilibrium systems: Electronic spectra
journal, November 1983
- Reimers, Jeffrey R.; Wilson, Kent R.; Heller, Eric J.
- The Journal of Chemical Physics, Vol. 79, Issue 10
Spectrum simulation and decomposition with nuclear ensemble: formal derivation and application to benzene, furan and 2-phenylfuran
journal, June 2012
- Crespo-Otero, Rachel; Barbatti, Mario
- Theoretical Chemistry Accounts, Vol. 131, Issue 6
Automated Selection of Active Orbital Spaces
journal, March 2016
- Stein, Christopher J.; Reiher, Markus
- Journal of Chemical Theory and Computation, Vol. 12, Issue 4
Automated Construction of Molecular Active Spaces from Atomic Valence Orbitals
journal, August 2017
- Sayfutyarova, Elvira R.; Sun, Qiming; Chan, Garnet Kin-Lic
- Journal of Chemical Theory and Computation, Vol. 13, Issue 9