DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction

Abstract

In this study, we have extended our graphical processing unit (GPU)-accelerated direct configuration interaction program to multiple devices, reducing iteration times for configuration spaces of 165 million determinants to only 3 s using NVIDIA P100 GPUs. Similar improvements in the one- and two-particle reduced density matrix formation allow for fast analytical energy gradients and electronic properties. Our parallel algorithm enables the calculation of arbitrarily large configuration spaces (limited only by available system memory), with iteration times of 13 min for an active space of 18 electrons in 18 orbitals (2.4 billion determinants) using six consumer grade NVIDIA 1080Ti GPUs. These advances enable routine molecular dynamics simulations, geometry optimizations, and absorption spectrum calculations for molecules with large configuration spaces, a task that has heretofore required massive computational effort. In this work, we demonstrate the utility of our program by generating the absorption spectrum for diphenyl acetylene at the floating occupation molecular orbital complete active space configuration interaction level of theory. Lastly, several active spaces were investigated to assess the dependence of spectral features on orbital space dimension.

Authors:
ORCiD logo [1]; ORCiD logo [1]
  1. Stanford Univ., CA (United States); SLAC National Accelerator Lab., Menlo Park, CA (United States)
Publication Date:
Research Org.:
SLAC National Accelerator Lab., Menlo Park, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR). Scientific Discovery through Advanced Computing (SciDAC); Extreme Science and Engineering Discovery Environment; National Science Foundation (NSF)
OSTI Identifier:
1617039
Grant/Contract Number:  
AC02-76SF00515; TG-CHE140101; ACI-1429830
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Chemical Theory and Computation
Additional Journal Information:
Journal Volume: 16; Journal Issue: 3; Journal ID: ISSN 1549-9618
Publisher:
American Chemical Society
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY

Citation Formats

Fales, B. Scott, and Martínez, Todd J. Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction. United States: N. p., 2020. Web. doi:10.1021/acs.jctc.9b01165.
Fales, B. Scott, & Martínez, Todd J. Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction. United States. https://doi.org/10.1021/acs.jctc.9b01165
Fales, B. Scott, and Martínez, Todd J. Wed . "Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction". United States. https://doi.org/10.1021/acs.jctc.9b01165. https://www.osti.gov/servlets/purl/1617039.
@article{osti_1617039,
title = {Efficient Treatment of Large Active Spaces through Multi-GPU Parallel Implementation of Direct Configuration Interaction},
author = {Fales, B. Scott and Martínez, Todd J.},
abstractNote = {In this study, we have extended our graphical processing unit (GPU)-accelerated direct configuration interaction program to multiple devices, reducing iteration times for configuration spaces of 165 million determinants to only 3 s using NVIDIA P100 GPUs. Similar improvements in the one- and two-particle reduced density matrix formation allow for fast analytical energy gradients and electronic properties. Our parallel algorithm enables the calculation of arbitrarily large configuration spaces (limited only by available system memory), with iteration times of 13 min for an active space of 18 electrons in 18 orbitals (2.4 billion determinants) using six consumer grade NVIDIA 1080Ti GPUs. These advances enable routine molecular dynamics simulations, geometry optimizations, and absorption spectrum calculations for molecules with large configuration spaces, a task that has heretofore required massive computational effort. In this work, we demonstrate the utility of our program by generating the absorption spectrum for diphenyl acetylene at the floating occupation molecular orbital complete active space configuration interaction level of theory. Lastly, several active spaces were investigated to assess the dependence of spectral features on orbital space dimension.},
doi = {10.1021/acs.jctc.9b01165},
journal = {Journal of Chemical Theory and Computation},
number = 3,
volume = 16,
place = {United States},
year = {Wed Jan 29 00:00:00 EST 2020},
month = {Wed Jan 29 00:00:00 EST 2020}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 13 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Generalized valence bond description of bonding in low-lying states of molecules
journal, November 1973

  • Goddard, William A.; Dunning, Thom H.; Hunt, William J.
  • Accounts of Chemical Research, Vol. 6, Issue 11
  • DOI: 10.1021/ar50071a002

The half-projected Hartree-Fock method: I. Eigenvalue formulation and simple applications
journal, December 1976

  • Cox, P. Anthony; Wood, Melvyn H.
  • Theoretica Chimica Acta, Vol. 41, Issue 4
  • DOI: 10.1007/BF01177995

A complete active space SCF method (CASSCF) using a density matrix formulated super-CI approach
journal, May 1980


Are atoms intrinsic to molecular electronic wavefunctions? I. The FORS model
journal, September 1982


Molecular gradients for semiempirical CI wavefunctions with floating occupation molecular orbitals
journal, July 2000


Ab initio floating occupation molecular orbital-complete active space configuration interaction: An efficient approximation to CASSCF
journal, June 2010

  • Slavíček, Petr; Martínez, Todd J.
  • The Journal of Chemical Physics, Vol. 132, Issue 23
  • DOI: 10.1063/1.3436501

Configuration interaction singles natural orbitals: An orbital basis for an efficient and size intensive multireference description of electronic excited states
journal, January 2015

  • Shu, Yinan; Hohenstein, Edward G.; Levine, Benjamin G.
  • The Journal of Chemical Physics, Vol. 142, Issue 2
  • DOI: 10.1063/1.4905124

High-Multiplicity Natural Orbitals in Multireference Configuration Interaction for Excited State Potential Energy Surfaces
journal, May 2013

  • Lu, Zhen; Matsika, Spiridoula
  • The Journal of Physical Chemistry A, Vol. 117, Issue 32
  • DOI: 10.1021/jp401444c

Determinant based configuration interaction algorithms for complete and restricted configuration interaction spaces
journal, August 1988

  • Olsen, Jeppe; Roos, Björn O.; Jo/rgensen, Poul
  • The Journal of Chemical Physics, Vol. 89, Issue 4
  • DOI: 10.1063/1.455063

The restricted active space self-consistent-field method, implemented with a split graph unitary group approach
journal, July 1990

  • Malmqvist, Per Aake.; Rendell, Alistair.; Roos, Bjoern O.
  • The Journal of Physical Chemistry, Vol. 94, Issue 14
  • DOI: 10.1021/j100377a011

The generalized active space concept in multiconfigurational self-consistent field methods
journal, July 2011

  • Ma, Dongxia; Li Manni, Giovanni; Gagliardi, Laura
  • The Journal of Chemical Physics, Vol. 135, Issue 4
  • DOI: 10.1063/1.3611401

Iterative perturbation calculations of ground and excited state energies from multiconfigurational zeroth‐order wavefunctions
journal, June 1973

  • Huron, B.; Malrieu, J. P.; Rancurel, P.
  • The Journal of Chemical Physics, Vol. 58, Issue 12
  • DOI: 10.1063/1.1679199

Selected versus complete configuration interaction expansions
journal, August 1991

  • Illas, F.; Rubio, J.; Ricart, J. M.
  • The Journal of Chemical Physics, Vol. 95, Issue 3
  • DOI: 10.1063/1.461037

Communication: An adaptive configuration interaction approach for strongly correlated electrons with tunable accuracy
journal, April 2016

  • Schriber, Jeffrey B.; Evangelista, Francesco A.
  • The Journal of Chemical Physics, Vol. 144, Issue 16
  • DOI: 10.1063/1.4948308

Adaptive Configuration Interaction for Computing Challenging Electronic Excited States with Tunable Accuracy
journal, October 2017

  • Schriber, Jeffrey B.; Evangelista, Francesco A.
  • Journal of Chemical Theory and Computation, Vol. 13, Issue 11
  • DOI: 10.1021/acs.jctc.7b00725

A deterministic alternative to the full configuration interaction quantum Monte Carlo method
journal, July 2016

  • Tubman, Norm M.; Lee, Joonho; Takeshita, Tyler Y.
  • The Journal of Chemical Physics, Vol. 145, Issue 4
  • DOI: 10.1063/1.4955109

Heat-Bath Configuration Interaction: An Efficient Selected Configuration Interaction Algorithm Inspired by Heat-Bath Sampling
journal, August 2016

  • Holmes, Adam A.; Tubman, Norm M.; Umrigar, C. J.
  • Journal of Chemical Theory and Computation, Vol. 12, Issue 8
  • DOI: 10.1021/acs.jctc.6b00407

Ab initio quantum chemistry using the density matrix renormalization group
journal, March 1999

  • White, Steven R.; Martin, Richard L.
  • The Journal of Chemical Physics, Vol. 110, Issue 9
  • DOI: 10.1063/1.478295

Computation of determinant expansion coefficients within the graphically contracted function method
journal, November 2009

  • Gidofalvi, Gergely; Shepard, Ron
  • Journal of Computational Chemistry, Vol. 30, Issue 15
  • DOI: 10.1002/jcc.21275

A General Nonlinear Expansion Form for Electronic Wave Functions
journal, December 2005

  • Shepard, Ron
  • The Journal of Physical Chemistry A, Vol. 109, Issue 50
  • DOI: 10.1021/jp0543431

Large-Scale Electron Correlation Calculations: Rank-Reduced Full Configuration Interaction
journal, June 2018

  • Fales, B. Scott; Seritan, Stefan; Settje, Nick F.
  • Journal of Chemical Theory and Computation, Vol. 14, Issue 8
  • DOI: 10.1021/acs.jctc.8b00382

Incremental full configuration interaction
journal, March 2017

  • Zimmerman, Paul M.
  • The Journal of Chemical Physics, Vol. 146, Issue 10
  • DOI: 10.1063/1.4977727

Machine Learning Configuration Interaction
journal, October 2018


Fermion Monte Carlo without fixed nodes: A game of life, death, and annihilation in Slater determinant space
journal, January 2009

  • Booth, George H.; Thom, Alex J. W.; Alavi, Ali
  • The Journal of Chemical Physics, Vol. 131, Issue 5
  • DOI: 10.1063/1.3193710

Nanoscale Multireference Quantum Chemistry: Full Configuration Interaction on Graphical Processing Units
journal, September 2015

  • Fales, B. Scott; Levine, Benjamin G.
  • Journal of Chemical Theory and Computation, Vol. 11, Issue 10
  • DOI: 10.1021/acs.jctc.5b00634

An efficient implementation of the full-CI method using an (n–2)-electron projection space
journal, June 1989


A new method for large-scale Cl calculations
journal, August 1972


The direct CI method: A detailed analysis
journal, April 1983


The iterative calculation of a few of the lowest eigenvalues and corresponding eigenvectors of large real-symmetric matrices
journal, January 1975


Systematic Study of Selected Diagonalization Methods for Configuration Interaction Matrices
journal, January 2001

  • Leininger, Matthew L.; Sherrill, C. David; Allen, Wesley D.
  • Journal of Computational Chemistry, Vol. 22, Issue 13
  • DOI: 10.1002/jcc.1111

A direct method to transform between expansions in the configuration state function and Slater determinant bases
journal, July 2014

  • Olsen, Jeppe
  • The Journal of Chemical Physics, Vol. 141, Issue 3
  • DOI: 10.1063/1.4884786

Computation and analysis of the full configuration interaction wave function of some simple systems
journal, March 1993

  • Bendazzoli, Gian Luigi; Evangelisti, Stefano
  • International Journal of Quantum Chemistry, Vol. 48, Issue S27
  • DOI: 10.1002/qua.560480830

Pushing configuration-interaction to the limit: Towards massively parallel MCSCF calculations
journal, November 2017

  • Vogiatzis, Konstantinos D.; Ma, Dongxia; Olsen, Jeppe
  • The Journal of Chemical Physics, Vol. 147, Issue 18
  • DOI: 10.1063/1.4989858

A determinant based full configuration interaction program
journal, April 1989


P y SCF: the Python-based simulations of chemistry framework : The PySCF program
journal, September 2017

  • Sun, Qiming; Berkelbach, Timothy C.; Blunt, Nick S.
  • Wiley Interdisciplinary Reviews: Computational Molecular Science, Vol. 8, Issue 1
  • DOI: 10.1002/wcms.1340

Complete active space configuration interaction from state-averaged configuration interaction singles natural orbitals: Analytic first derivatives and derivative coupling vectors
journal, September 2017

  • Fales, B. Scott; Shu, Yinan; Levine, Benjamin G.
  • The Journal of Chemical Physics, Vol. 147, Issue 9
  • DOI: 10.1063/1.5000476

Analytic first derivatives of floating occupation molecular orbital-complete active space configuration interaction on graphical processing units
journal, July 2015

  • Hohenstein, Edward G.; Bouduban, Marine E. F.; Song, Chenchen
  • The Journal of Chemical Physics, Vol. 143, Issue 1
  • DOI: 10.1063/1.4923259

An atomic orbital-based formulation of the complete active space self-consistent field method on graphical processing units
journal, June 2015

  • Hohenstein, Edward G.; Luehr, Nathan; Ufimtsev, Ivan S.
  • The Journal of Chemical Physics, Vol. 142, Issue 22
  • DOI: 10.1063/1.4921956

“Balancing” the Block Davidson–Liu Algorithm
journal, June 2016

  • Parrish, Robert M.; Hohenstein, Edward G.; Martínez, Todd J.
  • Journal of Chemical Theory and Computation, Vol. 12, Issue 7
  • DOI: 10.1021/acs.jctc.6b00459

Quantum Chemistry on Graphical Processing Units. 2. Direct Self-Consistent-Field Implementation
journal, March 2009

  • Ufimtsev, Ivan S.; Martinez, Todd J.
  • Journal of Chemical Theory and Computation, Vol. 5, Issue 4
  • DOI: 10.1021/ct800526s

Quantum Chemistry on Graphical Processing Units. 3. Analytical Energy Gradients, Geometry Optimization, and First Principles Molecular Dynamics
journal, August 2009

  • Ufimtsev, Ivan S.; Martinez, Todd J.
  • Journal of Chemical Theory and Computation, Vol. 5, Issue 10
  • DOI: 10.1021/ct9003004

Quantum Chemistry on Graphical Processing Units. 1. Strategies for Two-Electron Integral Evaluation
journal, January 2008

  • Ufimtsev, Ivan S.; Martínez, Todd J.
  • Journal of Chemical Theory and Computation, Vol. 4, Issue 2
  • DOI: 10.1021/ct700268q

Variable Electronic Coupling in Phenylacetylene Dendrimers:  The Role of Förster, Dexter, and Charge-Transfer Interactions
journal, January 2004

  • Thompson, Alexis L.; Gaab, Kevin M.; Xu, Jianjun
  • The Journal of Physical Chemistry A, Vol. 108, Issue 4
  • DOI: 10.1021/jp030953u

Comprehensive Look at the Photochemistry of Tolane
journal, January 2017

  • Krämer, Maximilian; Bunz, Uwe H. F.; Dreuw, Andreas
  • The Journal of Physical Chemistry A, Vol. 121, Issue 5
  • DOI: 10.1021/acs.jpca.6b09596

Theoretical Study on the Photochemical Behavior of Diphenylacetylene in the Low-Lying Excited States
journal, October 2004

  • Amatatsu, Yoshiaki; Hosokawa, Masaru
  • The Journal of Physical Chemistry A, Vol. 108, Issue 46
  • DOI: 10.1021/jp047308n

Complex time dependent wave packet technique for thermal equilibrium systems: Electronic spectra
journal, November 1983

  • Reimers, Jeffrey R.; Wilson, Kent R.; Heller, Eric J.
  • The Journal of Chemical Physics, Vol. 79, Issue 10
  • DOI: 10.1063/1.445618

Spectrum simulation and decomposition with nuclear ensemble: formal derivation and application to benzene, furan and 2-phenylfuran
journal, June 2012


Automated Selection of Active Orbital Spaces
journal, March 2016

  • Stein, Christopher J.; Reiher, Markus
  • Journal of Chemical Theory and Computation, Vol. 12, Issue 4
  • DOI: 10.1021/acs.jctc.6b00156

Automated Construction of Molecular Active Spaces from Atomic Valence Orbitals
journal, August 2017

  • Sayfutyarova, Elvira R.; Sun, Qiming; Chan, Garnet Kin-Lic
  • Journal of Chemical Theory and Computation, Vol. 13, Issue 9
  • DOI: 10.1021/acs.jctc.7b00128