DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Complementary first and second derivative methods for ansatz optimization in variational Monte Carlo

Abstract

We present a comparison between a number of recently introduced low-memory wave function optimization methods for variational Monte Carlo in which we find that first and second derivative methods possess strongly complementary relative advantages. While we find that low-memory variants of the linear method are vastly more efficient at bringing wave functions with disparate types of nonlinear parameters to the vicinity of the energy minimum, accelerated descent approaches are then able to locate the precise minimum with less bias and lower statistical uncertainty. By constructing a simple hybrid approach that combines these methodologies, we show that all of these advantages can be had at once when simultaneously optimizing large determinant expansions, molecular orbital shapes, traditional Jastrow correlation factors, and more nonlinear many-electron Jastrow factors.

Authors:
 [1]; ORCiD logo [2]
  1. Univ. of California, Berkeley, CA (United States). Dept. of Physics
  2. Univ. of California, Berkeley, CA (United States). Dept. of Chemistry; Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Chemical Sciences Division
Publication Date:
Research Org.:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
OSTI Identifier:
1567167
Alternate Identifier(s):
OSTI ID: 1529687
Grant/Contract Number:  
AC02-05CH11231
Resource Type:
Accepted Manuscript
Journal Name:
Physical Chemistry Chemical Physics. PCCP
Additional Journal Information:
Journal Volume: 21; Journal Issue: 27; Journal ID: ISSN 1463-9076
Publisher:
Royal Society of Chemistry
Country of Publication:
United States
Language:
English
Subject:
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY

Citation Formats

Otis, Leon, and Neuscamman, Eric. Complementary first and second derivative methods for ansatz optimization in variational Monte Carlo. United States: N. p., 2019. Web. doi:10.1039/c9cp02269d.
Otis, Leon, & Neuscamman, Eric. Complementary first and second derivative methods for ansatz optimization in variational Monte Carlo. United States. https://doi.org/10.1039/c9cp02269d
Otis, Leon, and Neuscamman, Eric. Tue . "Complementary first and second derivative methods for ansatz optimization in variational Monte Carlo". United States. https://doi.org/10.1039/c9cp02269d. https://www.osti.gov/servlets/purl/1567167.
@article{osti_1567167,
title = {Complementary first and second derivative methods for ansatz optimization in variational Monte Carlo},
author = {Otis, Leon and Neuscamman, Eric},
abstractNote = {We present a comparison between a number of recently introduced low-memory wave function optimization methods for variational Monte Carlo in which we find that first and second derivative methods possess strongly complementary relative advantages. While we find that low-memory variants of the linear method are vastly more efficient at bringing wave functions with disparate types of nonlinear parameters to the vicinity of the energy minimum, accelerated descent approaches are then able to locate the precise minimum with less bias and lower statistical uncertainty. By constructing a simple hybrid approach that combines these methodologies, we show that all of these advantages can be had at once when simultaneously optimizing large determinant expansions, molecular orbital shapes, traditional Jastrow correlation factors, and more nonlinear many-electron Jastrow factors.},
doi = {10.1039/c9cp02269d},
journal = {Physical Chemistry Chemical Physics. PCCP},
number = 27,
volume = 21,
place = {United States},
year = {Tue Jan 01 00:00:00 EST 2019},
month = {Tue Jan 01 00:00:00 EST 2019}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 14 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Improved Speed and Scaling in Orbital Space Variational Monte Carlo
journal, November 2018

  • Sabzevari, Iliya; Sharma, Sandeep
  • Journal of Chemical Theory and Computation, Vol. 14, Issue 12
  • DOI: 10.1021/acs.jctc.8b00780

Full optimization of Jastrow–Slater wave functions with application to the first-row atoms and homonuclear diatomic molecules
journal, May 2008

  • Toulouse, Julien; Umrigar, C. J.
  • The Journal of Chemical Physics, Vol. 128, Issue 17
  • DOI: 10.1063/1.2908237

Photoswitches: From Molecules to Materials
journal, April 2010


Selected configuration interaction dressed by perturbation
journal, August 2018

  • Garniron, Yann; Scemama, Anthony; Giner, Emmanuel
  • The Journal of Chemical Physics, Vol. 149, Issue 6
  • DOI: 10.1063/1.5044503

Equation of Motion Theory for Excited States in Variational Monte Carlo and the Jastrow Antisymmetric Geminal Power in Hilbert Space
journal, July 2016

  • Zhao, Luning; Neuscamman, Eric
  • Journal of Chemical Theory and Computation, Vol. 12, Issue 8
  • DOI: 10.1021/acs.jctc.6b00480

Dissecting the Hydrogen Bond: A Quantum Monte Carlo Approach
journal, July 2008

  • Sterpone, Fabio; Spanu, Leonardo; Ferraro, Luca
  • Journal of Chemical Theory and Computation, Vol. 4, Issue 9
  • DOI: 10.1021/ct800121e

Excited States of Methylene, Polyenes, and Ozone from Heat-Bath Configuration Interaction
journal, February 2018

  • Chien, Alan D.; Holmes, Adam A.; Otten, Matthew
  • The Journal of Physical Chemistry A, Vol. 122, Issue 10
  • DOI: 10.1021/acs.jpca.8b01554

Communication: An adaptive configuration interaction approach for strongly correlated electrons with tunable accuracy
journal, April 2016

  • Schriber, Jeffrey B.; Evangelista, Francesco A.
  • The Journal of Chemical Physics, Vol. 144, Issue 16
  • DOI: 10.1063/1.4948308

Heat-Bath Configuration Interaction: An Efficient Selected Configuration Interaction Algorithm Inspired by Heat-Bath Sampling
journal, August 2016

  • Holmes, Adam A.; Tubman, Norm M.; Umrigar, C. J.
  • Journal of Chemical Theory and Computation, Vol. 12, Issue 8
  • DOI: 10.1021/acs.jctc.6b00407

Excitation Variance Matching with Limited Configuration Interaction Expansions in Variational Monte Carlo
text, January 2017


Excited State Specific Multi-Slater Jastrow Wave Functions
text, January 2018


Clean and Convenient Tessellations for Number Counting Jastrow Factors
preprint, January 2018


Recent Progresses on Diarylethene Based Photochromic Switches
journal, May 2004


Accuracy of Electronic Wave Functions in Quantum Monte Carlo: the Effect of High-Order Correlations
text, January 1997


Alleviation of the Fermion-Sign Problem by Optimization of Many-Body Wave Functions
journal, March 2007


Stochastic Gradient Approximation: An Efficient Method to Optimize Many-Body Wave Functions
journal, August 1997


Configuration interaction calculations on the nitrogen molecule
journal, January 1974

  • Langhoff, Stephen R.; Davidson, Ernest R.
  • International Journal of Quantum Chemistry, Vol. 8, Issue 1
  • DOI: 10.1002/qua.560080106

Excited State Specific Multi-Slater Jastrow Wave Functions
journal, January 2019

  • Pineda Flores, Sergio D.; Neuscamman, Eric
  • The Journal of Physical Chemistry A, Vol. 123, Issue 8
  • DOI: 10.1021/acs.jpca.8b10671

Solving the quantum many-body problem with artificial neural networks
journal, February 2017


Simple formalism for efficient derivatives and multi-determinant expansions in quantum Monte Carlo
journal, May 2016

  • Filippi, Claudia; Assaraf, Roland; Moroni, Saverio
  • The Journal of Chemical Physics, Vol. 144, Issue 19
  • DOI: 10.1063/1.4948778

Semistochastic Heat-Bath Configuration Interaction Method: Selected Configuration Interaction with Semistochastic Perturbation Theory.
text, January 2017

  • Sharma, S.; Holmes, Aa; Jeanmairet, G.
  • Apollo - University of Cambridge Repository
  • DOI: 10.17863/cam.8720

Correlator product state study of molecular magnetism in the giant Keplerate Mo 72 Fe 30
journal, August 2012


Strongly correlated barriers to rotation from parametric two-electron reduced-density-matrix methods in application to the isomerization of diazene
journal, January 2012

  • Sand, Andrew M.; Schwerdtfeger, Christine A.; Mazziotti, David A.
  • The Journal of Chemical Physics, Vol. 136, Issue 3
  • DOI: 10.1063/1.3675683

A new generation of effective core potentials for correlated calculations
journal, December 2017

  • Bennett, M. Chandler; Melton, Cody A.; Annaberdiyev, Abdulgani
  • The Journal of Chemical Physics, Vol. 147, Issue 22
  • DOI: 10.1063/1.4995643

Molecular hydrogen adsorbed on benzene: Insights from a quantum Monte Carlo study
journal, October 2008

  • Beaudet, Todd D.; Casula, Michele; Kim, Jeongnim
  • The Journal of Chemical Physics, Vol. 129, Issue 16
  • DOI: 10.1063/1.2987716

Clean and Convenient Tessellations for Number Counting Jastrow Factors
journal, November 2018

  • Van Der Goetz, Brett; Otis, Leon; Neuscamman, Eric
  • Journal of Chemical Theory and Computation, Vol. 15, Issue 2
  • DOI: 10.1021/acs.jctc.8b01139

Communication: A Jastrow factor coupled cluster theory for weak and strong electron correlation
journal, November 2013

  • Neuscamman, Eric
  • The Journal of Chemical Physics, Vol. 139, Issue 18
  • DOI: 10.1063/1.4829536

Zero-variance principle for Monte Carlo algorithms
text, January 1999


Computing the energy of a water molecule using MultiDeterminants: A simple, efficient algorithm
text, January 2011


Excitation variance matching with limited configuration interaction expansions in variational Monte Carlo
journal, October 2017

  • Robinson, Paul J.; Pineda Flores, Sergio D.; Neuscamman, Eric
  • The Journal of Chemical Physics, Vol. 147, Issue 16
  • DOI: 10.1063/1.5008743

A Blocked Linear Method for Optimizing Large Parameter Sets in Variational Monte Carlo
journal, May 2017

  • Zhao, Luning; Neuscamman, Eric
  • Journal of Chemical Theory and Computation, Vol. 13, Issue 6
  • DOI: 10.1021/acs.jctc.7b00119

An Efficient Variational Principle for the Direct Optimization of Excited States
journal, July 2016

  • Zhao, Luning; Neuscamman, Eric
  • Journal of Chemical Theory and Computation, Vol. 12, Issue 8
  • DOI: 10.1021/acs.jctc.6b00508

Optimization of quantum Monte Carlo wave functions by energy minimization
journal, February 2007

  • Toulouse, Julien; Umrigar, C. J.
  • The Journal of Chemical Physics, Vol. 126, Issue 8
  • DOI: 10.1063/1.2437215

Nonlinear biases, stochastically sampled effective Hamiltonians, and spectral functions in quantum Monte Carlo methods
journal, August 2018


Realization of Quantum Chemistry without Wave Functions through First-Order Semidefinite Programming
journal, November 2004


Energies of the first row atoms from quantum Monte Carlo
journal, June 2007

  • Brown, M. D.; Trail, J. R.; López Ríos, P.
  • The Journal of Chemical Physics, Vol. 126, Issue 22
  • DOI: 10.1063/1.2743972

Wave function optimization in the variational Monte Carlo method
journal, June 2005


Energy and Variance Optimization of Many-Body Wave Functions
journal, April 2005


Geminal wave functions with Jastrow correlation: A first application to atoms
journal, October 2003

  • Casula, Michele; Sorella, Sandro
  • The Journal of Chemical Physics, Vol. 119, Issue 13
  • DOI: 10.1063/1.1604379

Finite size errors in quantum many-body simulations of extended systems
text, January 1998


Approaching chemical accuracy with quantum Monte Carlo
journal, March 2012

  • Petruzielo, F. R.; Toulouse, Julien; Umrigar, C. J.
  • The Journal of Chemical Physics, Vol. 136, Issue 12
  • DOI: 10.1063/1.3697846

Structural Optimization by Quantum Monte Carlo: Investigating the Low-Lying Excited States of Ethylene
journal, March 2012

  • Barborini, Matteo; Sorella, Sandro; Guidoni, Leonardo
  • Journal of Chemical Theory and Computation, Vol. 8, Issue 4
  • DOI: 10.1021/ct200724q

Zero-Variance Principle for Monte Carlo Algorithms
journal, December 1999


Iterative backflow renormalization procedure for many-body ground-state wave functions of strongly interacting normal Fermi liquids
journal, March 2015


Toward Intelligent Molecular Machines:  Directed Motions of Biological and Artificial Molecules and Assemblies
journal, April 2005

  • Kinbara, Kazushi; Aida, Takuzo
  • Chemical Reviews, Vol. 105, Issue 4
  • DOI: 10.1021/cr030071r

Projector Quantum Monte Carlo Method for Nonlinear Wave Functions
text, January 2017

  • Schwarz, Lauretta; Alavi, Ali; Booth, Gh
  • Apollo - University of Cambridge Repository
  • DOI: 10.17863/cam.11565

State-of-the-art density matrix renormalization group and coupled cluster theory studies of the nitrogen binding curve
journal, October 2004

  • Chan, Garnet Kin-Lic; Kállay, Mihály; Gauss, Jürgen
  • The Journal of Chemical Physics, Vol. 121, Issue 13
  • DOI: 10.1063/1.1783212

Recent progresses on diarylethene based photochromic switches
journal, January 2004

  • Tian, He; Yang, Songjie
  • Chemical Society Reviews, Vol. 33, Issue 2
  • DOI: 10.1039/b302356g

Framework for constructing generic Jastrow correlation factors
journal, September 2012


Ab initio molecular dynamics simulation of liquid water by quantum Monte Carlo
journal, April 2015

  • Zen, Andrea; Luo, Ye; Mazzola, Guglielmo
  • The Journal of Chemical Physics, Vol. 142, Issue 14
  • DOI: 10.1063/1.4917171

Energies of the first row atoms from quantum Monte Carlo
text, January 2010


Quantum Monte Carlo simulations of solids
journal, January 2001


Auxiliary-field quantum Monte Carlo calculations of the structural properties of nickel oxide
journal, October 2018

  • Zhang, Shuai; Malone, Fionn D.; Morales, Miguel A.
  • The Journal of Chemical Physics, Vol. 149, Issue 16
  • DOI: 10.1063/1.5040900

Improved Optimization for the Cluster Jastrow Antisymmetric Geminal Power and Tests on Triple-Bond Dissociations
journal, June 2016


Approximating strongly correlated wave functions with correlator product states
journal, December 2009


Communication: Variation after response in quantum Monte Carlo
journal, August 2016

  • Neuscamman, Eric
  • The Journal of Chemical Physics, Vol. 145, Issue 8
  • DOI: 10.1063/1.4961686

Generic expansion of the Jastrow correlation factor in polynomials satisfying symmetry and cusp conditions
journal, February 2015

  • Lüchow, Arne; Sturm, Alexander; Schulte, Christoph
  • The Journal of Chemical Physics, Vol. 142, Issue 8
  • DOI: 10.1063/1.4909554

Energy-consistent pseudopotentials for quantum Monte Carlo calculations
journal, June 2007

  • Burkatzki, M.; Filippi, C.; Dolg, M.
  • The Journal of Chemical Physics, Vol. 126, Issue 23
  • DOI: 10.1063/1.2741534

Correlated geminal wave function for molecules: An efficient resonating valence bond approach
journal, October 2004

  • Casula, Michele; Attaccalite, Claudio; Sorella, Sandro
  • The Journal of Chemical Physics, Vol. 121, Issue 15
  • DOI: 10.1063/1.1794632

Ground-state properties of quantum many-body systems: entangled-plaquette states and variational Monte Carlo
journal, August 2009


Optimization of Ground- and Excited-State Wave Functions and van der Waals Clusters
journal, July 2001


σ -SCF: A direct energy-targeting method to mean-field excited states
journal, December 2017

  • Ye, Hong-Zhou; Welborn, Matthew; Ricke, Nathan D.
  • The Journal of Chemical Physics, Vol. 147, Issue 21
  • DOI: 10.1063/1.5001262

Computing the energy of a water molecule using multideterminants: A simple, efficient algorithm
journal, December 2011

  • Clark, Bryan K.; Morales, Miguel A.; McMinis, Jeremy
  • The Journal of Chemical Physics, Vol. 135, Issue 24
  • DOI: 10.1063/1.3665391

Excited-State Diffusion Monte Carlo Calculations: A Simple and Efficient Two-Determinant Ansatz
journal, November 2018

  • Blunt, Nick S.; Neuscamman, Eric
  • Journal of Chemical Theory and Computation, Vol. 15, Issue 1
  • DOI: 10.1021/acs.jctc.8b00879

Accuracy of electronic wave functions in quantum Monte Carlo: The effect of high-order correlations
journal, August 1997

  • Huang, Chien-Jung; Umrigar, C. J.; Nightingale, M. P.
  • The Journal of Chemical Physics, Vol. 107, Issue 8
  • DOI: 10.1063/1.474658

Semistochastic Heat-Bath Configuration Interaction Method: Selected Configuration Interaction with Semistochastic Perturbation Theory
journal, March 2017

  • Sharma, Sandeep; Holmes, Adam A.; Jeanmairet, Guillaume
  • Journal of Chemical Theory and Computation, Vol. 13, Issue 4
  • DOI: 10.1021/acs.jctc.6b01028

Monte Carlo energy and variance-minimization techniques for optimizing many-body wave functions
journal, May 1999


Weak binding between two aromatic rings: Feeling the van der Waals attraction by quantum Monte Carlo methods
journal, July 2007

  • Sorella, Sandro; Casula, Michele; Rocca, Dario
  • The Journal of Chemical Physics, Vol. 127, Issue 1
  • DOI: 10.1063/1.2746035

Optimizing the Energy with Quantum Monte Carlo: A Lower Numerical Scaling for Jastrow–Slater Expansions
journal, October 2017

  • Assaraf, Roland; Moroni, S.; Filippi, Claudia
  • Journal of Chemical Theory and Computation, Vol. 13, Issue 11
  • DOI: 10.1021/acs.jctc.7b00648

Size Consistent Excited States via Algorithmic Transformations between Variational Principles
journal, November 2017

  • Shea, Jacqueline A. R.; Neuscamman, Eric
  • Journal of Chemical Theory and Computation, Vol. 13, Issue 12
  • DOI: 10.1021/acs.jctc.7b00923

Charge-transfer excited states: Seeking a balanced and efficient wave function ansatz in variational Monte Carlo
journal, November 2017

  • Blunt, N. S.; Neuscamman, Eric
  • The Journal of Chemical Physics, Vol. 147, Issue 19
  • DOI: 10.1063/1.4998197

Molecular hydrogen adsorbed on benzene: insights from a quantum Monte Carlo study
text, January 2008


Resonating valence bond wave function with molecular orbitals: Application to first-row molecules
journal, October 2009

  • Marchi, Mariapia; Azadi, Sam; Casula, Michele
  • The Journal of Chemical Physics, Vol. 131, Issue 15
  • DOI: 10.1063/1.3249966

Stochastic Gradient Descent Tricks
book, January 2012


Quantum Monte Carlo with Jastrow-valence-bond wave functions
text, January 2011


A deterministic alternative to the full configuration interaction quantum Monte Carlo method
journal, July 2016

  • Tubman, Norm M.; Lee, Joonho; Takeshita, Tyler Y.
  • The Journal of Chemical Physics, Vol. 145, Issue 4
  • DOI: 10.1063/1.4955109

Electronic Quantum Monte Carlo Calculations of Atomic Forces, Vibrations, and Anharmonicities
text, January 2004


General atomic and molecular electronic structure system
journal, November 1993

  • Schmidt, Michael W.; Baldridge, Kim K.; Boatz, Jerry A.
  • Journal of Computational Chemistry, Vol. 14, Issue 11, p. 1347-1363
  • DOI: 10.1002/jcc.540141112

ImprovedSCF convergence acceleration
journal, January 1982


Quantum Monte Carlo with Jastrow-valence-bond wave functions
journal, February 2011

  • Braïda, Benoît; Toulouse, Julien; Caffarel, Michel
  • The Journal of Chemical Physics, Vol. 134, Issue 8
  • DOI: 10.1063/1.3555821

Suppressing Ionic Terms with Number-Counting Jastrow Factors in Real Space
journal, April 2017

  • Goetz, Brett Van Der; Neuscamman, Eric
  • Journal of Chemical Theory and Computation, Vol. 13, Issue 5
  • DOI: 10.1021/acs.jctc.7b00158

M ONTE C ARLO M ETHODS IN E LECTRONIC S TRUCTURES FOR L ARGE S YSTEMS
journal, October 2000


Electronic quantum Monte Carlo calculations of atomic forces, vibrations, and anharmonicities
journal, June 2005

  • Lee, Myung Won; Mella, Massimo; Rappe, Andrew M.
  • The Journal of Chemical Physics, Vol. 122, Issue 24
  • DOI: 10.1063/1.1924690

Optimization of quantum Monte Carlo wave functions using analytical energy derivatives
journal, February 2000

  • Lin, Xi; Zhang, Hongkai; Rappe, Andrew M.
  • The Journal of Chemical Physics, Vol. 112, Issue 6
  • DOI: 10.1063/1.480839

Toward Intelligent Molecular Machines: Directed Motions of Biological and Artificial Molecules and Assemblies
journal, July 2005


Dissecting the hydrogen bond: a Quantum Monte Carlo approach
preprint, January 2008


Density matrix renormalization group algorithms with a single center site
journal, November 2005


Observations on variational and projector Monte Carlo methods
journal, October 2015

  • Umrigar, C. J.
  • The Journal of Chemical Physics, Vol. 143, Issue 16
  • DOI: 10.1063/1.4933112

The iterative calculation of a few of the lowest eigenvalues and corresponding eigenvectors of large real-symmetric matrices
journal, January 1975


Correlation of Electrons in a Narrow s Band
journal, March 1965


Multideterminant Wave Functions in Quantum Monte Carlo
journal, June 2012

  • Morales, Miguel A.; McMinis, Jeremy; Clark, Bryan K.
  • Journal of Chemical Theory and Computation, Vol. 8, Issue 7
  • DOI: 10.1021/ct3003404

Alleviation of the Fermion-sign problem by optimization of many-body wave functions
text, January 2006


Molecular Electronic-Structure Theory
book, August 2000


Works referencing / citing this record:

Multireference configuration interaction and perturbation theory without reduced density matrices
journal, December 2019

  • Mahajan, Ankit; Blunt, Nick S.; Sabzevari, Iliya
  • The Journal of Chemical Physics, Vol. 151, Issue 21
  • DOI: 10.1063/1.5128115

An accelerated linear method for optimizing non-linear wavefunctions in variational Monte Carlo
journal, January 2020

  • Sabzevari, Iliya; Mahajan, Ankit; Sharma, Sandeep
  • The Journal of Chemical Physics, Vol. 152, Issue 2
  • DOI: 10.1063/1.5125803

An accelerated linear method for optimizing non-linear wavefunctions in variational Monte Carlo
text, January 2019


Multireference configuration interaction and perturbation theory without reduced density matrices
text, January 2019


A hybrid approach to extending selected configuration interaction and full configuration interaction quantum Monte Carlo
journal, November 2019

  • Blunt, Nick S.
  • The Journal of Chemical Physics, Vol. 151, Issue 17
  • DOI: 10.1063/1.5123146

Accelerating Stochastic Quantum Chemistry
text, January 2019