DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Gradient-based stochastic estimation of the density matrix

Abstract

Fast estimation of the single-particle density matrix is key to many applications in quantum chemistry and condensed matter physics. The best numerical methods leverage the fact that the density matrix elements f(H)ij decay rapidly with distance rij between orbitals. This decay is usually exponential. However, for the special case of metals at zero temperature, algebraic decay of the density matrix appears and poses a significant numerical challenge. Here, we introduce a gradient-based probing method to estimate all local density matrix elements at a computational cost that scales linearly with system size. For zero-temperature metals, the stochastic error scales like S-(d+2)/2d, where d is the dimension and S is a prefactor to the computational cost. The convergence becomes exponential if the system is at finite temperature or is insulating.

Authors:
 [1];  [2]; ORCiD logo [3];  [4]
  1. Univ. of Tennessee, Knoxville, TN (United States). Dept. of Physics and Astronomy
  2. Univ. of Virginia, Charlottesville, VA (United States). Dept. of Physics
  3. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
  4. Univ. of Tennessee, Knoxville, TN (United States). Dept. of Physics and Astronomy; Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Quantum Condensed Matter Division and Shull-Wollan Center
Publication Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Basic Energy Sciences (BES)
OSTI Identifier:
1481135
Alternate Identifier(s):
OSTI ID: 1423724
Report Number(s):
LA-UR-17-30801
Journal ID: ISSN 0021-9606
Grant/Contract Number:  
AC52-06NA25396
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Chemical Physics
Additional Journal Information:
Journal Volume: 148; Journal Issue: 9; Journal ID: ISSN 0021-9606
Publisher:
American Institute of Physics (AIP)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; 75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND SUPERFLUIDITY; 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY

Citation Formats

Wang, Zhentao, Cher, Gia-Wei, Barros, Kipton Marcos, and Batista, Cristian D. Gradient-based stochastic estimation of the density matrix. United States: N. p., 2018. Web. doi:10.1063/1.5017741.
Wang, Zhentao, Cher, Gia-Wei, Barros, Kipton Marcos, & Batista, Cristian D. Gradient-based stochastic estimation of the density matrix. United States. https://doi.org/10.1063/1.5017741
Wang, Zhentao, Cher, Gia-Wei, Barros, Kipton Marcos, and Batista, Cristian D. Mon . "Gradient-based stochastic estimation of the density matrix". United States. https://doi.org/10.1063/1.5017741. https://www.osti.gov/servlets/purl/1481135.
@article{osti_1481135,
title = {Gradient-based stochastic estimation of the density matrix},
author = {Wang, Zhentao and Cher, Gia-Wei and Barros, Kipton Marcos and Batista, Cristian D.},
abstractNote = {Fast estimation of the single-particle density matrix is key to many applications in quantum chemistry and condensed matter physics. The best numerical methods leverage the fact that the density matrix elements f(H)ij decay rapidly with distance rij between orbitals. This decay is usually exponential. However, for the special case of metals at zero temperature, algebraic decay of the density matrix appears and poses a significant numerical challenge. Here, we introduce a gradient-based probing method to estimate all local density matrix elements at a computational cost that scales linearly with system size. For zero-temperature metals, the stochastic error scales like S-(d+2)/2d, where d is the dimension and S is a prefactor to the computational cost. The convergence becomes exponential if the system is at finite temperature or is insulating.},
doi = {10.1063/1.5017741},
journal = {Journal of Chemical Physics},
number = 9,
volume = 148,
place = {United States},
year = {Mon Mar 05 00:00:00 EST 2018},
month = {Mon Mar 05 00:00:00 EST 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 12 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Energy conserving, linear scaling Born-Oppenheimer molecular dynamics
journal, October 2012

  • Cawkwell, M. J.; Niklasson, Anders M. N.
  • The Journal of Chemical Physics, Vol. 137, Issue 13
  • DOI: 10.1063/1.4755991

Mott Transition in a Metallic Liquid: Gutzwiller Molecular Dynamics Simulations
journal, June 2017


Decay properties of the finite-temperature density matrix in metals
journal, August 1998


Decay Properties of Spectral Projectors with Applications to Electronic Structure
journal, January 2013

  • Benzi, Michele; Boito, Paola; Razouk, Nader
  • SIAM Review, Vol. 55, Issue 1
  • DOI: 10.1137/100814019

Kernel Polynomial Approximations for Densities of States and Spectral Functions
journal, March 1996

  • Silver, R. N.; Roeder, H.; Voter, A. F.
  • Journal of Computational Physics, Vol. 124, Issue 1
  • DOI: 10.1006/jcph.1996.0048

A stochastic estimator of the trace of the influence matrix for laplacian smoothing splines
journal, January 1990

  • Hutchinson, M. F.
  • Communications in Statistics - Simulation and Computation, Vol. 19, Issue 2
  • DOI: 10.1080/03610919008812866

Ab initio molecular dynamics with noisy forces: Validating the quantum Monte Carlo approach with benchmark calculations of molecular vibrational properties
journal, November 2014

  • Luo, Ye; Zen, Andrea; Sorella, Sandro
  • The Journal of Chemical Physics, Vol. 141, Issue 19
  • DOI: 10.1063/1.4901430

A probing method for computing the diagonal of a matrix inverse
journal, April 2011

  • Tang, Jok M.; Saad, Yousef
  • Numerical Linear Algebra with Applications, Vol. 19, Issue 3
  • DOI: 10.1002/nla.779

\mathcal{O}(N) methods in electronic structure calculations
journal, February 2012


On the Estimation of Sparse Jacobian Matrices
journal, February 1974

  • Curtis, A. R.; Powell, M. J. D.; Reid, J. K.
  • IMA Journal of Applied Mathematics, Vol. 13, Issue 1
  • DOI: 10.1093/imamat/13.1.117

An iteration method for the solution of the eigenvalue problem of linear differential and integral operators
journal, October 1950

  • Lanczos, C.
  • Journal of Research of the National Bureau of Standards, Vol. 45, Issue 4
  • DOI: 10.6028/jres.045.026

Density functional tight binding
journal, March 2014

  • Elstner, Marcus; Seifert, Gotthard
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 372, Issue 2011
  • DOI: 10.1098/rsta.2012.0483

Fast Spectral Projection Algorithms for Density-Matrix Computations
journal, June 1999

  • Beylkin, Gregory; Coult, Nicholas; Mohlenkamp, Martin J.
  • Journal of Computational Physics, Vol. 152, Issue 1
  • DOI: 10.1006/jcph.1999.6215

Estimation of Sparse Jacobian Matrices and Graph Coloring Blems
journal, February 1983

  • Coleman, Thomas F.; Moré, Jorge J.
  • SIAM Journal on Numerical Analysis, Vol. 20, Issue 1
  • DOI: 10.1137/0720013

Kernel polynomial method for a nonorthogonal electronic-structure calculation of amorphous diamond
journal, June 1997


FOURIER TRANSFORMATION OF THE n -DIMENSIONAL RADIAL DELTA FUNCTION
journal, January 1961


An estimator for the diagonal of a matrix
journal, November 2007


Liquid to solid nucleation via onion structure droplets
journal, November 2013

  • Barros, Kipton; Klein, W.
  • The Journal of Chemical Physics, Vol. 139, Issue 17
  • DOI: 10.1063/1.4827884

Random phase vector for calculating the trace of a large matrix
journal, May 2004


Sublinear scaling for time-dependent stochastic density functional theory
journal, January 2015

  • Gao, Yi; Neuhauser, Daniel; Baer, Roi
  • The Journal of Chemical Physics, Vol. 142, Issue 3
  • DOI: 10.1063/1.4905568

Linear scaling electronic structure calculations and accurate statistical mechanics sampling with noisy forces
journal, January 2006


Self-Averaging Stochastic Kohn-Sham Density-Functional Theory
journal, September 2013


SIESTA-PEXSI: massively parallel method for efficient and accurate ab initio materials simulation without matrix diagonalization
journal, July 2014


Linear-scaling tight binding from a truncated-moment approach
journal, May 1996


Randomized estimation of spectral densities of large matrices made accurate
journal, August 2016


Shape of magnetic domain walls formed by coupling to mobile charges
journal, September 2017


Spatial Decay of the Single-Particle Density Matrix in Insulators: Analytic Results in Two and Three Dimensions
journal, April 2002


Exponential Decay Properties of Wannier Functions and Related Quantities
journal, June 2001


Exact results for spatial decay of the one-body density matrix in low-dimensional insulators
journal, October 2004


Resistivity Minimum in Highly Frustrated Itinerant Magnets
journal, November 2016


Approximating Spectral Densities of Large Matrices
journal, January 2016

  • Lin, Lin; Saad, Yousef; Yang, Chao
  • SIAM Review, Vol. 58, Issue 1
  • DOI: 10.1137/130934283

Maximum entropy approach for linear scaling in the electronic structure problem
journal, June 1993


The Kondo lattice and weak antiferromagnetism
journal, July 1977


Rational approximation to the Fermi–Dirac function with applications in density functional theory
journal, May 2010


Linear Scaling Self-Consistent Field Calculations with Millions of Atoms in the Condensed Phase
journal, March 2012

  • VandeVondele, Joost; Borštnik, Urban; Hutter, Jürg
  • Journal of Chemical Theory and Computation, Vol. 8, Issue 10
  • DOI: 10.1021/ct200897x

An efficient and accurate decomposition of the Fermi operator
journal, July 2008

  • Ceriotti, Michele; Kühne, Thomas D.; Parrinello, Michele
  • The Journal of Chemical Physics, Vol. 129, Issue 2
  • DOI: 10.1063/1.2949515

Semiclassical dynamics of spin density waves
journal, January 2018


Extended Lagrangian Density Functional Tight-Binding Molecular Dynamics for Molecules and Solids
journal, June 2015

  • Aradi, Bálint; Niklasson, Anders M. N.; Frauenheim, Thomas
  • Journal of Chemical Theory and Computation, Vol. 11, Issue 7
  • DOI: 10.1021/acs.jctc.5b00324

Green’s Functions in Quantum Physics
book, January 2006


Locality of the Density Matrix in Metals, Semiconductors, and Insulators
journal, March 1999


On approximation by trigonometric sums and polynomials
journal, April 1912


Equilibrium configurations of large nanostructures using the embedded saturated-fragments stochastic density functional theory
journal, June 2017

  • Arnon, Eitam; Rabani, Eran; Neuhauser, Daniel
  • The Journal of Chemical Physics, Vol. 146, Issue 22
  • DOI: 10.1063/1.4984931

A Stochastic Estimator of the Trace of the Influence Matrix for Laplacian Smoothing Splines
journal, January 1989

  • Hutchinson, M. F.
  • Communications in Statistics - Simulation and Computation, Vol. 18, Issue 3
  • DOI: 10.1080/03610918908812806

Linear scaling self-consistent field calculations with millions of atoms in the condensed phase
text, January 2012

  • VandeVondele, J.; Borštnik, U.; Hutter, J.
  • American Chemical Society
  • DOI: 10.5167/uzh-66004

Exponential Decay Properties of Wannier Functions and Related Quantities
text, January 2001


Decay properties of spectral projectors with applications to electronic structure
preprint, January 2012


Efficient Langevin Simulation of Coupled Classical Fields and Fermions
text, January 2013


Liquid to solid nucleation via onion structure droplets
text, January 2013


Approximating spectral densities of large matrices
preprint, January 2013


Novel magnetic orderings in the kagome Kondo-lattice model
text, January 2014


Sublinear scaling for time-dependent stochastic density functional theory
text, January 2014


Time-dependent Stochastic Bethe-Salpeter Approach
preprint, January 2015


Shape of magnetic domain walls formed by coupling to mobile charges
text, January 2016


Semiclassical dynamics of spin density waves
text, January 2017


Random phase vector for calculating the trace of a large matrix
text, January 2004


Works referencing / citing this record:

Anomalous magnetoresistance due to longitudinal spin fluctuations in a Jeff = 1/2 Mott semiconductor
journal, November 2019


Anomalous magnetoresistance due to longitudinal spin fluctuations in a Jeff = 1/2 Mott semiconductor
journal, November 2019