Gradient-based stochastic estimation of the density matrix
Abstract
Fast estimation of the single-particle density matrix is key to many applications in quantum chemistry and condensed matter physics. The best numerical methods leverage the fact that the density matrix elements f(H)ij decay rapidly with distance rij between orbitals. This decay is usually exponential. However, for the special case of metals at zero temperature, algebraic decay of the density matrix appears and poses a significant numerical challenge. Here, we introduce a gradient-based probing method to estimate all local density matrix elements at a computational cost that scales linearly with system size. For zero-temperature metals, the stochastic error scales like S-(d+2)/2d, where d is the dimension and S is a prefactor to the computational cost. The convergence becomes exponential if the system is at finite temperature or is insulating.
- Authors:
-
- Univ. of Tennessee, Knoxville, TN (United States). Dept. of Physics and Astronomy
- Univ. of Virginia, Charlottesville, VA (United States). Dept. of Physics
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
- Univ. of Tennessee, Knoxville, TN (United States). Dept. of Physics and Astronomy; Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Quantum Condensed Matter Division and Shull-Wollan Center
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Basic Energy Sciences (BES)
- OSTI Identifier:
- 1481135
- Alternate Identifier(s):
- OSTI ID: 1423724
- Report Number(s):
- LA-UR-17-30801
Journal ID: ISSN 0021-9606
- Grant/Contract Number:
- AC52-06NA25396
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Chemical Physics
- Additional Journal Information:
- Journal Volume: 148; Journal Issue: 9; Journal ID: ISSN 0021-9606
- Publisher:
- American Institute of Physics (AIP)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; 75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND SUPERFLUIDITY; 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY
Citation Formats
Wang, Zhentao, Cher, Gia-Wei, Barros, Kipton Marcos, and Batista, Cristian D. Gradient-based stochastic estimation of the density matrix. United States: N. p., 2018.
Web. doi:10.1063/1.5017741.
Wang, Zhentao, Cher, Gia-Wei, Barros, Kipton Marcos, & Batista, Cristian D. Gradient-based stochastic estimation of the density matrix. United States. https://doi.org/10.1063/1.5017741
Wang, Zhentao, Cher, Gia-Wei, Barros, Kipton Marcos, and Batista, Cristian D. Mon .
"Gradient-based stochastic estimation of the density matrix". United States. https://doi.org/10.1063/1.5017741. https://www.osti.gov/servlets/purl/1481135.
@article{osti_1481135,
title = {Gradient-based stochastic estimation of the density matrix},
author = {Wang, Zhentao and Cher, Gia-Wei and Barros, Kipton Marcos and Batista, Cristian D.},
abstractNote = {Fast estimation of the single-particle density matrix is key to many applications in quantum chemistry and condensed matter physics. The best numerical methods leverage the fact that the density matrix elements f(H)ij decay rapidly with distance rij between orbitals. This decay is usually exponential. However, for the special case of metals at zero temperature, algebraic decay of the density matrix appears and poses a significant numerical challenge. Here, we introduce a gradient-based probing method to estimate all local density matrix elements at a computational cost that scales linearly with system size. For zero-temperature metals, the stochastic error scales like S-(d+2)/2d, where d is the dimension and S is a prefactor to the computational cost. The convergence becomes exponential if the system is at finite temperature or is insulating.},
doi = {10.1063/1.5017741},
journal = {Journal of Chemical Physics},
number = 9,
volume = 148,
place = {United States},
year = {Mon Mar 05 00:00:00 EST 2018},
month = {Mon Mar 05 00:00:00 EST 2018}
}
Web of Science
Works referenced in this record:
Energy conserving, linear scaling Born-Oppenheimer molecular dynamics
journal, October 2012
- Cawkwell, M. J.; Niklasson, Anders M. N.
- The Journal of Chemical Physics, Vol. 137, Issue 13
Mott Transition in a Metallic Liquid: Gutzwiller Molecular Dynamics Simulations
journal, June 2017
- Chern, Gia-Wei; Barros, Kipton; Batista, Cristian D.
- Physical Review Letters, Vol. 118, Issue 22
Decay properties of the finite-temperature density matrix in metals
journal, August 1998
- Goedecker, S.
- Physical Review B, Vol. 58, Issue 7
Decay Properties of Spectral Projectors with Applications to Electronic Structure
journal, January 2013
- Benzi, Michele; Boito, Paola; Razouk, Nader
- SIAM Review, Vol. 55, Issue 1
Kernel Polynomial Approximations for Densities of States and Spectral Functions
journal, March 1996
- Silver, R. N.; Roeder, H.; Voter, A. F.
- Journal of Computational Physics, Vol. 124, Issue 1
A stochastic estimator of the trace of the influence matrix for laplacian smoothing splines
journal, January 1990
- Hutchinson, M. F.
- Communications in Statistics - Simulation and Computation, Vol. 19, Issue 2
Ab initio molecular dynamics with noisy forces: Validating the quantum Monte Carlo approach with benchmark calculations of molecular vibrational properties
journal, November 2014
- Luo, Ye; Zen, Andrea; Sorella, Sandro
- The Journal of Chemical Physics, Vol. 141, Issue 19
A probing method for computing the diagonal of a matrix inverse
journal, April 2011
- Tang, Jok M.; Saad, Yousef
- Numerical Linear Algebra with Applications, Vol. 19, Issue 3
\mathcal{O}(N) methods in electronic structure calculations
journal, February 2012
- Bowler, D. R.; Miyazaki, T.
- Reports on Progress in Physics, Vol. 75, Issue 3
On the Estimation of Sparse Jacobian Matrices
journal, February 1974
- Curtis, A. R.; Powell, M. J. D.; Reid, J. K.
- IMA Journal of Applied Mathematics, Vol. 13, Issue 1
An iteration method for the solution of the eigenvalue problem of linear differential and integral operators
journal, October 1950
- Lanczos, C.
- Journal of Research of the National Bureau of Standards, Vol. 45, Issue 4
Density functional tight binding
journal, March 2014
- Elstner, Marcus; Seifert, Gotthard
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 372, Issue 2011
Fast Spectral Projection Algorithms for Density-Matrix Computations
journal, June 1999
- Beylkin, Gregory; Coult, Nicholas; Mohlenkamp, Martin J.
- Journal of Computational Physics, Vol. 152, Issue 1
Estimation of Sparse Jacobian Matrices and Graph Coloring Blems
journal, February 1983
- Coleman, Thomas F.; Moré, Jorge J.
- SIAM Journal on Numerical Analysis, Vol. 20, Issue 1
Calculating the density of states and optical-absorption spectra of large quantum systems by the plane-wave moments method
journal, April 1994
- Wang, Lin-Wang
- Physical Review B, Vol. 49, Issue 15
Kernel polynomial method for a nonorthogonal electronic-structure calculation of amorphous diamond
journal, June 1997
- Röder, H.; Silver, R. N.; Drabold, D. A.
- Physical Review B, Vol. 55, Issue 23
FOURIER TRANSFORMATION OF THE n -DIMENSIONAL RADIAL DELTA FUNCTION
journal, January 1961
- Vembu, S.
- The Quarterly Journal of Mathematics, Vol. 12, Issue 1
An estimator for the diagonal of a matrix
journal, November 2007
- Bekas, C.; Kokiopoulou, E.; Saad, Y.
- Applied Numerical Mathematics, Vol. 57, Issue 11-12
Liquid to solid nucleation via onion structure droplets
journal, November 2013
- Barros, Kipton; Klein, W.
- The Journal of Chemical Physics, Vol. 139, Issue 17
Random phase vector for calculating the trace of a large matrix
journal, May 2004
- Iitaka, Toshiaki; Ebisuzaki, Toshikazu
- Physical Review E, Vol. 69, Issue 5
Sublinear scaling for time-dependent stochastic density functional theory
journal, January 2015
- Gao, Yi; Neuhauser, Daniel; Baer, Roi
- The Journal of Chemical Physics, Vol. 142, Issue 3
Linear scaling electronic structure calculations and accurate statistical mechanics sampling with noisy forces
journal, January 2006
- Krajewski, Florian R.; Parrinello, Michele
- Physical Review B, Vol. 73, Issue 4
Self-Averaging Stochastic Kohn-Sham Density-Functional Theory
journal, September 2013
- Baer, Roi; Neuhauser, Daniel; Rabani, Eran
- Physical Review Letters, Vol. 111, Issue 10
SIESTA-PEXSI: massively parallel method for efficient and accurate ab initio materials simulation without matrix diagonalization
journal, July 2014
- Lin, Lin; García, Alberto; Huhs, Georg
- Journal of Physics: Condensed Matter, Vol. 26, Issue 30
Linear-scaling tight binding from a truncated-moment approach
journal, May 1996
- Voter, A. F.; Kress, J. D.; Silver, R. N.
- Physical Review B, Vol. 53, Issue 19
Randomized estimation of spectral densities of large matrices made accurate
journal, August 2016
- Lin, Lin
- Numerische Mathematik, Vol. 136, Issue 1
Shape of magnetic domain walls formed by coupling to mobile charges
journal, September 2017
- Ozawa, Ryo; Hayami, Satoru; Barros, Kipton
- Physical Review B, Vol. 96, Issue 9
Spatial Decay of the Single-Particle Density Matrix in Insulators: Analytic Results in Two and Three Dimensions
journal, April 2002
- Taraskin, S. N.; Drabold, D. A.; Elliott, S. R.
- Physical Review Letters, Vol. 88, Issue 19
Exponential Decay Properties of Wannier Functions and Related Quantities
journal, June 2001
- He, Lixin; Vanderbilt, David
- Physical Review Letters, Vol. 86, Issue 23
Exact results for spatial decay of the one-body density matrix in low-dimensional insulators
journal, October 2004
- Jȩdrzejewski, Janusz; Krokhmalskii, Taras
- Physical Review B, Vol. 70, Issue 15
Resistivity Minimum in Highly Frustrated Itinerant Magnets
journal, November 2016
- Wang, Zhentao; Barros, Kipton; Chern, Gia-Wei
- Physical Review Letters, Vol. 117, Issue 20
Approximating Spectral Densities of Large Matrices
journal, January 2016
- Lin, Lin; Saad, Yousef; Yang, Chao
- SIAM Review, Vol. 58, Issue 1
Maximum entropy approach for linear scaling in the electronic structure problem
journal, June 1993
- Drabold, David A.; Sankey, Otto F.
- Physical Review Letters, Vol. 70, Issue 23
Rational approximation to the Fermi–Dirac function with applications in density functional theory
journal, May 2010
- Sidje, Roger B.; Saad, Yousef
- Numerical Algorithms, Vol. 56, Issue 3
Linear Scaling Self-Consistent Field Calculations with Millions of Atoms in the Condensed Phase
journal, March 2012
- VandeVondele, Joost; Borštnik, Urban; Hutter, Jürg
- Journal of Chemical Theory and Computation, Vol. 8, Issue 10
An efficient and accurate decomposition of the Fermi operator
journal, July 2008
- Ceriotti, Michele; Kühne, Thomas D.; Parrinello, Michele
- The Journal of Chemical Physics, Vol. 129, Issue 2
Semiclassical dynamics of spin density waves
journal, January 2018
- Chern, Gia-Wei; Barros, Kipton; Wang, Zhentao
- Physical Review B, Vol. 97, Issue 3
Extended Lagrangian Density Functional Tight-Binding Molecular Dynamics for Molecules and Solids
journal, June 2015
- Aradi, Bálint; Niklasson, Anders M. N.; Frauenheim, Thomas
- Journal of Chemical Theory and Computation, Vol. 11, Issue 7
Green’s Functions in Quantum Physics
book, January 2006
- Economou, Eleftherios N.
- Springer Series in Solid-State Sciences
Locality of the Density Matrix in Metals, Semiconductors, and Insulators
journal, March 1999
- Ismail-Beigi, Sohrab; Arias, T. A.
- Physical Review Letters, Vol. 82, Issue 10
On approximation by trigonometric sums and polynomials
journal, April 1912
- Jackson, Dunham
- Transactions of the American Mathematical Society, Vol. 13, Issue 4
Equilibrium configurations of large nanostructures using the embedded saturated-fragments stochastic density functional theory
journal, June 2017
- Arnon, Eitam; Rabani, Eran; Neuhauser, Daniel
- The Journal of Chemical Physics, Vol. 146, Issue 22
A Stochastic Estimator of the Trace of the Influence Matrix for Laplacian Smoothing Splines
journal, January 1989
- Hutchinson, M. F.
- Communications in Statistics - Simulation and Computation, Vol. 18, Issue 3
Linear scaling self-consistent field calculations with millions of atoms in the condensed phase
text, January 2012
- VandeVondele, J.; Borštnik, U.; Hutter, J.
- American Chemical Society
Exponential Decay Properties of Wannier Functions and Related Quantities
text, January 2001
- He, Lixin; Vanderbilt, David
- The American Physical Society
Decay properties of spectral projectors with applications to electronic structure
preprint, January 2012
- Benzi, Michele; Boito, Paola; Razouk, Nader
- arXiv
Efficient Langevin Simulation of Coupled Classical Fields and Fermions
text, January 2013
- Barros, Kipton; Kato, Yasuyuki
- arXiv
Liquid to solid nucleation via onion structure droplets
text, January 2013
- Barros, Kipton; Klein, W.
- arXiv
Approximating spectral densities of large matrices
preprint, January 2013
- Lin, Lin; Saad, Yousef; Yang, Chao
- arXiv
Novel magnetic orderings in the kagome Kondo-lattice model
text, January 2014
- Barros, Kipton; Venderbos, Jörn W. F.; Chern, Gia-Wei
- arXiv
Sublinear scaling for time-dependent stochastic density functional theory
text, January 2014
- Gao, Yi; Neuhauser, Daniel; Baer, Roi
- arXiv
Time-dependent Stochastic Bethe-Salpeter Approach
preprint, January 2015
- Rabani, Eran; Baer, Roi; Neuhauser, Daniel
- arXiv
Shape of magnetic domain walls formed by coupling to mobile charges
text, January 2016
- Ozawa, Ryo; Hayami, Satoru; Barros, Kipton
- arXiv
Semiclassical dynamics of spin density waves
text, January 2017
- Chern, Gia-Wei; Barros, Kipton; Wang, Zhentao
- arXiv
Random phase vector for calculating the trace of a large matrix
text, January 2004
- Iitaka, Toshiaki; Ebisuzaki, Toshikazu
- arXiv
The Decay Properties of the Finite Temperature Density Matrix in Metals
text, January 1998
- Goedecker, S.
- arXiv
Works referencing / citing this record:
Anomalous magnetoresistance due to longitudinal spin fluctuations in a Jeff = 1/2 Mott semiconductor
journal, November 2019
- Hao, Lin; Wang, Zhentao; Yang, Junyi
- Nature Communications, Vol. 10, Issue 1
Anomalous Magnetoresistance due to Longitudinal Spin Fluctuations in a Jeff = 1/2 Mott Semiconductor
text, January 2019
- Hao, Lin; Wang, Zhentao; Yang, Junyi
- arXiv
Anomalous magnetoresistance due to longitudinal spin fluctuations in a Jeff = 1/2 Mott semiconductor
journal, November 2019
- Hao, Lin; Wang, Zhentao; Yang, Junyi
- Nature Communications, Vol. 10, Issue 1