Title: Deflation as a method of variance reduction for estimating the trace of a matrix inverse

Abstract

Many fields require computing the trace of the inverse of a large, sparse matrix. The typical method used for such computations is the Hutchinson method which is a Monte Carlo (MC) averaging over matrix quadratures. To improve its convergence, several variance reductions techniques have been proposed. In this paper, we study the effects of deflating the near null singular value space. We make two main contributions. First, we analyze the variance of the Hutchinson method as a function of the deflated singular values and vectors. Although this provides good intuition in general, by assuming additionally that the singular vectors are random unitary matrices, we arrive at concise formulas for the deflated variance that include only the variance and mean of the singular values. We make the remarkable observation that deflation may increase variance for Hermitian matrices but not for non-Hermitian ones. This is a rare, if not unique, property where non-Hermitian matrices outperform Hermitian ones. The theory can be used as a model for predicting the benefits of deflation. Second, we use deflation in the context of a large scale application of "disconnected diagrams" in Lattice QCD. On lattices, Hierarchical Probing (HP) has previously provided an order of magnitude ofmore » variance reduction over MC by removing "error" from neighboring nodes of increasing distance in the lattice. Although deflation used directly on MC yields a limited improvement of 30% in our problem, when combined with HP they reduce variance by a factor of over 150 compared to MC. For this, we pre-computated 1000 smallest singular values of an ill-conditioned matrix of size 25 million. Furthermore, using PRIMME and a domain-specific Algebraic Multigrid preconditioner, we perform one of the largest eigenvalue computations in Lattice QCD at a fraction of the cost of our trace computation.« less

Authors:

Gambhir, Arjun Singh ^[1]; Stathopoulos, Andreas ^[1]; Orginos, Kostas ^[1]

---

+ Show Author Affiliations

1. College of William and Mary, Williamsburg, VA (United States)

Publication Date:

Thu Apr 06 00:00:00 EDT 2017

Research Org.:

Thomas Jefferson National Accelerator Facility (TJNAF), Newport News, VA (United States)

Sponsoring Org.:

USDOE Office of Science (SC), Nuclear Physics (NP)

OSTI Identifier:

1362120

Report Number(s):

JLAB-THY-16-2291; DOE/OR/23177-3870; arXiv:1603.05988
Journal ID: ISSN 1064-8275

Grant/Contract Number:  

AC05-06OR23100; CCF 1218349; ACI S12-SSE 1440700; FC02-12ER41890; FG02-04ER41302; AC05-06OR23177

Resource Type:

Accepted Manuscript

Journal Name:

SIAM Journal on Scientific Computing

Additional Journal Information:

Journal Volume: 39; Journal Issue: 2; Journal ID: ISSN 1064-8275

Publisher:

SIAM

Country of Publication:

United States

Language:

English

Subject:

97 MATHEMATICS AND COMPUTING; deflation; random unitary matrices; Monte Carlo; trace of matrix inverse; Hutchinson; singular values