An Algebraic Multilevel Preconditioner with Low-Rank Corrections for Sparse Symmetric Matrices

Xi, Yuanzhe; Li, Ruipeng; Saad, Yousef

doi:10.1137/15m1021830

An Algebraic Multilevel Preconditioner with Low-Rank Corrections for Sparse Symmetric Matrices

Journal Article · Wed Mar 02 23:00:00 EST 2016 · SIAM Journal on Matrix Analysis and Applications

DOI:https://doi.org/10.1137/15m1021830· OSTI ID:1756735

Xi, Yuanzhe ^[1]; Li, Ruipeng ^[2]; Saad, Yousef ^[1]

Univ. of Minnesota, Twin Cities, MN (United States)
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)

In this work, we describe a multilevel preconditioning technique for solving sparse symmetric linear systems of equations. This “Multilevel Schur Low-Rank” (MSLR) preconditioner first builds a tree structure $$\mathcal{T}$$ based on a hierarchical decomposition of the matrix and then computes an approximate inverse of the original matrix level by level. Unlike classical direct solvers, the construction of the MSLR preconditioner follows a top-down traversal of $$\mathcal{T}$$ and exploits a low-rank property that is satisfied by the difference between the inverses of the local Schur complements and specific blocks of the original matrix. A few steps of the generalized Lanczos tridiagonalization procedure are applied to capture most of this difference. Numerical results are reported to illustrate the efficiency and robustness of the MSLR preconditioner with both two- and three-dimensional discretized PDE problems and with publicly available test problems.

View Accepted Manuscript (DOE)

Research Organization:: Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC52-07NA27344

OSTI ID:: 1756735

Report Number(s):: LLNL-JRNL--680317; 804288

Journal Information:: SIAM Journal on Matrix Analysis and Applications, Journal Name: SIAM Journal on Matrix Analysis and Applications Journal Issue: 1 Vol. 37; ISSN 0895-4798

Publisher:: SIAMCopyright Statement

Country of Publication:: United States

Language:: English

References (34)

Sweeping preconditioner for the Helmholtz equation: Hierarchical matrix representation Engquist, Björn; Ying, Lexing Communications on Pure and Applied Mathematics, Vol. 64, Issue 5 https://doi.org/10.1002/cpa.20358	journal	February 2011
ARMS: an algebraic recursive multilevel solver for general sparse linear systems Saad, Y.; Suchomel, B. Numerical Linear Algebra with Applications, Vol. 9, Issue 5 https://doi.org/10.1002/nla.279	journal	January 2002
Fast algorithms for hierarchically semiseparable matrices Xia, Jianlin; Chandrasekaran, Shivkumar; Gu, Ming Numerical Linear Algebra with Applications, Vol. 17, Issue 6 https://doi.org/10.1002/nla.691	journal	November 2010
ℋ-matrices for Convection-diffusion Problems with Constant Convection Borne, Sabine Le Computing, Vol. 70, Issue 3 https://doi.org/10.1007/s00607-003-1474-4	journal	June 2003
Adaptive-Multilevel BDDC and its parallel implementation Sousedík, Bedřich; Šístek, Jakub; Mandel, Jan Computing, Vol. 95, Issue 12 https://doi.org/10.1007/s00607-013-0293-5	journal	January 2013
Semi On-Line Scheduling on Two Identical Machines He, Y.; Zhang, G. Computing, Vol. 62, Issue 3 https://doi.org/10.1007/s006070050020	journal	June 1999
GPU-accelerated preconditioned iterative linear solvers Li, Ruipeng; Saad, Yousef The Journal of Supercomputing, Vol. 63, Issue 2 https://doi.org/10.1007/s11227-012-0825-3	journal	October 2012
Experimental study of ILU preconditioners for indefinite matrices Chow, Edmond; Saad, Yousef Journal of Computational and Applied Mathematics, Vol. 86, Issue 2 https://doi.org/10.1016/S0377-0427(97)00171-4	journal	December 1997
An O ( N ) direct solver for integral equations on the plane Corona, Eduardo; Martinsson, Per-Gunnar; Zorin, Denis Applied and Computational Harmonic Analysis, Vol. 38, Issue 2 https://doi.org/10.1016/j.acha.2014.04.002	journal	March 2015
A fast direct solver for boundary integral equations in two dimensions Martinsson, P. G.; Rokhlin, V. Journal of Computational Physics, Vol. 205, Issue 1 https://doi.org/10.1016/j.jcp.2004.10.033	journal	May 2005
Adaptive BDDC in three dimensions Mandel, Jan; Sousedík, Bedřich; Šístek, Jakub Mathematics and Computers in Simulation, Vol. 82, Issue 10 https://doi.org/10.1016/j.matcom.2011.03.014	journal	June 2012
A Parallel Multistage ILU Factorization Based on a Hierarchical Graph Decomposition Hénon, Pascal; Saad, Yousef SIAM Journal on Scientific Computing, Vol. 28, Issue 6 https://doi.org/10.1137/040608258	journal	January 2006
H-matrix Preconditioners in Convection-Dominated Problems Le Borne, Sabine; Grasedyck, Lars SIAM Journal on Matrix Analysis and Applications, Vol. 27, Issue 4 https://doi.org/10.1137/040615845	journal	January 2006
Optimized Multiplicative, Additive, and Restricted Additive Schwarz Preconditioning St-Cyr, A.; Gander, M. J.; Thomas, S. J. SIAM Journal on Scientific Computing, Vol. 29, Issue 6 https://doi.org/10.1137/060652610	journal	January 2007
Nested Dissection of a Regular Finite Element Mesh George, Alan SIAM Journal on Numerical Analysis, Vol. 10, Issue 2 https://doi.org/10.1137/0710032	journal	April 1973
GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems Saad, Youcef; Schultz, Martin H. SIAM Journal on Scientific and Statistical Computing, Vol. 7, Issue 3 https://doi.org/10.1137/0907058	journal	July 1986
Superfast Multifrontal Method for Large Structured Linear Systems of Equations Xia, Jianlin; Chandrasekaran, Shivkumar; Gu, Ming SIAM Journal on Matrix Analysis and Applications, Vol. 31, Issue 3 https://doi.org/10.1137/09074543X	journal	January 2010
Robust Approximate Cholesky Factorization of Rank-Structured Symmetric Positive Definite Matrices Xia, Jianlin; Gu, Ming SIAM Journal on Matrix Analysis and Applications, Vol. 31, Issue 5 https://doi.org/10.1137/090750500	journal	January 2010
A Flexible Inner-Outer Preconditioned GMRES Algorithm Saad, Youcef SIAM Journal on Scientific Computing, Vol. 14, Issue 2 https://doi.org/10.1137/0914028	journal	March 1993
ILUM: A Multi-Elimination ILU Preconditioner for General Sparse Matrices Saad, Y. SIAM Journal on Scientific Computing, Vol. 17, Issue 4 https://doi.org/10.1137/0917054	journal	July 1996
Efficient Structured Multifrontal Factorization for General Large Sparse Matrices Xia, Jianlin SIAM Journal on Scientific Computing, Vol. 35, Issue 2 https://doi.org/10.1137/120867032	journal	January 2013
Randomized Sparse Direct Solvers Xia, Jianlin SIAM Journal on Matrix Analysis and Applications, Vol. 34, Issue 1 https://doi.org/10.1137/12087116X	journal	January 2013
Divide and Conquer Low-Rank Preconditioners for Symmetric Matrices Li, Ruipeng; Saad, Yousef SIAM Journal on Scientific Computing, Vol. 35, Issue 4 https://doi.org/10.1137/120872735	journal	January 2013
Superfast and Stable Structured Solvers for Toeplitz Least Squares via Randomized Sampling Xi, Yuanzhe; Xia, Jianlin; Cauley, Stephen SIAM Journal on Matrix Analysis and Applications, Vol. 35, Issue 1 https://doi.org/10.1137/120895755	journal	January 2014
A Fast Randomized Eigensolver with Structured LDL Factorization Update Xi, Yuanzhe; Xia, Jianlin; Chan, Raymond SIAM Journal on Matrix Analysis and Applications, Vol. 35, Issue 3 https://doi.org/10.1137/130914966	journal	January 2014
A Direct Solver with $O(N)$ Complexity for Variable Coefficient Elliptic PDEs Discretized via a High-Order Composite Spectral Collocation Method Gillman, A.; Martinsson, P. G. SIAM Journal on Scientific Computing, Vol. 36, Issue 4 https://doi.org/10.1137/130918988	journal	January 2014
Preconditioned Krylov Subspace Methods for Sampling Multivariate Gaussian Distributions Chow, Edmond; Saad, Yousef SIAM Journal on Scientific Computing, Vol. 36, Issue 2 https://doi.org/10.1137/130920587	journal	January 2014
An Approximate Minimum Degree Ordering Algorithm Amestoy, Patrick R.; Davis, Timothy A.; Duff, Iain S. SIAM Journal on Matrix Analysis and Applications, Vol. 17, Issue 4 https://doi.org/10.1137/S0895479894278952	journal	October 1996
Approximate Inverse Preconditioners via Sparse-Sparse Iterations Chow, Edmond; Saad, Yousef SIAM Journal on Scientific Computing, Vol. 19, Issue 3 https://doi.org/10.1137/S1064827594270415	journal	May 1998
A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs Karypis, George; Kumar, Vipin SIAM Journal on Scientific Computing, Vol. 20, Issue 1 https://doi.org/10.1137/S1064827595287997	journal	January 1998
A Sparse Approximate Inverse Preconditioner for Nonsymmetric Linear Systems Benzi, Michele; Tuma, Miroslav SIAM Journal on Scientific Computing, Vol. 19, Issue 3 https://doi.org/10.1137/S1064827595294691	journal	May 1998
BILUM: Block Versions of Multielimination and Multilevel ILU Preconditioner for General Sparse Linear Systems Saad, Yousef; Zhang, Jun SIAM Journal on Scientific Computing, Vol. 20, Issue 6 https://doi.org/10.1137/S106482759732753X	journal	January 1999
Algorithm 837 Amestoy, Patrick R.; Davis, Timothy A.; Duff, Iain S. ACM Transactions on Mathematical Software, Vol. 30, Issue 3, p. 381-388 https://doi.org/10.1145/1024074.1024081	journal	September 2004
Methods of conjugate gradients for solving linear systems Hestenes, M. R.; Stiefel, E. Journal of Research of the National Bureau of Standards, Vol. 49, Issue 6 https://doi.org/10.6028/jres.049.044	journal	December 1952

Cited By (2)

Multilevel approaches for FSAI preconditioning: MULTILEVEL APPROACHES FOR FSAI PRECONDITIONING Magri, Victor A. P.; Franceschini, Andrea; Ferronato, Massimiliano Numerical Linear Algebra with Applications, Vol. 25, Issue 5 https://doi.org/10.1002/nla.2183	journal	April 2018
Parallel Multiprojection Preconditioned Methods Based on Subspace Compression Moutafis, Byron E.; Filelis-Papadopoulos, Christos K.; Gravvanis, George A. Mathematical Problems in Engineering, Vol. 2017 https://doi.org/10.1155/2017/2580820	journal	January 2017

Similar Records

Low-Rank Correction Methods for Algebraic Domain Decomposition Preconditioners

Journal Article · Tue Aug 01 00:00:00 EDT 2017 · SIAM Journal on Matrix Analysis and Applications · OSTI ID:1438714

Approximate inverse preconditioners for general sparse matrices

Conference · Fri Dec 30 23:00:00 EST 1994 · OSTI ID:219599

Fast wavelet based sparse approximate inverse preconditioner

Conference · Mon Dec 30 23:00:00 EST 1996 · OSTI ID:433357

Related Subjects

97 MATHEMATICS AND COMPUTING
Krylove subspace methods
Nested Dissection ordering
Schur complements
domain decomposition
incomplete factorization
low-rank approximation
multilevel preconditioner

An Algebraic Multilevel Preconditioner with Low-Rank Corrections for Sparse Symmetric Matrices

Citation Formats

References (34)

Cited By (2)

Similar Records

Related Subjects