Incomplete Sparse Approximate Inverses for Parallel Preconditioning

Anzt, Hartwig; Huckle, Thomas K.; Bräckle, Jürgen; Dongarra, Jack

doi:10.1016/j.parco.2017.10.003

Title: Incomplete Sparse Approximate Inverses for Parallel Preconditioning

Abstract

In this study, we propose a new preconditioning method that can be seen as a generalization of block-Jacobi methods, or as a simplification of the sparse approximate inverse (SAI) preconditioners. The “Incomplete Sparse Approximate Inverses” (ISAI) is in particular efficient in the solution of sparse triangular linear systems of equations. Those arise, for example, in the context of incomplete factorization preconditioning. ISAI preconditioners can be generated via an algorithm providing fine-grained parallelism, which makes them attractive for hardware with a high concurrency level. Finally, in a study covering a large number of matrices, we identify the ISAI preconditioner as an attractive alternative to exact triangular solves in the context of incomplete factorization preconditioning.

Authors:

Anzt, Hartwig ^[1]; Huckle, Thomas K. ^[2]; Bräckle, Jürgen ^[2]; Dongarra, Jack ^[3]

Karlsruhe Inst. of Technology (KIT) (Germany); Univ. of Tennessee, Knoxville, TN (United States). Innovative Computing Lab.
Technical Univ. of Munich (Germany). Dept. of Informatics
Univ. of Tennessee, Knoxville, TN (United States). Innovative Computing Lab.; Univ. of Manchester (United Kingdom). School of Computer Science; Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

Publication Date:: 2017-10-28

Research Org.:: Univ. of Tennessee, Knoxville, TN (United States)

Sponsoring Org.:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE National Nuclear Security Administration (NNSA)

OSTI Identifier:: 1407456

Alternate Identifier(s):: OSTI ID: 1511776

Grant/Contract Number:: SC0016513

Resource Type:: Accepted Manuscript

Journal Name:: Parallel Computing

Additional Journal Information:: Journal Volume: 71; Journal ID: ISSN 0167-8191

Publisher:: Elsevier

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING; preconditioning; incomplete sparse approximate inverse; incomplete LU factorization; approximate sparse triangular solves; parallel computing

Citation Formats


                    Anzt, Hartwig, Huckle, Thomas K., Bräckle, Jürgen, and Dongarra, Jack. Incomplete Sparse Approximate Inverses for Parallel Preconditioning.  United States: N. p., 2017. 
        Web.  doi:10.1016/j.parco.2017.10.003.

Copy to clipboard


                    Anzt, Hartwig, Huckle, Thomas K., Bräckle, Jürgen, & Dongarra, Jack. Incomplete Sparse Approximate Inverses for Parallel Preconditioning.  United States.  doi:https://doi.org/10.1016/j.parco.2017.10.003

Copy to clipboard


                    Anzt, Hartwig, Huckle, Thomas K., Bräckle, Jürgen, and Dongarra, Jack. Sat .  
        "Incomplete Sparse Approximate Inverses for Parallel Preconditioning".  United States.  doi:https://doi.org/10.1016/j.parco.2017.10.003.  https://www.osti.gov/servlets/purl/1407456.

Copy to clipboard


                    
@article{osti_1407456,

  title        = {Incomplete Sparse Approximate Inverses for Parallel Preconditioning},

  author       = {Anzt, Hartwig and Huckle, Thomas K. and Bräckle, Jürgen and Dongarra, Jack},

  abstractNote = {In this study, we propose a new preconditioning method that can be seen as a generalization of block-Jacobi methods, or as a simplification of the sparse approximate inverse (SAI) preconditioners. The “Incomplete Sparse Approximate Inverses” (ISAI) is in particular efficient in the solution of sparse triangular linear systems of equations. Those arise, for example, in the context of incomplete factorization preconditioning. ISAI preconditioners can be generated via an algorithm providing fine-grained parallelism, which makes them attractive for hardware with a high concurrency level. Finally, in a study covering a large number of matrices, we identify the ISAI preconditioner as an attractive alternative to exact triangular solves in the context of incomplete factorization preconditioning.},

  doi          = {10.1016/j.parco.2017.10.003},

  journal      = {Parallel Computing},

  number       = ,

  volume       = 71,

  place        = {United States},

  year         = {2017},

  month        = {10}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (Publisher)

Accepted Manuscript (DOE)

Publisher's Version of Record

DOI: https://doi.org/10.1016/j.parco.2017.10.003

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 2 works

Citation information provided by
Web of Science

Save / Share:

Export Metadata

Save to My Library

Works referencing / citing this record:

An efficient sparse approximate inverse preconditioning algorithm on GPU
journal, November 2019

He, Guixia; Yin, Renjie; Gao, Jiaquan
Concurrency and Computation: Practice and Experience, Vol. 32, Issue 7
DOI: 10.1002/cpe.5598

Similar Records in DOE PAGES and OSTI.GOV collections:

Performance analysis of high quality parallel preconditioners applied to 3D finite element structural analysis

Conference Kolotilina, L ; Nikishin, A ; Yeremin, A

The solution of large systems of linear equations is a crucial bottleneck when performing 3D finite element analysis of structures. Also, in many cases the reliability and robustness of iterative solution strategies, and their efficiency when exploiting hardware resources, fully determine the scope of industrial applications which can be solved on a particular computer platform. This is especially true for modern vector/parallel supercomputers with large vector length and for modern massively parallel supercomputers. Preconditioned iterative methods have been successfully applied to industrial class finite element analysis of structures. The construction and application of high quality preconditioners constitutes a high percentagemore »« less
Full Text Available
Approximate inverse preconditioners for general sparse matrices

Conference Chow, E ; Saad, Y

Preconditioned Krylov subspace methods are often very efficient in solving sparse linear matrices that arise from the discretization of elliptic partial differential equations. However, for general sparse indifinite matrices, the usual ILU preconditioners fail, often because of the fact that the resulting factors L and U give rise to unstable forward and backward sweeps. In such cases, alternative preconditioners based on approximate inverses may be attractive. We are currently developing a number of such preconditioners based on iterating on each column to get the approximate inverse. For this approach to be efficient, the iteration must be done in sparse mode,more »« less
Full Text Available
Experience with the incomplete Cholesky conjugate gradient method in a diffusion code

Journal Article Hoebel, W - Nucl. Sci. Eng.; (United States)

For the numerical solution of sparse systems of linear equations arising from the finite difference approximation of the multidimensional neutron diffusion equation, fast methods are needed. Effective algorithms for scalar computers may not be likewise suitable on vector computers. In the improved version (DIXY2) of the Karlsruhe two-dimensional neutron diffusion code for rectangular geometries, an incomplete Cholesky conjugate gradient (ICCG) algorithm has been combined with the originally implemented cyclically reduced four-line successive overrelaxation (CR4LSOR) inner iteration method. The combined procedure is automatically activated for slowly converging applications, thus leading to a drastic reduction of iterations as well as CPU timesmore »« less
Fast wavelet based sparse approximate inverse preconditioner

Conference Wan, W L

Incomplete LU factorization is a robust preconditioner for both general and PDE problems but unfortunately not easy to parallelize. Recent study of Huckle and Grote and Chow and Saad showed that sparse approximate inverse could be a potential alternative while readily parallelizable. However, for special class of matrix A that comes from elliptic PDE problems, their preconditioners are not optimal in the sense that independent of mesh size. A reason may be that no good sparse approximate inverse exists for the dense inverse matrix. Our observation is that for this kind of matrices, its inverse entries typically have piecewise smoothmore »« less
Full Text Available
Effective parallel preconditioning with sparse approximate inverses

Conference Grote, M ; Huckle, T

A parallel preconditioner is presented for the solution of general sparse linear systems of equations. A sparse approximate inverse is computed explicitly, and then applied as a preconditioner to an iterative method. The computation of the preconditioner is inherently parallel, and its application only requires a matrix-vector product. The sparsity pattern of the approximate inverse is not imposed a priori but captured automatically. This keeps the amount of work and the number of nonzero entries in the preconditioner to a minimum. An extensive set of test problems from scientific and industrial applications provides convincing evidence of the effectiveness of thismore » new approach.« less

Similar Records

Title: Incomplete Sparse Approximate Inverses for Parallel Preconditioning

Abstract

Citation Formats

An efficient sparse approximate inverse preconditioning algorithm on GPU journal, November 2019

An efficient sparse approximate inverse preconditioning algorithm on GPU
journal, November 2019