Fast synchronization-free algorithms for parallel sparse triangular solves with multiple right-hand sides

Liu, Weifeng; Li, Ang; Hogg, Jonathan D.; Duff, Iain S.; Vinter, Brian

doi:10.1002/cpe.4244

Fast synchronization-free algorithms for parallel sparse triangular solves with multiple right-hand sides

Journal Article · Thu Nov 09 23:00:00 EST 2017 · Concurrency and Computation: Practice and Experience

DOI:https://doi.org/10.1002/cpe.4244· OSTI ID:1557091

Liu, Weifeng ^[1]; Li, Ang ^[2]; Hogg, Jonathan D. ^[3]; Duff, Iain S. ^[3]; Vinter, Brian ^[1]

University of Copenhagen
BATTELLE (PACIFIC NW LAB)
STFC Rutherford Appleton Laboratory, UK

The sparse triangular solve kernels, SpTRSV and SpTRSM, are important building blocks for a number of numerical linear algebra routines. Parallelizing SpTRSV and SpTRSM on today's many-core platforms, such as GPUs, is not an easy task since computing a component of the solution may depend on previously computed components, enforcing a degree of sequential processing. As a consequence, most existing work introduces a preprocessing stage to partition the components into a group of level-sets or colour-sets so that components within a set are independent and can be processed simultaneously during the subsequent solution stage. However, this class of methods requires a long preprocessing time as well as significant runtime synchronization over-heads between the sets. To address this, we

Research Organization:: Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: AC05-76RL01830

OSTI ID:: 1557091

Report Number(s):: PNNL-SA-130501

Journal Information:: Concurrency and Computation: Practice and Experience, Journal Name: Concurrency and Computation: Practice and Experience Journal Issue: 21 Vol. 29

Country of Publication:: United States

Language:: English

References (17)

Solving Sparse Triangular Linear Systems on Parallel Computers Anderson, Edward; Saad, Youcef International Journal of High Speed Computing, Vol. 01, Issue 01 https://doi.org/10.1142/S0129053389000056	journal	May 1989
Numerical Methods for Least Squares Problems Björck, Åke Society for Industrial and Applied Mathematics https://doi.org/10.1137/1.9781611971484	book	January 1996
Structure-adaptive parallel solution of sparse triangular linear systems Totoni, Ehsan; Heath, Michael T.; Kale, Laxmikant V. Parallel Computing, Vol. 40, Issue 9 https://doi.org/10.1016/j.parco.2014.06.006	journal	October 2014
A framework for general sparse matrix–matrix multiplication on GPUs and heterogeneous processors Liu, Weifeng; Vinter, Brian Journal of Parallel and Distributed Computing, Vol. 85 https://doi.org/10.1016/j.jpdc.2015.06.010	journal	November 2015
Iterative Methods for Sparse Linear Systems Saad, Yousef https://doi.org/10.1137/1.9780898718003	book	January 2003
Aggregation Methods for Solving Sparse Triangular Systems on Multiprocessors Saltz, Joel H. SIAM Journal on Scientific and Statistical Computing, Vol. 11, Issue 1 https://doi.org/10.1137/0911008	journal	January 1990
A Fast Dense Triangular Solve in CUDA Hogg, J. D. SIAM Journal on Scientific Computing, Vol. 35, Issue 3 https://doi.org/10.1137/12088358X	journal	January 2013
The university of Florida sparse matrix collection Davis, Timothy A.; Hu, Yifan ACM Transactions on Mathematical Software, Vol. 38, Issue 1 https://doi.org/10.1145/2049662.2049663	journal	November 2011
GPU-accelerated preconditioned iterative linear solvers Li, Ruipeng; Saad, Yousef The Journal of Supercomputing, Vol. 63, Issue 2 https://doi.org/10.1007/s11227-012-0825-3	journal	October 2012
A Cross-Platform SpMV Framework on Many-Core Architectures Zhang, Yunquan; Li, Shigang; Yan, Shengen ACM Transactions on Architecture and Code Optimization, Vol. 13, Issue 4 https://doi.org/10.1145/2994148	journal	October 2016
The design of MA48: a code for the direct solution of sparse unsymmetric linear systems of equations Duff, I. S.; Reid, J. K. ACM Transactions on Mathematical Software, Vol. 22, Issue 2 https://doi.org/10.1145/229473.229476	journal	June 1996
Scaling synchronization in multicore programs Morrison, Adam Communications of the ACM, Vol. 59, Issue 11 https://doi.org/10.1145/2980987	journal	October 2016
Sparse triangular solves for ILU revisited: data layout crucial to better performance Smith, Barry; Zhang, Hong The International Journal of High Performance Computing Applications, Vol. 25, Issue 4 https://doi.org/10.1177/1094342010389857	journal	December 2010
Speculative segmented sum for sparse matrix-vector multiplication on heterogeneous processors Liu, Weifeng; Vinter, Brian Parallel Computing, Vol. 49 https://doi.org/10.1016/j.parco.2015.04.004	journal	November 2015
An overview of the sparse basic linear algebra subprograms: The new standard from the BLAS technical forum Duff, Iain S.; Heroux, Michael A.; Pozo, Roldan ACM Transactions on Mathematical Software, Vol. 28, Issue 2 https://doi.org/10.1145/567806.567810	journal	June 2002
Parallel algorithms for solving linear systems with sparse triangular matrices Mayer, Jan Computing, Vol. 86, Issue 4 https://doi.org/10.1007/s00607-009-0066-3	journal	September 2009
Fine-Grained Parallel Incomplete LU Factorization Chow, Edmond; Patel, Aftab SIAM Journal on Scientific Computing, Vol. 37, Issue 2 https://doi.org/10.1137/140968896	journal	January 2015

Similar Records

Fast synchronization‐free algorithms for parallel sparse triangular solves with multiple right‐hand sides

Journal Article · Sun Jul 30 00:00:00 EDT 2017 · Concurrency and Computation. Practice and Experience · OSTI ID:1398070

Fast and Scalable Sparse Triangular Solver for Multi-GPU Based HPC Architectures

Conference · Mon Aug 09 00:00:00 EDT 2021 · OSTI ID:1830211

Unified Communication Optimization Strategies for Sparse Triangular Solver on CPU and GPU Clusters

Conference · Wed Nov 01 00:00:00 EDT 2023 · OSTI ID:2438981

Related Subjects

HPC

Fast synchronization-free algorithms for parallel sparse triangular solves with multiple right-hand sides

Citation Formats

References (17)

Similar Records

Related Subjects