Reducing communication in algebraic multigrid with multi-step node aware communication

Bienz, Amanda; Gropp, William D.; Olson, Luke N.

doi:10.1177/1094342020925535

Reducing communication in algebraic multigrid with multi-step node aware communication

Journal Article · Thu Jun 11 00:00:00 EDT 2020 · International Journal of High Performance Computing Applications

DOI:https://doi.org/10.1177/1094342020925535· OSTI ID:1801083

^[1]; Gropp, William D.; Olson, Luke N. ^[2]

OSTI
Department of Computer Science, University of Illinois at Urbana–Champaign, Urbana, Illinois, USA

Algebraic multigrid (AMG) is often viewed as a scalable [Formula: see text] solver for sparse linear systems. Yet, AMG lacks parallel scalability due to increasingly large costs associated with communication, both in the initial construction of a multigrid hierarchy and in the iterative solve phase. This work introduces a parallel implementation of AMG that reduces the cost of communication, yielding improved parallel scalability. It is common in Message Passing Interface (MPI), particularly in the MPI-everywhere approach, to arrange inter-process communication, so that communication is transported regardless of the location of the send and receive processes. Performance tests show notable differences in the cost of intra- and internode communication, motivating a restructuring of communication. In this case, the communication schedule takes advantage of the less costly intra-node communication, reducing both the number and the size of internode messages. Node-centric communication extends to the range of components in both the setup and solve phase of AMG, yielding an increase in the weak and strong scaling of the entire method.

Research Organization:: Univ. of Illinois at Urbana-Champaign, IL (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

DOE Contract Number:: NA0002374

OSTI ID:: 1801083

Journal Information:: International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications Journal Issue: 5 Vol. 34; ISSN 1094-3420

Publisher:: SAGE

Country of Publication:: United States

Language:: English

References (28)

Reducing Parallel Communication in Algebraic Multigrid through Sparsification Bienz, Amanda; Falgout, Robert D.; Gropp, William SIAM Journal on Scientific Computing, Vol. 38, Issue 5 https://doi.org/10.1137/15M1026341	journal	January 2016
Exploiting hierarchy in parallel computer networks to optimize collective operation performance Karonis, N. T.; de Supinski, B. R.; Foster, I. Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000 https://doi.org/10.1109/IPDPS.2000.846009	conference	January 2000
Asynchronous Task-Based Parallelization of Algebraic Multigrid AlOnazi, Amani; Markomanolis, George S.; Keyes, David Proceedings of the Platform for Advanced Scientific Computing Conference on - PASC '17 https://doi.org/10.1145/3093172.3093230	conference	January 2017
Exploiting Common Neighborhoods to Optimize MPI Neighborhood Collectives Mirsadeghi, Seyed H.; Traff, Jesper Larsson; Balaji, Pavan 2017 IEEE 24th International Conference on High Performance Computing (HiPC) https://doi.org/10.1109/HiPC.2017.00047	conference	December 2017
Ultrascalable Implicit Finite Element Analyses in Solid Mechanics with over a Half a Billion Degrees of Freedom Adams, M. F.; Bayraktar, H. H.; Keaveny, T. M. Proceedings of the ACM/IEEE SC2004 Conference https://doi.org/10.1109/SC.2004.62	conference	January 2004
On long-range interpolation operators for aggressive coarsening: INTERPOLATION FOR AGGRESSIVE COARSENING Yang, Ulrike Meier Numerical Linear Algebra with Applications, Vol. 17, Issue 2-3 https://doi.org/10.1002/nla.689	journal	December 2009
Improving Performance Models for Irregular Point-to-Point Communication Bienz, Amanda; Gropp, William D.; Olson, Luke N. EuroMPI'18: 25th European MPI Users' Group Meeting, Proceedings of the 25th European MPI Users' Group Meeting https://doi.org/10.1145/3236367.3236368	conference	September 2018
Graph partitioning models for parallel computing Hendrickson, Bruce; Kolda, Tamara G. Parallel Computing, Vol. 26, Issue 12 https://doi.org/10.1016/S0167-8191(00)00048-X	journal	November 2000
On Two-Dimensional Sparse Matrix Partitioning: Models, Methods, and a Recipe Çatalyürek, Ümt V.; Aykanat, Cevdet; Uçar, Bora SIAM Journal on Scientific Computing, Vol. 32, Issue 2 https://doi.org/10.1137/080737770	journal	January 2010
Application-specific topology-aware mapping for three dimensional topologies Bhatele, Abhinav; Kale, Laxmikant V. Distributed Processing Symposium (IPDPS), 2008 IEEE International Symposium on Parallel and Distributed Processing https://doi.org/10.1109/IPDPS.2008.4536348	conference	April 2008
Distance-two interpolation for parallel algebraic multigrid De Sterck, Hans; Falgout, Robert D.; Nolting, Joshua W. Numerical Linear Algebra with Applications, Vol. 15, Issue 2-3 https://doi.org/10.1002/nla.559	journal	January 2008
Faster topology-aware collective algorithms through non-minimal communication Sack, Paul; Gropp, William Proceedings of the 17th ACM SIGPLAN symposium on Principles and Practice of Parallel Programming - PPoPP '12 https://doi.org/10.1145/2145816.2145823	conference	January 2012
Challenges of Scaling Algebraic Multigrid Across Modern Multicore Architectures Baker, Allison H.; Gamblin, Todd; Schulz, Martin Distributed Processing Symposium (IPDPS), 2011 IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2011.35	conference	May 2011
Multigrid Methods for Variational Problems McCormick, S. F.; Ruge, J. W. SIAM Journal on Numerical Analysis, Vol. 19, Issue 5 https://doi.org/10.1137/0719067	journal	October 1982
Non-Galerkin Coarse Grids for Algebraic Multigrid Falgout, Robert D.; Schroder, Jacob B. SIAM Journal on Scientific Computing, Vol. 36, Issue 3 https://doi.org/10.1137/130931539	journal	January 2014
Improving communication performance in dense linear algebra via topology aware collectives Solomonik, Edgar; Bhatele, Abhinav; Demmel, James Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063487	conference	January 2011
Fast optimal load balancing algorithms for 1D partitioning Pınar, Ali; Aykanat, Cevdet Journal of Parallel and Distributed Computing, Vol. 64, Issue 8 https://doi.org/10.1016/j.jpdc.2004.05.003	journal	August 2004
Reducing Complexity in Parallel Algebraic Multigrid Preconditioners De Sterck, Hans; Yang, Ulrike Meier; Heys, Jeffrey J. SIAM Journal on Matrix Analysis and Applications, Vol. 27, Issue 4 https://doi.org/10.1137/040615729	journal	January 2006
A Two-Dimensional Data Distribution Method for Parallel Sparse Matrix-Vector Multiplication Vastenhouw, Brendan; Bisseling, Rob H. SIAM Review, Vol. 47, Issue 1 https://doi.org/10.1137/S0036144502409019	journal	January 2005
Sparse collective operations for MPI Hoefler, Torsten; Traff, Jesper Larsson Distributed Processing (IPDPS), 2009 IEEE International Symposium on Parallel & Distributed Processing https://doi.org/10.1109/IPDPS.2009.5160935	conference	May 2009
TRAM: Optimizing Fine-Grained Communication with Topological Routing and Aggregation of Messages Wesolowski, Lukasz; Venkataraman, Ramprasad; Gupta, Abhishek 2014 43nd International Conference on Parallel Processing (ICPP), 2014 43rd International Conference on Parallel Processing https://doi.org/10.1109/ICPP.2014.30	conference	September 2014
Non-Galerkin Multigrid Based on Sparsified Smoothed Aggregation Treister, Eran; Yavneh, Irad SIAM Journal on Scientific Computing, Vol. 37, Issue 1 https://doi.org/10.1137/140952570	journal	January 2015
Parallel Smoothed Aggregation Multigrid : Aggregation Strategies on Massively Parallel Machines Tuminaro, R. S.; Tong, C. ACM/IEEE SC 2000 Conference (SC'00) https://doi.org/10.1109/SC.2000.10008	conference	January 2000
Hypergraph-partitioning-based decomposition for parallel sparse-matrix vector multiplication Catalyurek, U. V.; Aykanat, C. IEEE Transactions on Parallel and Distributed Systems, Vol. 10, Issue 7 https://doi.org/10.1109/71.780863	journal	July 1999
BoomerAMG: A parallel algebraic multigrid solver and preconditioner Henson, Van Emden; Yang, Ulrike Meier Applied Numerical Mathematics, Vol. 41, Issue 1 https://doi.org/10.1016/S0168-9274(01)00115-5	journal	April 2002
Mapping applications with collectives over sub-communicators on torus networks Bhatele, Abhinav; Gamblin, Todd; Langer, Steven H. 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.75	conference	November 2012
Modeling MPI Communication Performance on SMP Nodes: Is it Time to Retire the Ping Pong Test Gropp, William; Olson, Luke N.; Samfass, Philipp Proceedings of the 23rd European MPI Users' Group Meeting on - EuroMPI 2016 https://doi.org/10.1145/2966884.2966919	conference	January 2016
MagPIe: MPI's collective communication operations for clustered wide area systems Kielmann, Thilo; Hofman, Rutger F. H.; Bal, Henri E. ACM SIGPLAN Notices, Vol. 34, Issue 8 https://doi.org/10.1145/329366.301116	journal	August 1999

Similar Records

Reducing communication in algebraic multigrid with multi-step node aware communication

Journal Article · Thu Jun 11 00:00:00 EDT 2020 · International Journal of High Performance Computing Applications · OSTI ID:1632986

Reducing Communication in Algebraic Multigrid Using Additive Variants

Journal Article · Tue Feb 11 23:00:00 EST 2014 · Numerical Linear Algebra with Applications · OSTI ID:1237550

Parallel performance of algebraic multigrid domain decomposition

Journal Article · Mon Oct 12 00:00:00 EDT 2020 · Numerical Linear Algebra with Applications · OSTI ID:1776659

Related Subjects

Computer Science

Reducing communication in algebraic multigrid with multi-step node aware communication

Citation Formats

References (28)

Similar Records

Related Subjects