Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Reducing communication in algebraic multigrid with multi-step node aware communication

Journal Article · · International Journal of High Performance Computing Applications
; ;  [1]
  1. Department of Computer Science, University of Illinois at Urbana–Champaign, Urbana, Illinois, USA

Algebraic multigrid (AMG) is often viewed as a scalable [Formula: see text] solver for sparse linear systems. Yet, AMG lacks parallel scalability due to increasingly large costs associated with communication, both in the initial construction of a multigrid hierarchy and in the iterative solve phase. This work introduces a parallel implementation of AMG that reduces the cost of communication, yielding improved parallel scalability. It is common in Message Passing Interface (MPI), particularly in the MPI-everywhere approach, to arrange inter-process communication, so that communication is transported regardless of the location of the send and receive processes. Performance tests show notable differences in the cost of intra- and internode communication, motivating a restructuring of communication. In this case, the communication schedule takes advantage of the less costly intra-node communication, reducing both the number and the size of internode messages. Node-centric communication extends to the range of components in both the setup and solve phase of AMG, yielding an increase in the weak and strong scaling of the entire method.

Sponsoring Organization:
USDOE
Grant/Contract Number:
NONE; NA0002374
OSTI ID:
1632986
Alternate ID(s):
OSTI ID: 1801083
Journal Information:
International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications Journal Issue: 5 Vol. 34; ISSN 1094-3420
Publisher:
SAGE PublicationsCopyright Statement
Country of Publication:
United States
Language:
English

References (31)

Reducing communication in algebraic multigrid using additive variants: REDUCING COMMUNICATION IN AMG WITH ADDITIVE VARIANTS journal February 2014
Distance-two interpolation for parallel algebraic multigrid journal January 2008
On long-range interpolation operators for aggressive coarsening: INTERPOLATION FOR AGGRESSIVE COARSENING journal December 2009
A high-performance, portable implementation of the MPI message passing interface standard journal September 1996
Graph partitioning models for parallel computing journal November 2000
BoomerAMG: A parallel algebraic multigrid solver and preconditioner journal April 2002
Fast optimal load balancing algorithms for 1D partitioning journal August 2004
Node aware sparse matrix–vector multiplication journal August 2019
Hypergraph-partitioning-based decomposition for parallel sparse-matrix vector multiplication journal July 1999
Exploiting Common Neighborhoods to Optimize MPI Neighborhood Collectives conference December 2017
TRAM: Optimizing Fine-Grained Communication with Topological Routing and Aggregation of Messages
  • Wesolowski, Lukasz; Venkataraman, Ramprasad; Gupta, Abhishek
  • 2014 43nd International Conference on Parallel Processing (ICPP), 2014 43rd International Conference on Parallel Processing https://doi.org/10.1109/ICPP.2014.30
conference September 2014
Exploiting hierarchy in parallel computer networks to optimize collective operation performance conference January 2000
Application-specific topology-aware mapping for three dimensional topologies conference April 2008
Sparse collective operations for MPI conference May 2009
Challenges of Scaling Algebraic Multigrid Across Modern Multicore Architectures
  • Baker, Allison H.; Gamblin, Todd; Schulz, Martin
  • Distributed Processing Symposium (IPDPS), 2011 IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2011.35
conference May 2011
Parallel Smoothed Aggregation Multigrid : Aggregation Strategies on Massively Parallel Machines conference January 2000
Ultrascalable Implicit Finite Element Analyses in Solid Mechanics with over a Half a Billion Degrees of Freedom conference January 2004
Mapping applications with collectives over sub-communicators on torus networks
  • Bhatele, Abhinav; Gamblin, Todd; Langer, Steven H.
  • 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.75
conference November 2012
Reducing Complexity in Parallel Algebraic Multigrid Preconditioners journal January 2006
Multigrid Methods for Variational Problems journal October 1982
On Two-Dimensional Sparse Matrix Partitioning: Models, Methods, and a Recipe journal January 2010
Non-Galerkin Coarse Grids for Algebraic Multigrid journal January 2014
Non-Galerkin Multigrid Based on Sparsified Smoothed Aggregation journal January 2015
Reducing Parallel Communication in Algebraic Multigrid through Sparsification journal January 2016
A Two-Dimensional Data Distribution Method for Parallel Sparse Matrix-Vector Multiplication journal January 2005
Improving communication performance in dense linear algebra via topology aware collectives
  • Solomonik, Edgar; Bhatele, Abhinav; Demmel, James
  • Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063487
conference January 2011
Faster topology-aware collective algorithms through non-minimal communication conference January 2012
Modeling MPI Communication Performance on SMP Nodes: Is it Time to Retire the Ping Pong Test conference January 2016
Asynchronous Task-Based Parallelization of Algebraic Multigrid conference January 2017
Improving Performance Models for Irregular Point-to-Point Communication
  • Bienz, Amanda; Gropp, William D.; Olson, Luke N.
  • EuroMPI'18: 25th European MPI Users' Group Meeting, Proceedings of the 25th European MPI Users' Group Meeting https://doi.org/10.1145/3236367.3236368
conference September 2018
MagPIe: MPI's collective communication operations for clustered wide area systems journal August 1999

Similar Records

Reducing communication in algebraic multigrid with multi-step node aware communication
Journal Article · Thu Jun 11 00:00:00 EDT 2020 · International Journal of High Performance Computing Applications · OSTI ID:1801083

Reducing Communication in Algebraic Multigrid Using Additive Variants
Journal Article · Tue Feb 11 23:00:00 EST 2014 · Numerical Linear Algebra with Applications · OSTI ID:1237550

Parallel performance of algebraic multigrid domain decomposition
Journal Article · Mon Oct 12 00:00:00 EDT 2020 · Numerical Linear Algebra with Applications · OSTI ID:1776659

Related Subjects