skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A performance model for the communication in fast multipole methods on high-performance computing platforms

Journal Article · · International Journal of High Performance Computing Applications
 [1];  [1];  [1]
  1. Division of Computer, Electrical and Mathematical Sciences and Engineering King Abdullah University of Science and Technology, Thuwal, Saudi Arabia

Exascale systems are predicted to have approximately 1 billion cores, assuming gigahertz cores. Limitations on affordable network topologies for distributed memory systems of such massive scale bring new challenges to the currently dominant parallel programing model. Currently, there are many efforts to evaluate the hardware and software bottlenecks of exascale designs. It is therefore of interest to model application performance and to understand what changes need to be made to ensure extrapolated scalability. The fast multipole method (FMM) was originally developed for accelerating N-body problems in astrophysics and molecular dynamics but has recently been extended to a wider range of problems. Its high arithmetic intensity combined with its linear complexity and asynchronous communication patterns make it a promising algorithm for exascale systems. In this paper, we discuss the challenges for FMM on current parallel computers and future exascale architectures, with a focus on internode communication. We focus on the communication part only; the efficiency of the computational kernels are beyond the scope of the present study. We develop a performance model that considers the communication patterns of the FMM and observe a good match between our model and the actual communication time on four high-performance computing (HPC) systems, when latency, bandwidth, network topology, and multicore penalties are all taken into account. To our knowledge, this is the first formal characterization of internode communication in FMM that validates the model against actual measurements of communication time. The ultimate communication model is predictive in an absolute sense; however, on complex systems, this objective is often out of reach or of a difficulty out of proportion to its benefit when there exists a simpler model that is inexpensive and sufficient to guide coding decisions leading to improved scaling. The current model provides such guidance.

Research Organization:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); Argonne National Lab. (ANL), Argonne, IL (United States); UT-Battelle LLC/ORNL, Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC)
DOE Contract Number:
AC02-06CH11357; AC05-00OR22725
OSTI ID:
1565623
Journal Information:
International Journal of High Performance Computing Applications, Vol. 30, Issue 4; ISSN 1094-3420
Publisher:
SAGE
Country of Publication:
United States
Language:
English

References (22)

A hierarchical O(N log N) force-calculation algorithm journal December 1986
Diagnosis, Tuning, and Redesign for Multicore Performance: A Case Study of the Fast Multipole Method
  • Chandramowlishwarany, Aparna; Madduri, Kamesh; Vuduc, Richard
  • 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.19
conference November 2010
Optimizing and tuning the fast multipole method for state-of-the-art multicore architectures conference April 2010
A Fast Adaptive Multipole Algorithm in Three Dimensions journal November 1999
Symbolic performance prediction of scalable parallel programs conference January 1995
Guest Editors Introduction to the top 10 algorithms journal January 2000
Parallel Algorithms for the Spectral Transform Method journal May 1997
Modeling the performance of an algebraic multigrid cycle on HPC platforms conference January 2011
Adaptation and performance of the fast multipole method for dipolar systems journal May 2004
Integral Equation Methods for Stokes Flow and Isotropic Elasticity in the Plane journal May 1996
A fast algorithm for particle simulations journal December 1987
Scaling Hierarchical N-body Simulations on GPU Clusters
  • Jetley, Pritish; Wesolowski, Lukasz; Gioachin, Filippo
  • 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.49
conference November 2010
Predictive performance and scalability modeling of a large-scale application conference January 2001
A massively parallel adaptive fast-multipole method on heterogeneous architectures
  • Lashuk, Ilya; Biros, George; Chandramowlishwaran, Aparna
  • Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09 https://doi.org/10.1145/1654059.1654118
conference January 2009
Petascale direct numerical simulation of turbulent channel flow on up to 786K cores
  • Lee, Myoungkyu; Malaya, Nicholas; Moser, Robert D.
  • Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '13 https://doi.org/10.1145/2503210.2503298
conference January 2013
Integrated compilation and scalability analysis for parallel systems conference January 1998
On the scaling of multipole methods for particle–particle interactions journal January 1998
Modeling application performance by convolving machine signatures with application profiles
  • Snavely, A.; Wolter, N.; Carrington, L.
  • Proceedings of the Fourth Annual IEEE International Workshop on Workload Characterization. WWC-4 (Cat. No.01EX538) https://doi.org/10.1109/WWC.2001.990754
conference January 2001
Application of the fast multipole method for the evaluation of magnetostatic fields in micromagnetic computations journal December 2008
Aeroacoustic Integrals Accelerated by Fast Multipole Method journal July 2011
Performance evaluation of the IBM SP and the Compaq AlphaServer SC conference January 2000
Three-dimensional multilevel fast multipole algorithm from static to electrodynamic journal July 2000