skip to main content

Title: Balancing Conflicting Requirements for Grid and Particle Decomposition in Continuum-Lagrangian Solvers

The load balancing strategies for hybrid solvers that involve grid based partial differential equation solution coupled with particle tracking are presented in this paper. A typical Message Passing Interface (MPI) based parallelization of grid based solves are done using a spatial domain decomposition while particle tracking is primarily done using either of the two techniques. One of the techniques is to distribute the particles to MPI ranks to whose grid they belong to while the other is to share the particles equally among all ranks, irrespective of their spatial location. The former technique provides spatial locality for field interpolation but cannot assure load balance in terms of number of particles, which is achieved by the latter. The two techniques are compared for a case of particle tracking in a homogeneous isotropic turbulence box as well as a turbulent jet case. We performed a strong scaling study for more than 32,000 cores, which results in particle densities representative of anticipated exascale machines. The use of alternative implementations of MPI collectives and efficient load equalization strategies are studied to reduce data communication overheads.
 [1] ;  [1]
  1. National Renewable Energy Lab. (NREL), Golden, CO (United States)
Publication Date:
OSTI Identifier:
Report Number(s):
Journal ID: ISSN 0167-8191
DOE Contract Number:
Resource Type:
Journal Article
Resource Relation:
Journal Name: Parallel Computing; Journal Volume: 52; Related Information: Parallel Computing
Research Org:
National Renewable Energy Lab. (NREL), Golden, CO (United States)
Sponsoring Org:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
Country of Publication:
United States
97 MATHEMATICS AND COMPUTING; Load balancing; Lagrangian particle tracking; Particle in Cell; Exascale simulations