Balancing Conflicting Requirements for Grid and Particle Decomposition in Continuum-Lagrangian Solvers
- National Renewable Energy Lab. (NREL), Golden, CO (United States)
The load balancing strategies for hybrid solvers that involve grid based partial differential equation solution coupled with particle tracking are presented in this paper. A typical Message Passing Interface (MPI) based parallelization of grid based solves are done using a spatial domain decomposition while particle tracking is primarily done using either of the two techniques. One of the techniques is to distribute the particles to MPI ranks to whose grid they belong to while the other is to share the particles equally among all ranks, irrespective of their spatial location. The former technique provides spatial locality for field interpolation but cannot assure load balance in terms of number of particles, which is achieved by the latter. The two techniques are compared for a case of particle tracking in a homogeneous isotropic turbulence box as well as a turbulent jet case. We performed a strong scaling study for more than 32,000 cores, which results in particle densities representative of anticipated exascale machines. The use of alternative implementations of MPI collectives and efficient load equalization strategies are studied to reduce data communication overheads.
- Research Organization:
- National Renewable Energy Lab. (NREL), Golden, CO (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- DOE Contract Number:
- AC36-08GO28308
- OSTI ID:
- 1229547
- Report Number(s):
- NREL/JA-2C00-65414
- Journal Information:
- Parallel Computing, Vol. 52; Related Information: Parallel Computing; ISSN 0167-8191
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
Similar Records
Explicit spatial scattering for load balancing in conservatively synchronized parallel discrete-event simulations
Deploy threading in Nalu solver stack