skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Advances in Patch-Based Adaptive Mesh Refinement Scalability

Journal Article · · Journal of Parallel and Distributed Computing
 [1];  [1]
  1. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)

Patch-based structured adaptive mesh refinement (SAMR) is widely used for high-resolution simu- lations. Combined with modern supercomputers, it could provide simulations of unprecedented size and resolution. A persistent challenge for this com- bination has been managing dynamically adaptive meshes on more and more MPI tasks. The dis- tributed mesh management scheme in SAMRAI has made some progress SAMR scalability, but early al- gorithms still had trouble scaling past the regime of 105 MPI tasks. This work provides two critical SAMR regridding algorithms, which are integrated into that scheme to ensure efficiency of the whole. The clustering algorithm is an extension of the tile- clustering approach, making it more flexible and efficient in both clustering and parallelism. The partitioner is a new algorithm designed to prevent the network congestion experienced by its prede- cessor. We evaluated performance using weak- and strong-scaling benchmarks designed to be difficult for dynamic adaptivity. Results show good scaling on up to 1.5M cores and 2M MPI tasks. Detailed timing diagnostics suggest scaling would continue well past that.

Research Organization:
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
AC52-07NA27344
OSTI ID:
1241965
Report Number(s):
LLNL-JRNL-668377
Journal Information:
Journal of Parallel and Distributed Computing, Vol. 89; ISSN 0743-7315
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 31 works
Citation information provided by
Web of Science

References (15)

An arbitrary Lagrangian–Eulerian method with adaptive mesh refinement for the solution of the Euler equations journal September 2004
Local adaptive mesh refinement for shock hydrodynamics journal May 1989
Adaptive mesh refinement for hyperbolic partial differential equations journal March 1984
An algorithm for point clustering and grid generation journal January 1991
PT-Scotch: A tool for efficient parallel graph ordering journal July 2008
Multidimensional upwind methods for hyperbolic conservation laws journal March 1990
Efficient solution algorithms for the Riemann problem for real gases journal June 1985
Zoltan data management services for parallel dynamic applications journal January 2002
Parallel clustering algorithms for structured AMR journal November 2006
Managing application complexity in the SAMRAI object-oriented framework journal January 2002
A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs journal January 1998
Scalable parallel regridding algorithms for block-structured adaptive mesh refinement journal March 2011
Parallel space-filling curve generation through sorting journal January 2007
Adaptive Mesh Refinement for Wave Propagation in Nonlinear Solids journal July 1995
Enhancing scalability of parallel structured AMR calculations conference January 2003

Cited By (7)

Full Eulerian deformable solid‐fluid interaction scheme based on building‐cube method for large‐scale parallel computing
  • Nishiguchi, Koji; Bale, Rahul; Okazawa, Shigenobu
  • International Journal for Numerical Methods in Engineering, Vol. 117, Issue 2 https://doi.org/10.1002/nme.5954
journal October 2018
Extension of the subgrid-scale gradient model for compressible magnetohydrodynamics turbulent instabilities journal October 2019
A Simflowny-based finite-difference code for high-performance computing in numerical relativity journal August 2018
Gravitational waves from dark boson star binary mergers journal November 2018
Gradient subgrid-scale model for relativistic MHD large-eddy simulations journal March 2020
Extension of the sub-grid-scale gradient model for compressible magnetohydrodynamics turbulent instabilities text January 2019
Gradient sub-grid-scale model for relativistic MHD Large Eddy Simulations text January 2019