Parallel Implementation and Scaling of an Adaptive Mesh Discrete Ordinates Algorithm for Transport
Block-structured adaptive mesh refinement (AMR) uses a mesh structure built up out of locally-uniform rectangular grids. In the BoxLib parallel framework used by the Raptor code, each processor operates on one or more of these grids at each refinement level. The decomposition of the mesh into grids and the distribution of these grids among processors may change every few timesteps as a calculation proceeds. Finer grids use smaller timesteps than coarser grids, requiring additional work to keep the system synchronized and ensure conservation between different refinement levels. In a paper for NECDC 2002 I presented preliminary results on implementation of parallel transport sweeps on the AMR mesh, conjugate gradient acceleration, accuracy of the AMR solution, and scalar speedup of the AMR algorithm compared to a uniform fully-refined mesh. This paper continues with a more in-depth examination of the parallel scaling properties of the scheme, both in single-level and multi-level calculations. Both sweeping and setup costs are considered. The algorithm scales with acceptable performance to several hundred processors. Trends suggest, however, that this is the limit for efficient calculations with traditional transport sweeps, and that modifications to the sweep algorithm will be increasingly needed as job sizes in the thousands of processors become common.
- Research Organization:
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Sponsoring Organization:
- US Department of Energy (US)
- DOE Contract Number:
- W-7405-ENG-48
- OSTI ID:
- 15011611
- Report Number(s):
- UCRL-CONF-208312; TRN: US0501288
- Resource Relation:
- Conference: Presented at: NECDC 2004, Livermore, CA (US), 10/04/2004--10/07/2004; Other Information: PBD: 29 Nov 2004
- Country of Publication:
- United States
- Language:
- English
Similar Records
A space-time parallel algorithm with adaptive mesh refinement for computational fluid dynamics
An adaptive mesh refinement algorithm for the discrete ordinates method