Title: Scalable Implicit Solvers with Dynamic Mesh Adaptation for a Relativistic Drift-Kinetic Fokker–Planck–Boltzmann Model

Journal Article · · Journal of Computational Physics
ORCiD logo [1];  [2];  [3]; ORCiD logo [4]; ORCiD logo [4]
  1. Argonne National Laboratory (ANL), Argonne, IL (United States); Virginia Polytechnic Inst. and State Univ. (Virginia Tech), Blacksburg, VA (United States)
  2. Argonne National Laboratory (ANL), Argonne, IL (United States); Virginia Polytechnic Inst. and State Univ. (Virginia Tech), Blacksburg, VA (United States); Boston Univ., MA (United States)
  3. Argonne National Laboratory (ANL), Argonne, IL (United States)
  4. Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)

In this work we consider a relativistic drift-kinetic model for runaway electrons along with a Fokker–Planck operator for small-angle Coulomb collisions, a radiation damping operator, and a secondary knock-on (Boltzmann) collision source. Here, we develop a new scalable fully implicit solver utilizing finite volume and conservative finite difference schemes and dynamic mesh adaptivity. A new data management framework in the PETSc library based on the p4est library is developed to enable simulations with dynamic adaptive mesh refinement (AMR), distributed memory parallelization, and dynamic load balancing of computational work. This framework and the runaway electron solver building on the framework are able to dynamically capture both bulk Maxwellian at the low-energy region and a runaway tail at the high-energy region. To effectively capture features via the AMR algorithm, a new AMR indicator prediction strategy is proposed that is performed alongside the implicit time evolution of the solution. This strategy is complemented by the introduction of computationally cheap feature-based AMR indicators that are analyzed theoretically. Numerical results quantify the advantages of the prediction strategy in better capturing features compared with nonpredictive strategies; and we demonstrate trade-offs regarding computational costs. The robustness with respect to model parameters, algorithmic scalability, and parallel scalability are demonstrated through several benchmark problems including manufactured solutions and solutions of different physics models. We focus on demonstrating the advantages of using implicit time stepping and AMR for runaway electron simulations.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States). Argonne Leadership Computing Facility (ALCF); Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC); Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE; USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
89233218CNA000001; AC02-05CH11231; AC02-06CH11357
OSTI ID:
2332786
Report Number(s):
LA-UR-23-22498
Journal Information:
Journal of Computational Physics, Journal Name: Journal of Computational Physics Vol. 507; ISSN 0021-9991
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (43)

An Adaptive Finite Element Method for Magnetohydrodynamics journal December 1998
Numerical Treatment of Polar Coordinate Singularities journal January 2000
Modeling atmospheric chemistry and transport with dynamic adaptive resolution journal January 2008
Local adaptive mesh refinement for shock hydrodynamics journal May 1989
A stable and accurate convective modelling procedure based on quadratic upstream interpolation journal June 1979
BoomerAMG: A parallel algebraic multigrid solver and preconditioner journal April 2002
NORSE: A solver for the relativistic non-linear Fokker–Planck equation for electrons in a homogeneous plasma journal March 2017
A fully implicit, scalable, conservative nonlinear relativistic Fokker–Planck 0D-2P solver for runaway electrons journal September 2020
Jacobian-free Newton–Krylov methods: a survey of approaches and applications journal January 2004
Implicit adaptive mesh refinement for 2D reduced resistive magnetohydrodynamics journal October 2008
Block-structured adaptive mesh refinement algorithms for Vlasov simulation journal May 2013
A stable partitioned FSI algorithm for rigid bodies and incompressible flow. Part I: Model problem analysis journal August 2017
An adaptive scalable fully implicit algorithm based on stabilized finite element for reduced visco-resistive MHD journal April 2022
Finite Volume Methods for Hyperbolic Problems book January 2002
Advanced Newton Methods for Geodynamical Models of Stokes Flow With Viscoplastic Rheologies journal September 2020
Theory of runaway electrons in ITER: Equations, important parameters, and implications for mitigation journal March 2015
Toroidal effect on runaway vortex and avalanche growth rate journal August 2019
Nonlinear relativistic gyrokinetic Vlasov-Maxwell equations journal December 1999
Relativistic limitations on runaway electrons journal June 1975
Theory for avalanche of runaway electrons in tokamaks journal October 1997
Fokker-Planck simulations mylb of knock-on electron runaway avalanche and bursts in tokamaks journal November 1998
Runaway electron drift orbits in magnetostatic perturbed fields journal March 2011
Phase-space dynamics of runaway electrons in magnetic fields journal February 2017
Relation of the runaway avalanche threshold to momentum space topology journal January 2018
Effect of partially ionized impurities and radiation on the effective critical electric field for runaway generation journal June 2018
Avalanche mechanism for runaway electron amplification in a tokamak plasma journal April 2019
Physics of runaway electrons in tokamaks journal June 2019
Kinetic solvers with adaptive mesh in phase space journal December 2013
Effect of Partially Screened Nuclei on Fast-Electron Dynamics journal June 2017
Bottom-Up Construction and 2:1 Balance Refinement of Linear Octrees in Parallel journal January 2008
Diagonally Implicit Runge–Kutta Methods for Stiff O.D.E.’s journal December 1977
p4est : Scalable Algorithms for Parallel Adaptive Mesh Refinement on Forests of Octrees journal January 2011
Implicit-Explicit Formulations of a Three-Dimensional Nonhydrostatic Unified Model of the Atmosphere (NUMA) journal January 2013
Recursive Algorithms for Distributed Forests of Octrees journal January 2015
An Adaptive Multiresolution Discontinuous Galerkin Method for Time-Dependent Transport Equations in Multidimensions journal January 2017
Weighted BFBT Preconditioner for Stokes Flow Problems with Highly Heterogeneous Viscosity journal January 2017
Landau Collision Integral Solver with Adaptive Mesh Refinement on Emerging Architectures journal January 2017
Nonsymmetric Algebraic Multigrid Based on Local Approximate Ideal Restriction ($\ell$AIR) journal January 2018
Massively Parallel Simulations of Binary Black Hole Intermediate-Mass-Ratio Inspirals journal January 2019
An Adaptive Discontinuous Petrov--Galerkin Method for the Grad--Shafranov Equation journal January 2020
Relativistic Vlasov-Maxwell modelling using finite volumes and adaptive mesh refinement journal June 2017
The Peano Software—Parallel, Automaton-based, Dynamically Adaptive Grid Traversals journal April 2019
FINMHD: An Adaptive Finite-element Code for Magnetic Reconnection and Formation of Plasmoid Chains in Magnetohydrodynamics journal July 2019