Scalable implicit incompressible resistive MHD with stabilized FE and fully-coupled Newton–Krylov-AMG

Shadid, J. N.; Pawlowski, R. P.; Cyr, E. C.; Tuminaro, R. S.; Chacon, L.; Weber, P. D.

doi:10.1016/j.cma.2016.01.019

Scalable implicit incompressible resistive MHD with stabilized FE and fully-coupled Newton–Krylov-AMG

Journal Article · Wed Feb 10 00:00:00 EST 2016 · Computer Methods in Applied Mechanics and Engineering

DOI:https://doi.org/10.1016/j.cma.2016.01.019· OSTI ID:1310309

Shadid, J. N. ^[1]; Pawlowski, R. P. ^[2]; Cyr, E. C. ^[2]; Tuminaro, R. S. ^[2]; Chacon, L. ^[3]; Weber, P. D. ^[2]

Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Univ. of New Mexico, Albuquerque, NM (United States)
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Here, we discuss that the computational solution of the governing balance equations for mass, momentum, heat transfer and magnetic induction for resistive magnetohydrodynamics (MHD) systems can be extremely challenging. These difficulties arise from both the strong nonlinear, nonsymmetric coupling of fluid and electromagnetic phenomena, as well as the significant range of time- and length-scales that the interactions of these physical mechanisms produce. This paper explores the development of a scalable, fully-implicit stabilized unstructured finite element (FE) capability for 3D incompressible resistive MHD. The discussion considers the development of a stabilized FE formulation in context of the variational multiscale (VMS) method, and describes the scalable implicit time integration and direct-to-steady-state solution capability. The nonlinear solver strategy employs Newton–Krylov methods, which are preconditioned using fully-coupled algebraic multilevel preconditioners. These preconditioners are shown to enable a robust, scalable and efficient solution approach for the large-scale sparse linear systems generated by the Newton linearization. Verification results demonstrate the expected order-of-accuracy for the stabilized FE discretization. The approach is tested on a variety of prototype problems, that include MHD duct flows, an unstable hydromagnetic Kelvin–Helmholtz shear layer, and a 3D island coalescence problem used to model magnetic reconnection. Initial results that explore the scaling of the solution methods are also presented on up to 128K processors for problems with up to 1.8B unknowns on a CrayXK7.

View Accepted Manuscript (DOE)

Research Organization:: Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States); Sandia National Laboratories, Livermore, CA (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000; AC52-06NA25396

OSTI ID:: 1310309

Alternate ID(s):: OSTI ID: 1467499

Report Number(s):: SAND--2014-20573J; PII: S0045782516300184

Journal Information:: Computer Methods in Applied Mechanics and Engineering, Journal Name: Computer Methods in Applied Mechanics and Engineering Journal Issue: C Vol. 304; ISSN 0045-7825

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (66)

A conservative stabilized finite element method for the magneto-hydrodynamic equations Ben Salah, Nizar; Soulaimani, Azzeddine; Habashi, Wagdi G. International Journal for Numerical Methods in Fluids, Vol. 29, Issue 5 https://doi.org/10.1002/(SICI)1097-0363(19990315)29:5<535::AID-FLD799>3.0.CO;2-D	journal	March 1999
Implicit and semi-implicit schemes: Algorithms Keppens, R.; Tóth, G.; Botchev, M. A. International Journal for Numerical Methods in Fluids, Vol. 30, Issue 3 https://doi.org/10.1002/(SICI)1097-0363(19990615)30:3<335::AID-FLD923>3.0.CO;2-U	journal	June 1999
On a multilevel preconditioning module for unstructured mesh Krylov solvers: two-level Schwarz Tuminaro, R. S.; Tong, C. H.; Shadid, J. N. Communications in Numerical Methods in Engineering, Vol. 18, Issue 6 https://doi.org/10.1002/cnm.478	journal	March 2002
A parallel fully coupled algebraic multilevel preconditioner applied to multiphysics PDE applications: Drift-diffusion, flow/transport/reaction, resistive MHD Lin, Paul T.; Shadid, John N.; Tuminaro, Raymond S. International Journal for Numerical Methods in Fluids, Vol. 64, Issue 10-12 https://doi.org/10.1002/fld.2402	journal	September 2010
Performance of fully coupled algebraic multilevel domain decomposition preconditioners for incompressible flow and transport Lin, Paul T.; Sala, Marzio; Shadid, John N. International Journal for Numerical Methods in Engineering, Vol. 67, Issue 2 https://doi.org/10.1002/nme.1624	journal	January 2006
An Inexact Newton Method for Fully Coupled Solution of the Navier–Stokes Equations with Heat and Mass Transport Shadid, John N.; Tuminaro, Ray S.; Walker, Homer F. Journal of Computational Physics, Vol. 137, Issue 1 https://doi.org/10.1006/jcph.1997.5798	journal	October 1997
A Simple Finite Difference Scheme for Multidimensional Magnetohydrodynamical Equations Dai, Wenlong; Woodward, Paul R. Journal of Computational Physics, Vol. 142, Issue 2 https://doi.org/10.1006/jcph.1998.5944	journal	May 1998
The ∇·B=0 Constraint in Shock-Capturing Magnetohydrodynamics Codes Tóth, Gábor Journal of Computational Physics, Vol. 161, Issue 2 https://doi.org/10.1006/jcph.2000.6519	journal	July 2000
Divergence-Free Adaptive Mesh Refinement for Magnetohydrodynamics Balsara, Dinshaw S. Journal of Computational Physics, Vol. 174, Issue 2 https://doi.org/10.1006/jcph.2001.6917	journal	December 2001
Hyperbolic Divergence Cleaning for the MHD Equations Dedner, A.; Kemm, F.; Kröner, D. Journal of Computational Physics, Vol. 175, Issue 2 https://doi.org/10.1006/jcph.2001.6961	journal	January 2002
An Implicit, Nonlinear Reduced Resistive MHD Solver Chacón, L.; Knoll, D. A.; Finn, J. M. Journal of Computational Physics, Vol. 178, Issue 1 https://doi.org/10.1006/jcph.2002.7015	journal	May 2002
Mixed finite elements in ?3 Nedelec, J. C. Numerische Mathematik, Vol. 35, Issue 3 https://doi.org/10.1007/BF01396415	journal	September 1980
Singularities of Electromagnetic Fields¶in Polyhedral Domains Costabel, Martin; Dauge, Monique Archive for Rational Mechanics and Analysis, Vol. 151, Issue 3 https://doi.org/10.1007/s002050050197	journal	April 2000
Mixed finite element methods for stationary incompressible magneto?hydrodynamics Sch�tzau, Dominik Numerische Mathematik, Vol. 96, Issue 4 https://doi.org/10.1007/s00211-003-0487-4	journal	February 2004
A stabilized finite element method for the incompressible magnetohydrodynamic equations Gerbeau, J. -F. Numerische Mathematik, Vol. 87, Issue 1 https://doi.org/10.1007/s002110000193	journal	November 2000
Weighted regularization of Maxwell equations in polyhedral domains Costabel, Martin; Dauge, Monique Numerische Mathematik, Vol. 93, Issue 2 https://doi.org/10.1007/s002110100388	journal	December 2002
Stabilized Finite Element Approximation of the Stationary Magneto-Hydrodynamics Equations Codina, Ramon; Hernández - Silva, Noel Computational Mechanics, Vol. 38, Issue 4-5 https://doi.org/10.1007/s00466-006-0037-x	journal	February 2006
The Effect of Nonzero ∇ · B on the numerical solution of the magnetohydrodynamic equations Brackbill, J. U.; Barnes, D. C. Journal of Computational Physics, Vol. 35, Issue 3 https://doi.org/10.1016/0021-9991(80)90079-0	journal	May 1980
Semi-implicit method for three-dimensional compressible magnetohydrodynamic simulation Harned, Douglas S.; Kerner, W. Journal of Computational Physics, Vol. 60, Issue 1 https://doi.org/10.1016/0021-9991(85)90017-8	journal	August 1985
An implicit algorithm for compressible three-dimensional magnetohydrodynamic calculations Aydemir, A. Y.; Barnes, D. C. Journal of Computational Physics, Vol. 59, Issue 1 https://doi.org/10.1016/0021-9991(85)90110-X	journal	May 1985
A method for incorporating Gauss' law into electromagnetic PIC codes Marder, Barry Journal of Computational Physics, Vol. 68, Issue 1 https://doi.org/10.1016/0021-9991(87)90043-X	journal	January 1987
Semi-implicit magnetohydrodynamic calculations Schnack, D. D.; Barnes, D. C.; Mikic, Z. Journal of Computational Physics, Vol. 70, Issue 2 https://doi.org/10.1016/0021-9991(87)90186-0	journal	June 1987
Accurate semi-implicit treatment of the Hall effect in magnetohydrodynamic computations Harned, Douglas S.; Mikic´, Zoran Journal of Computational Physics, Vol. 83, Issue 1 https://doi.org/10.1016/0021-9991(89)90220-9	journal	July 1989
Streamline upwind/Petrov-Galerkin formulations for convection dominated flows with particular emphasis on the incompressible Navier-Stokes equations Brooks, Alexander N.; Hughes, Thomas J. R. Computer Methods in Applied Mechanics and Engineering, Vol. 32, Issue 1-3 https://doi.org/10.1016/0045-7825(82)90071-8	journal	September 1982
A new finite element formulation for computational fluid dynamics: V. Circumventing the babuška-brezzi condition: a stable Petrov-Galerkin formulation of the stokes problem accommodating equal-order interpolations Hughes, Thomas J. R.; Franca, Leopoldo P.; Balestra, Marc Computer Methods in Applied Mechanics and Engineering, Vol. 59, Issue 1 https://doi.org/10.1016/0045-7825(86)90025-3	journal	November 1986
A new finite element formulation for computational fluid dynamics: III. The generalized streamline operator for multidimensional advective-diffusive systems Hughes, Thomas J. R.; Mallet, Michel Computer Methods in Applied Mechanics and Engineering, Vol. 58, Issue 3 https://doi.org/10.1016/0045-7825(86)90152-0	journal	November 1986
Multiscale phenomena: Green's functions, the Dirichlet-to-Neumann formulation, subgrid scale models, bubbles and the origins of stabilized methods Hughes, Thomas J. R. Computer Methods in Applied Mechanics and Engineering, Vol. 127, Issue 1-4 https://doi.org/10.1016/0045-7825(95)00844-9	journal	November 1995
Approximate Riemann solver for the two-fluid plasma model Shumlak, U.; Loverich, J. Journal of Computational Physics, Vol. 187, Issue 2 https://doi.org/10.1016/S0021-9991(03)00151-7	journal	May 2003
On stabilized finite element methods for linear systems of convection–diffusion-reaction equations Codina, Ramon Computer Methods in Applied Mechanics and Engineering, Vol. 188, Issue 1-3 https://doi.org/10.1016/S0045-7825(00)00177-8	journal	July 2000
Stabilized finite element approximation of transient incompressible flows using orthogonal subscales Codina, Ramon Computer Methods in Applied Mechanics and Engineering, Vol. 191, Issue 39-40 https://doi.org/10.1016/S0045-7825(02)00337-7	journal	August 2002
The variational multiscale method—a paradigm for computational mechanics Hughes, Thomas J. R.; Feijóo, Gonzalo R.; Mazzei, Luca Computer Methods in Applied Mechanics and Engineering, Vol. 166, Issue 1-2 https://doi.org/10.1016/S0045-7825(98)00079-6	journal	November 1998
Adjoint operators for the natural discretizations of the divergence, gradient and curl on logically rectangular grids Hyman, James M.; Shashkov, Mikhail Applied Numerical Mathematics, Vol. 25, Issue 4 https://doi.org/10.1016/S0168-9274(97)00097-4	journal	December 1997
Hall MHD effects on the 2D Kelvin–Helmholtz/tearing instability Chacón, L.; Knoll, D. A.; Finn, J. M. Physics Letters A, Vol. 308, Issue 2-3 https://doi.org/10.1016/S0375-9601(02)01807-8	journal	February 2003
Large-scale stabilized FE computational analysis of nonlinear steady-state transport/reaction systems Shadid, J. N.; Salinger, A. G.; Pawlowski, R. P. Computer Methods in Applied Mechanics and Engineering, Vol. 195, Issue 13-16 https://doi.org/10.1016/j.cma.2005.05.047	journal	February 2006
A non-staggered, conservative, , finite-volume scheme for 3D implicit extended magnetohydrodynamics in curvilinear geometries Chacón, L. Computer Physics Communications, Vol. 163, Issue 3 https://doi.org/10.1016/j.cpc.2004.08.005	journal	November 2004
Advanced physics calculations using a multi-fluid plasma model Shumlak, U.; Lilly, R.; Reddell, N. Computer Physics Communications, Vol. 182, Issue 9 https://doi.org/10.1016/j.cpc.2010.12.048	journal	September 2011
Nonlinear magnetohydrodynamics simulation using high-order finite elements Sovinec, C. R.; Glasser, A. H.; Gianakon, T. A. Journal of Computational Physics, Vol. 195, Issue 1 https://doi.org/10.1016/j.jcp.2003.10.004	journal	March 2004
Performance of fully coupled domain decomposition preconditioners for finite element transport/reaction simulations Shadid, J. N.; Tuminaro, R. S.; Devine, K. D. Journal of Computational Physics, Vol. 205, Issue 1 https://doi.org/10.1016/j.jcp.2004.10.038	journal	May 2005
An adaptive finite element method for magnetohydrodynamics Lankalapalli, S.; Flaherty, J. E.; Shephard, M. S. Journal of Computational Physics, Vol. 225, Issue 1 https://doi.org/10.1016/j.jcp.2006.12.010	journal	July 2007
Towards a scalable fully-implicit fully-coupled resistive MHD formulation with stabilized FE methods Shadid, J. N.; Pawlowski, R. P.; Banks, J. W. Journal of Computational Physics, Vol. 229, Issue 20 https://doi.org/10.1016/j.jcp.2010.06.018	journal	October 2010
Approximation of the thermally coupled MHD problem using a stabilized finite element method Codina, Ramon; Hernández, Noel Journal of Computational Physics, Vol. 230, Issue 4 https://doi.org/10.1016/j.jcp.2010.11.003	journal	February 2011
Review of implicit methods for the magnetohydrodynamic description of magnetically confined plasmas Jardin, S. C. Journal of Computational Physics, Vol. 231, Issue 3 https://doi.org/10.1016/j.jcp.2010.12.025	journal	February 2012
On an unconditionally convergent stabilized finite element approximation of resistive magnetohydrodynamics Badia, Santiago; Codina, Ramon; Planas, Ramon Journal of Computational Physics, Vol. 234 https://doi.org/10.1016/j.jcp.2012.09.031	journal	February 2013
A new class of finite element variational multiscale turbulence models for incompressible magnetohydrodynamics Sondak, D.; Shadid, J. N.; Oberai, A. A. Journal of Computational Physics, Vol. 295 https://doi.org/10.1016/j.jcp.2015.04.035	journal	August 2015
IRMHD: an implicit radiative and magnetohydrodynamical solver for self-gravitating systems Hujeirat, A. Monthly Notices of the Royal Astronomical Society, Vol. 298, Issue 1 https://doi.org/10.1046/j.1365-8711.1998.01732.x	journal	July 1998
Three-dimensional HYDRA simulations of National Ignition Facility targets Marinak, M. M.; Kerbel, G. D.; Gentile, N. A. Physics of Plasmas, Vol. 8, Issue 5 https://doi.org/10.1063/1.1356740	journal	May 2001
Implicit solution of the four-field extended-magnetohydrodynamic equations using high-order high-continuity finite elements Jardin, S. C.; Breslau, J. A. Physics of Plasmas, Vol. 12, Issue 5 https://doi.org/10.1063/1.1864992	journal	May 2005
Coalescence of magnetic islands, sloshing, and the pressure problem Knoll, D. A.; Chacón, L. Physics of Plasmas, Vol. 13, Issue 3 https://doi.org/10.1063/1.2173515	journal	March 2006
An optimal, parallel, fully implicit Newton–Krylov solver for three-dimensional viscoresistive magnetohydrodynamics Chacón, L. Physics of Plasmas, Vol. 15, Issue 5 https://doi.org/10.1063/1.2838244	journal	May 2008
Nonlinear, three-dimensional magnetohydrodynamics of noncircular tokamaks Strauss, H. R. Physics of Fluids, Vol. 19, Issue 1 https://doi.org/10.1063/1.861310	journal	January 1976
Nonlinear reduced fluid equations for toroidal plasmas Drake, J. F.; Antonsen, Thomas M. Physics of Fluids, Vol. 27, Issue 4 https://doi.org/10.1063/1.864680	journal	January 1984
A four-field model for tokamak plasma dynamics Hazeltine, R. D.; Kotschenreuther, M.; Morrison, P. J. Physics of Fluids, Vol. 28, Issue 8 https://doi.org/10.1063/1.865255	journal	January 1985
Simulation of magnetohydrodynamic flows - A constrained transport method Evans, Charles R.; Hawley, John F. The Astrophysical Journal, Vol. 332 https://doi.org/10.1086/166684	journal	September 1988
A Divergence‐free Upwind Code for Multidimensional Magnetohydrodynamic Flows Ryu, Dongsu; Miniati, Francesco; Jones, T. W. The Astrophysical Journal, Vol. 509, Issue 1 https://doi.org/10.1086/306481	journal	December 1998
Nonlinear simulation studies of tokamaks and STs Park, W.; Breslau, J.; Chen, J. Nuclear Fusion, Vol. 43, Issue 6 https://doi.org/10.1088/0029-5515/43/6/311	journal	June 2003
Self-focusing of local plasma currents Fadeev, V. M.; Kvabtskhava, I. F.; Komarov, N. N. Nuclear Fusion, Vol. 5, Issue 3 https://doi.org/10.1088/0029-5515/5/3/003	journal	September 1965
On the existence, uniqueness, and finite element approximation of solutions of the equations of stationary, incompressible magnetohydrodynamics Gunzburger, Max D.; Meir, Amnon J.; Peterson, Janet S. Mathematics of Computation, Vol. 56, Issue 194 https://doi.org/10.1090/S0025-5718-1991-1066834-0	journal	May 1991
Coalescence of Magnetic Islands in the Low-Resistivity, Hall-MHD Regime Knoll, D. A.; Chacón, L. Physical Review Letters, Vol. 96, Issue 13 https://doi.org/10.1103/PhysRevLett.96.135001	journal	April 2006
Inexact Newton Methods Dembo, Ron S.; Eisenstat, Stanley C.; Steihaug, Trond SIAM Journal on Numerical Analysis, Vol. 19, Issue 2 https://doi.org/10.1137/0719025	journal	April 1982
Convergence Theory of Nonlinear Newton–Krylov Algorithms Brown, Peter N.; Saad, Youcef SIAM Journal on Optimization, Vol. 4, Issue 2 https://doi.org/10.1137/0804017	journal	May 1994
Globally Convergent Inexact Newton Methods Eisenstat, Stanley C.; Walker, Homer F. SIAM Journal on Optimization, Vol. 4, Issue 2 https://doi.org/10.1137/0804022	journal	May 1994
Choosing the Forcing Terms in an Inexact Newton Method Eisenstat, Stanley C.; Walker, Homer F. SIAM Journal on Scientific Computing, Vol. 17, Issue 1 https://doi.org/10.1137/0917003	journal	January 1996
A New Approximate Block Factorization Preconditioner for Two-Dimensional Incompressible (Reduced) Resistive MHD Cyr, Eric C.; Shadid, John N.; Tuminaro, Raymond S. SIAM Journal on Scientific Computing, Vol. 35, Issue 3 https://doi.org/10.1137/12088879X	journal	January 2013
Globalization Techniques for Newton–Krylov Methods and Applications to the Fully Coupled Solution of the Navier–Stokes Equations Pawlowski, Roger P.; Shadid, John N.; Simonis, Joseph P. SIAM Review, Vol. 48, Issue 4 https://doi.org/10.1137/S0036144504443511	journal	January 2006
An overview of the Trilinos project Heroux, Michael A.; Phipps, Eric T.; Salinger, Andrew G. ACM Transactions on Mathematical Software, Vol. 31, Issue 3 https://doi.org/10.1145/1089014.1089021	journal	September 2005
ALEGRA: An Arbitrary Lagrangian-Eulerian Multimaterial, Multiphysics Code Robinson, Allen; Brunner, Thomas; Carroll, Susan 46th AIAA Aerospace Sciences Meeting and Exhibit https://doi.org/10.2514/6.2008-1235	conference	June 2012

Cited By (3)

On the performance of Krylov smoothing for fully coupled AMG preconditioners for VMS resistive MHD Lin, Paul T.; Shadid, John N.; Tsuji, Paul H. International Journal for Numerical Methods in Engineering, Vol. 120, Issue 12 https://doi.org/10.1002/nme.6178	journal	August 2019
Dimension reduction in magnetohydrodynamics power generation models: Dimensional analysis and active subspaces: GLAWS Glaws, Andrew; Constantine, Paul G.; Shadid, John N. Statistical Analysis and Data Mining: The ASA Data Science Journal, Vol. 10, Issue 5 https://doi.org/10.1002/sam.11355	journal	August 2017
Pattern formation and self-organization in plasmas interacting with surfaces Trelles, Juan Pablo Journal of Physics D: Applied Physics, Vol. 49, Issue 39 https://doi.org/10.1088/0022-3727/49/39/393002	journal	September 2016

Similar Records

On performance of Krylov smoothing for fully-coupled AMG preconditioners for VMS resistive MHD

Program Document · Wed Nov 01 00:00:00 EDT 2017 · OSTI ID:1429689

Initial performance of fully-coupled AMG and approximate block factorization preconditioners for solution of implicit FE resistive MHD.

Conference · Tue Jun 01 00:00:00 EDT 2010 · OSTI ID:1020538

Towards a Scalable Fully-Implicit Fully-coupled Resistive MHD Formulation with Stabilized FE Methods

Journal Article · Thu Dec 31 23:00:00 EST 2009 · Journal of Computational Physics · OSTI ID:985756

Related Subjects

97 MATHEMATICS AND COMPUTING
Newton–Krylov
algebraic multigrid methods
implicit methods
resistive magnetohydrodynamics
stabilized FE
variational multiscale methods

Scalable implicit incompressible resistive MHD with stabilized FE and fully-coupled Newton–Krylov-AMG

Citation Formats

References (66)

Cited By (3)

Similar Records

Related Subjects