Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs
Abstract
Fully implicit Runge--Kutta (IRK) methods have many desirable accuracy and stability properties as time integration schemes, but high-order IRK methods are not commonly used in practice with large-scale numerical PDEs because of the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic framework for solving the nonlinear equations that arise from IRK methods (and discontinuous Galerkin discretizations in time) applied to nonlinear numerical PDEs, including PDEs with algebraic constraints. Several new linearizations of the nonlinear IRK equations are developed, offering faster and more robust convergence than the often-considered simplified Newton, as well as an effective preconditioner for the true Jacobian if exact Newton iterations are desired. Inverting these linearizations requires solving a set of block 2 x 2 systems. Under quite general assumptions, it is proven that the preconditioned 2 x 2 operator's condition number is bounded by a small constant close to one, independent of the spatial discretization, spatial mesh, and time step, and with only weak dependence on the number of stages or integration accuracy. Moreover, the new method is built using the same preconditioners needed for backward Euler-type time stepping schemes, so can be readily added to existing codes. The new methods aremore »
- Authors:
-
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
- Monash Univ., Melbourne, VIC (Australia)
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States). Center for Applied Scientific Computing
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1873332
- Report Number(s):
- LA-UR-20-30444
Journal ID: ISSN 1064-8275
- Grant/Contract Number:
- 89233218CNA000001
- Resource Type:
- Accepted Manuscript
- Journal Name:
- SIAM Journal on Scientific Computing
- Additional Journal Information:
- Journal Volume: 44; Journal Issue: 2; Journal ID: ISSN 1064-8275
- Publisher:
- Society for Industrial and Applied Mathematics (SIAM)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; Runge-Kutta; numerical PDEs; preconditioning; Navier-Stokes; time integration
Citation Formats
Southworth, Ben S., Krzysik, Oliver, and Pazner, Will. Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs. United States: N. p., 2022.
Web. doi:10.1137/21m1390438.
Southworth, Ben S., Krzysik, Oliver, & Pazner, Will. Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs. United States. https://doi.org/10.1137/21m1390438
Southworth, Ben S., Krzysik, Oliver, and Pazner, Will. Mon .
"Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs". United States. https://doi.org/10.1137/21m1390438. https://www.osti.gov/servlets/purl/1873332.
@article{osti_1873332,
title = {Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs},
author = {Southworth, Ben S. and Krzysik, Oliver and Pazner, Will},
abstractNote = {Fully implicit Runge--Kutta (IRK) methods have many desirable accuracy and stability properties as time integration schemes, but high-order IRK methods are not commonly used in practice with large-scale numerical PDEs because of the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic framework for solving the nonlinear equations that arise from IRK methods (and discontinuous Galerkin discretizations in time) applied to nonlinear numerical PDEs, including PDEs with algebraic constraints. Several new linearizations of the nonlinear IRK equations are developed, offering faster and more robust convergence than the often-considered simplified Newton, as well as an effective preconditioner for the true Jacobian if exact Newton iterations are desired. Inverting these linearizations requires solving a set of block 2 x 2 systems. Under quite general assumptions, it is proven that the preconditioned 2 x 2 operator's condition number is bounded by a small constant close to one, independent of the spatial discretization, spatial mesh, and time step, and with only weak dependence on the number of stages or integration accuracy. Moreover, the new method is built using the same preconditioners needed for backward Euler-type time stepping schemes, so can be readily added to existing codes. The new methods are applied to several challenging fluid flow problems, including the compressible Euler and Navier--Stokes equations, and the vorticity-streamfunction formulation of the incompressible Euler and Navier--Stokes equations. Up to 10th-order accuracy is demonstrated using Gauss IRK, while in all cases fourth-order Gauss IRK requires roughly half the number of preconditioner applications as required by standard Singly diagonally implicit Runge--Kutta methods.},
doi = {10.1137/21m1390438},
journal = {SIAM Journal on Scientific Computing},
number = 2,
volume = 44,
place = {United States},
year = {Mon Mar 14 00:00:00 EDT 2022},
month = {Mon Mar 14 00:00:00 EDT 2022}
}
Works referenced in this record:
Inexact Simplified Newton Iterations for Implicit Runge-Kutta Methods
journal, January 2000
- Jay, Laurent O.
- SIAM Journal on Numerical Analysis, Vol. 38, Issue 4
Preconditioning of fully implicit Runge-Kutta schemes for parabolic PDEs
journal, January 2006
- Staff, Gunnar A.; Mardal, Kent-Andre; Nilssen, Trygve K.
- Modeling, Identification and Control: A Norwegian Research Bulletin, Vol. 27, Issue 2
An Efficient Solution Process for Implicit Runge–Kutta Methods
journal, December 1977
- Bickart, Theodore A.
- SIAM Journal on Numerical Analysis, Vol. 14, Issue 6
A posteriori error analysis for higher order dissipative methods for evolution problems
journal, September 2006
- Makridakis, Charalambos; Nochetto, Ricardo H.
- Numerische Mathematik, Vol. 104, Issue 4
MFEM: A modular finite element methods library
journal, January 2021
- Anderson, Robert; Andrej, Julian; Barker, Andrew
- Computers & Mathematics with Applications, Vol. 81
Efficient numerical realization of discontinuous Galerkin methods for temporal discretization of parabolic problems
journal, October 2012
- Richter, Thomas; Springer, Andreas; Vexler, Boris
- Numerische Mathematik, Vol. 124, Issue 1
A splitting preconditioner for the iterative solution of implicit Runge-Kutta and boundary value methods
journal, January 2014
- Chen, Hao
- BIT Numerical Mathematics, Vol. 54, Issue 3
A High-Order Discontinuous Galerkin Method for 2D Incompressible Flows
journal, May 2000
- Liu, Jian-Guo; Shu, Chi-Wang
- Journal of Computational Physics, Vol. 160, Issue 2
Order optimal preconditioners for fully implicit Runge-Kutta schemes applied to the bidomain equations
journal, April 2010
- Nilssen, Trygve K.; Staff, Gunnar A.; Mardal, Kent-Andre
- Numerical Methods for Partial Differential Equations, Vol. 27, Issue 5
Approximate Riemann solvers, parameter vectors, and difference schemes
journal, October 1981
- Roe, P. L.
- Journal of Computational Physics, Vol. 43, Issue 2
Galerkin and Runge–Kutta methods: unified formulation, a posteriori error estimates and nodal superconvergence
journal, February 2011
- Akrivis, Georgios; Makridakis, Charalambos; Nochetto, Ricardo H.
- Numerische Mathematik, Vol. 118, Issue 3
Nonsymmetric Reduction-Based Algebraic Multigrid
journal, January 2019
- Manteuffel, Thomas A.; Münzenmaier, Steffen; Ruge, John
- SIAM Journal on Scientific Computing, Vol. 41, Issue 5
A second-order projection method for the incompressible navier-stokes equations
journal, December 1989
- Bell, John B.; Colella, Phillip; Glaz, Harland M.
- Journal of Computational Physics, Vol. 85, Issue 2
Time Discretization of Parabolic Problems by the HP-Version of the Discontinuous Galerkin Finite Element Method
journal, January 2000
- Schötzau, Dominik; Schwab, Christoph
- SIAM Journal on Numerical Analysis, Vol. 38, Issue 3
An Iteration Scheme for Implicit Runge—Kutta Methods
journal, January 1983
- Cooper, G. J.; Butcher, J. C.
- IMA Journal of Numerical Analysis, Vol. 3, Issue 2
Validation of a High-Order Large-Eddy Simulation Solver Using a Vertical-Axis Wind Turbine
journal, January 2016
- Kanner, Samuel; Persson, Per-Olof
- AIAA Journal, Vol. 54, Issue 1
Stability of the method of lines
journal, December 1992
- Reddy, Satish C.; Trefethen, Lloyd N.
- Numerische Mathematik, Vol. 62, Issue 1
Stiff differential equations solved by Radau methods
journal, November 1999
- Hairer, Ernst; Wanner, Gerhard
- Journal of Computational and Applied Mathematics, Vol. 111, Issue 1-2
A scheme for the implementation of implicit Runge-Kutta methods
journal, December 1990
- Cooper, G. J.; Vignesvaran, R.
- Computing, Vol. 45, Issue 4
Energy-conserving Runge–Kutta methods for the incompressible Navier–Stokes equations
journal, January 2013
- Sanderse, B.
- Journal of Computational Physics, Vol. 233
Order‐Optimal Preconditioners for Implicit Runge–Kutta Schemes Applied to Parabolic PDEs
journal, January 2007
- Mardal, K. ‐A.; Nilssen, T. K.; Staff, G. A.
- SIAM Journal on Scientific Computing, Vol. 29, Issue 1
On the efficient implementation of implicit Runge-Kutta methods
journal, January 1979
- Varah, J. M.
- Mathematics of Computation, Vol. 33, Issue 146
Stage-parallel fully implicit Runge–Kutta solvers for discontinuous Galerkin fluid simulations
journal, April 2017
- Pazner, Will; Persson, Per-Olof
- Journal of Computational Physics, Vol. 335
On the implementation of implicit Runge-Kutta methods
journal, September 1976
- Butcher, J. C.
- BIT, Vol. 16, Issue 3
Iterative schemes for three-stage implicit Runge-Kutta methods
journal, August 1995
- González-Pinto, S.; Montijano, J. I.; Rández, L.
- Applied Numerical Mathematics, Vol. 17, Issue 4
The Compact Discontinuous Galerkin (CDG) Method for Elliptic Problems
journal, January 2008
- Peraire, J.; Persson, P. -O.
- SIAM Journal on Scientific Computing, Vol. 30, Issue 4
Multigrid Methods for Implicit Runge--Kutta and Boundary Value Method Discretizations of Parabolic PDEs
journal, January 2005
- Van Lent, Jan; Vandewalle, Stefan
- SIAM Journal on Scientific Computing, Vol. 27, Issue 1
An Interior Penalty Finite Element Method with Discontinuous Elements
journal, August 1982
- Arnold, Douglas N.
- SIAM Journal on Numerical Analysis, Vol. 19, Issue 4
Preconditioners for the Discontinuous Galerkin time-stepping method of arbitrary order
journal, June 2017
- Basting, Steffen; Bänsch, Eberhard
- ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 51, Issue 4
High-order CFD methods: current status and perspective: HIGH-ORDER CFD METHODS
journal, January 2013
- Wang, Z. J.; Fidkowski, Krzysztof; Abgrall, Rémi
- International Journal for Numerical Methods in Fluids, Vol. 72, Issue 8
On Fixed-Point, Krylov, and $2\times 2$ Block Preconditioners for Nonsymmetric Problems
journal, January 2020
- Southworth, Ben S.; Sivas, Abdullah A.; Rhebergen, Sander
- SIAM Journal on Matrix Analysis and Applications, Vol. 41, Issue 2
Newton-GMRES Preconditioning for Discontinuous Galerkin Discretizations of the Navier–Stokes Equations
journal, January 2008
- Persson, P. -O.; Peraire, J.
- SIAM Journal on Scientific Computing, Vol. 30, Issue 6
Nonsymmetric Algebraic Multigrid Based on Local Approximate Ideal Restriction ($\ell$AIR)
journal, January 2018
- Manteuffel, Thomas A.; Ruge, John; Southworth, Ben S.
- SIAM Journal on Scientific Computing, Vol. 40, Issue 6
Improving the efficiency of the iterative schemes for implicit Runge-Kutta methods
journal, January 1996
- González-Pinto, S.; Montijano, J. I.; Rández, L.
- Journal of Computational and Applied Mathematics, Vol. 66, Issue 1-2
Galerkin and Runge–Kutta methods: unified formulation, a posteriori error estimates and nodal superconvergence
journal, February 2011
- Akrivis, Georgios; Makridakis, Charalambos; Nochetto, Ricardo H.
- Numerische Mathematik, Vol. 118, Issue 3
Improving the efficiency of the iterative schemes for implicit Runge-Kutta methods
journal, January 1996
- González-Pinto, S.; Montijano, J. I.; Rández, L.
- Journal of Computational and Applied Mathematics, Vol. 66, Issue 1-2
Energy-conserving Runge–Kutta methods for the incompressible Navier–Stokes equations
journal, January 2013
- Sanderse, B.
- Journal of Computational Physics, Vol. 233
A parallelizable preconditioner for the iterative solution of implicit Runge–Kutta-type methods
journal, November 1999
- Jay, Laurent O.; Braconnier, Thierry
- Journal of Computational and Applied Mathematics, Vol. 111, Issue 1-2
Robust and efficient preconditioners for the discontinuous Galerkin time-stepping method
journal, October 2016
- Smears, Iain
- IMA Journal of Numerical Analysis
Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part I: the Linear Setting
journal, February 2022
- Southworth, Ben S.; Krzysik, Oliver; Pazner, Will
- SIAM Journal on Scientific Computing, Vol. 44, Issue 1
Works referencing / citing this record:
Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part I: the Linear Setting
journal, February 2022
- Southworth, Ben S.; Krzysik, Oliver; Pazner, Will
- SIAM Journal on Scientific Computing, Vol. 44, Issue 1