DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs

Abstract

Fully implicit Runge--Kutta (IRK) methods have many desirable accuracy and stability properties as time integration schemes, but high-order IRK methods are not commonly used in practice with large-scale numerical PDEs because of the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic framework for solving the nonlinear equations that arise from IRK methods (and discontinuous Galerkin discretizations in time) applied to nonlinear numerical PDEs, including PDEs with algebraic constraints. Several new linearizations of the nonlinear IRK equations are developed, offering faster and more robust convergence than the often-considered simplified Newton, as well as an effective preconditioner for the true Jacobian if exact Newton iterations are desired. Inverting these linearizations requires solving a set of block 2 x 2 systems. Under quite general assumptions, it is proven that the preconditioned 2 x 2 operator's condition number is bounded by a small constant close to one, independent of the spatial discretization, spatial mesh, and time step, and with only weak dependence on the number of stages or integration accuracy. Moreover, the new method is built using the same preconditioners needed for backward Euler-type time stepping schemes, so can be readily added to existing codes. The new methods aremore » applied to several challenging fluid flow problems, including the compressible Euler and Navier--Stokes equations, and the vorticity-streamfunction formulation of the incompressible Euler and Navier--Stokes equations. Up to 10th-order accuracy is demonstrated using Gauss IRK, while in all cases fourth-order Gauss IRK requires roughly half the number of preconditioner applications as required by standard Singly diagonally implicit Runge--Kutta methods.« less

Authors:
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3]
  1. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
  2. Monash Univ., Melbourne, VIC (Australia)
  3. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States). Center for Applied Scientific Computing
Publication Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1873332
Report Number(s):
LA-UR-20-30444
Journal ID: ISSN 1064-8275
Grant/Contract Number:  
89233218CNA000001
Resource Type:
Accepted Manuscript
Journal Name:
SIAM Journal on Scientific Computing
Additional Journal Information:
Journal Volume: 44; Journal Issue: 2; Journal ID: ISSN 1064-8275
Publisher:
Society for Industrial and Applied Mathematics (SIAM)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; Runge-Kutta; numerical PDEs; preconditioning; Navier-Stokes; time integration

Citation Formats

Southworth, Ben S., Krzysik, Oliver, and Pazner, Will. Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs. United States: N. p., 2022. Web. doi:10.1137/21m1390438.
Southworth, Ben S., Krzysik, Oliver, & Pazner, Will. Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs. United States. https://doi.org/10.1137/21m1390438
Southworth, Ben S., Krzysik, Oliver, and Pazner, Will. Mon . "Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs". United States. https://doi.org/10.1137/21m1390438. https://www.osti.gov/servlets/purl/1873332.
@article{osti_1873332,
title = {Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part II: Nonlinearities and DAEs},
author = {Southworth, Ben S. and Krzysik, Oliver and Pazner, Will},
abstractNote = {Fully implicit Runge--Kutta (IRK) methods have many desirable accuracy and stability properties as time integration schemes, but high-order IRK methods are not commonly used in practice with large-scale numerical PDEs because of the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic framework for solving the nonlinear equations that arise from IRK methods (and discontinuous Galerkin discretizations in time) applied to nonlinear numerical PDEs, including PDEs with algebraic constraints. Several new linearizations of the nonlinear IRK equations are developed, offering faster and more robust convergence than the often-considered simplified Newton, as well as an effective preconditioner for the true Jacobian if exact Newton iterations are desired. Inverting these linearizations requires solving a set of block 2 x 2 systems. Under quite general assumptions, it is proven that the preconditioned 2 x 2 operator's condition number is bounded by a small constant close to one, independent of the spatial discretization, spatial mesh, and time step, and with only weak dependence on the number of stages or integration accuracy. Moreover, the new method is built using the same preconditioners needed for backward Euler-type time stepping schemes, so can be readily added to existing codes. The new methods are applied to several challenging fluid flow problems, including the compressible Euler and Navier--Stokes equations, and the vorticity-streamfunction formulation of the incompressible Euler and Navier--Stokes equations. Up to 10th-order accuracy is demonstrated using Gauss IRK, while in all cases fourth-order Gauss IRK requires roughly half the number of preconditioner applications as required by standard Singly diagonally implicit Runge--Kutta methods.},
doi = {10.1137/21m1390438},
journal = {SIAM Journal on Scientific Computing},
number = 2,
volume = 44,
place = {United States},
year = {Mon Mar 14 00:00:00 EDT 2022},
month = {Mon Mar 14 00:00:00 EDT 2022}
}

Works referenced in this record:

Inexact Simplified Newton Iterations for Implicit Runge-Kutta Methods
journal, January 2000


Preconditioning of fully implicit Runge-Kutta schemes for parabolic PDEs
journal, January 2006

  • Staff, Gunnar A.; Mardal, Kent-Andre; Nilssen, Trygve K.
  • Modeling, Identification and Control: A Norwegian Research Bulletin, Vol. 27, Issue 2
  • DOI: 10.4173/mic.2006.2.3

An Efficient Solution Process for Implicit Runge–Kutta Methods
journal, December 1977

  • Bickart, Theodore A.
  • SIAM Journal on Numerical Analysis, Vol. 14, Issue 6
  • DOI: 10.1137/0714069

A posteriori error analysis for higher order dissipative methods for evolution problems
journal, September 2006


MFEM: A modular finite element methods library
journal, January 2021


Efficient numerical realization of discontinuous Galerkin methods for temporal discretization of parabolic problems
journal, October 2012


A High-Order Discontinuous Galerkin Method for 2D Incompressible Flows
journal, May 2000

  • Liu, Jian-Guo; Shu, Chi-Wang
  • Journal of Computational Physics, Vol. 160, Issue 2
  • DOI: 10.1006/jcph.2000.6475

Order optimal preconditioners for fully implicit Runge-Kutta schemes applied to the bidomain equations
journal, April 2010

  • Nilssen, Trygve K.; Staff, Gunnar A.; Mardal, Kent-Andre
  • Numerical Methods for Partial Differential Equations, Vol. 27, Issue 5
  • DOI: 10.1002/num.20582

Approximate Riemann solvers, parameter vectors, and difference schemes
journal, October 1981


Galerkin and Runge–Kutta methods: unified formulation, a posteriori error estimates and nodal superconvergence
journal, February 2011

  • Akrivis, Georgios; Makridakis, Charalambos; Nochetto, Ricardo H.
  • Numerische Mathematik, Vol. 118, Issue 3
  • DOI: 10.1007/s00211-011-0363-6

Nonsymmetric Reduction-Based Algebraic Multigrid
journal, January 2019

  • Manteuffel, Thomas A.; Münzenmaier, Steffen; Ruge, John
  • SIAM Journal on Scientific Computing, Vol. 41, Issue 5
  • DOI: 10.1137/18M1193761

A second-order projection method for the incompressible navier-stokes equations
journal, December 1989


Time Discretization of Parabolic Problems by the HP-Version of the Discontinuous Galerkin Finite Element Method
journal, January 2000


An Iteration Scheme for Implicit Runge—Kutta Methods
journal, January 1983

  • Cooper, G. J.; Butcher, J. C.
  • IMA Journal of Numerical Analysis, Vol. 3, Issue 2
  • DOI: 10.1093/imanum/3.2.127

Validation of a High-Order Large-Eddy Simulation Solver Using a Vertical-Axis Wind Turbine
journal, January 2016

  • Kanner, Samuel; Persson, Per-Olof
  • AIAA Journal, Vol. 54, Issue 1
  • DOI: 10.2514/1.J054138

Stability of the method of lines
journal, December 1992

  • Reddy, Satish C.; Trefethen, Lloyd N.
  • Numerische Mathematik, Vol. 62, Issue 1
  • DOI: 10.1007/BF01396228

Stiff differential equations solved by Radau methods
journal, November 1999


A scheme for the implementation of implicit Runge-Kutta methods
journal, December 1990


Energy-conserving Runge–Kutta methods for the incompressible Navier–Stokes equations
journal, January 2013


Order‐Optimal Preconditioners for Implicit Runge–Kutta Schemes Applied to Parabolic PDEs
journal, January 2007

  • Mardal, K. ‐A.; Nilssen, T. K.; Staff, G. A.
  • SIAM Journal on Scientific Computing, Vol. 29, Issue 1
  • DOI: 10.1137/05064093X

On the efficient implementation of implicit Runge-Kutta methods
journal, January 1979


Stage-parallel fully implicit Runge–Kutta solvers for discontinuous Galerkin fluid simulations
journal, April 2017


On the implementation of implicit Runge-Kutta methods
journal, September 1976


Iterative schemes for three-stage implicit Runge-Kutta methods
journal, August 1995


The Compact Discontinuous Galerkin (CDG) Method for Elliptic Problems
journal, January 2008

  • Peraire, J.; Persson, P. -O.
  • SIAM Journal on Scientific Computing, Vol. 30, Issue 4
  • DOI: 10.1137/070685518

Multigrid Methods for Implicit Runge--Kutta and Boundary Value Method Discretizations of Parabolic PDEs
journal, January 2005

  • Van Lent, Jan; Vandewalle, Stefan
  • SIAM Journal on Scientific Computing, Vol. 27, Issue 1
  • DOI: 10.1137/030601144

An Interior Penalty Finite Element Method with Discontinuous Elements
journal, August 1982

  • Arnold, Douglas N.
  • SIAM Journal on Numerical Analysis, Vol. 19, Issue 4
  • DOI: 10.1137/0719052

Preconditioners for the Discontinuous Galerkin time-stepping method of arbitrary order
journal, June 2017

  • Basting, Steffen; Bänsch, Eberhard
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 51, Issue 4
  • DOI: 10.1051/m2an/2016055

High-order CFD methods: current status and perspective: HIGH-ORDER CFD METHODS
journal, January 2013

  • Wang, Z. J.; Fidkowski, Krzysztof; Abgrall, Rémi
  • International Journal for Numerical Methods in Fluids, Vol. 72, Issue 8
  • DOI: 10.1002/fld.3767

On Fixed-Point, Krylov, and $2\times 2$ Block Preconditioners for Nonsymmetric Problems
journal, January 2020

  • Southworth, Ben S.; Sivas, Abdullah A.; Rhebergen, Sander
  • SIAM Journal on Matrix Analysis and Applications, Vol. 41, Issue 2
  • DOI: 10.1137/19M1298317

Newton-GMRES Preconditioning for Discontinuous Galerkin Discretizations of the Navier–Stokes Equations
journal, January 2008

  • Persson, P. -O.; Peraire, J.
  • SIAM Journal on Scientific Computing, Vol. 30, Issue 6
  • DOI: 10.1137/070692108

Nonsymmetric Algebraic Multigrid Based on Local Approximate Ideal Restriction ($\ell$AIR)
journal, January 2018

  • Manteuffel, Thomas A.; Ruge, John; Southworth, Ben S.
  • SIAM Journal on Scientific Computing, Vol. 40, Issue 6
  • DOI: 10.1137/17M1144350

Improving the efficiency of the iterative schemes for implicit Runge-Kutta methods
journal, January 1996

  • González-Pinto, S.; Montijano, J. I.; Rández, L.
  • Journal of Computational and Applied Mathematics, Vol. 66, Issue 1-2
  • DOI: 10.1016/0377-0427(95)00184-0

Galerkin and Runge–Kutta methods: unified formulation, a posteriori error estimates and nodal superconvergence
journal, February 2011

  • Akrivis, Georgios; Makridakis, Charalambos; Nochetto, Ricardo H.
  • Numerische Mathematik, Vol. 118, Issue 3
  • DOI: 10.1007/s00211-011-0363-6

Improving the efficiency of the iterative schemes for implicit Runge-Kutta methods
journal, January 1996

  • González-Pinto, S.; Montijano, J. I.; Rández, L.
  • Journal of Computational and Applied Mathematics, Vol. 66, Issue 1-2
  • DOI: 10.1016/0377-0427(95)00184-0

Energy-conserving Runge–Kutta methods for the incompressible Navier–Stokes equations
journal, January 2013


A parallelizable preconditioner for the iterative solution of implicit Runge–Kutta-type methods
journal, November 1999


Robust and efficient preconditioners for the discontinuous Galerkin time-stepping method
journal, October 2016


Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part I: the Linear Setting
journal, February 2022

  • Southworth, Ben S.; Krzysik, Oliver; Pazner, Will
  • SIAM Journal on Scientific Computing, Vol. 44, Issue 1
  • DOI: 10.1137/21m1389742

Works referencing / citing this record:

Fast Solution of Fully Implicit Runge--Kutta and Discontinuous Galerkin in Time for Numerical PDEs, Part I: the Linear Setting
journal, February 2022

  • Southworth, Ben S.; Krzysik, Oliver; Pazner, Will
  • SIAM Journal on Scientific Computing, Vol. 44, Issue 1
  • DOI: 10.1137/21m1389742