Performance of explicit and IMEX MRI multirate methods on complex reactive flow problems within modern parallel adaptive structured grid frameworks
Abstract
Large-scale multiphysics simulations are computationally challenging due to the coupling of multiple processes with widely disparate time scales. The advent of exascale computing systems exacerbates these challenges since these systems enable ever-increasing size and complexity. In recent years, there has been renewed interest in developing multirate methods as a means to handle the large range of time scales, as these methods may afford greater accuracy and efficiency than more traditional approaches of using implicit-explicit (IMEX) and low-order operator splitting schemes. However, to date there have been few performance studies that compare different classes of multirate integrators on complex application problems. In this work, we study the performance of several newly developed multirate infinitesimal (MRI) methods, implemented in the SUNDIALS solver package, on two reacting flow model problems built on structured mesh frameworks. The first model revisits prior work on a compressible reacting flow problem with complex chemistry that is implemented using BoxLib but where we now include comparisons between a new explicit MRI scheme with the multirate spectral deferred correction (SDC) methods in the original paper. The second problem uses the same complex chemistry as the first problem, combined with a simplified flow model, but runs at a large spatialmore »
- Authors:
-
- Center for Applied Scientific Computing, Lawrence Livermore National Laboratory, Livermore, CA, USA
- Center for Computational Sciences and Engineering, Lawrence Berkeley National Laboratory, Berkeley, CA, USA
- Department of Mathematics, Southern Methodist University, Dallas, TX, USA
- Publication Date:
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 2311932
- Grant/Contract Number:
- Scientific Discovery through Advanced Computing (SciDAC)
- Resource Type:
- Published Article
- Journal Name:
- International Journal of High Performance Computing Applications
- Additional Journal Information:
- Journal Name: International Journal of High Performance Computing Applications; Journal ID: ISSN 1094-3420
- Publisher:
- SAGE Publications
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Loffeld, John J., Nonaka, Andy, Reynolds, Daniel R., Gardner, David J., and Woodward, Carol S. Performance of explicit and IMEX MRI multirate methods on complex reactive flow problems within modern parallel adaptive structured grid frameworks. United States: N. p., 2024.
Web. doi:10.1177/10943420241227914.
Loffeld, John J., Nonaka, Andy, Reynolds, Daniel R., Gardner, David J., & Woodward, Carol S. Performance of explicit and IMEX MRI multirate methods on complex reactive flow problems within modern parallel adaptive structured grid frameworks. United States. https://doi.org/10.1177/10943420241227914
Loffeld, John J., Nonaka, Andy, Reynolds, Daniel R., Gardner, David J., and Woodward, Carol S. Sun .
"Performance of explicit and IMEX MRI multirate methods on complex reactive flow problems within modern parallel adaptive structured grid frameworks". United States. https://doi.org/10.1177/10943420241227914.
@article{osti_2311932,
title = {Performance of explicit and IMEX MRI multirate methods on complex reactive flow problems within modern parallel adaptive structured grid frameworks},
author = {Loffeld, John J. and Nonaka, Andy and Reynolds, Daniel R. and Gardner, David J. and Woodward, Carol S.},
abstractNote = {Large-scale multiphysics simulations are computationally challenging due to the coupling of multiple processes with widely disparate time scales. The advent of exascale computing systems exacerbates these challenges since these systems enable ever-increasing size and complexity. In recent years, there has been renewed interest in developing multirate methods as a means to handle the large range of time scales, as these methods may afford greater accuracy and efficiency than more traditional approaches of using implicit-explicit (IMEX) and low-order operator splitting schemes. However, to date there have been few performance studies that compare different classes of multirate integrators on complex application problems. In this work, we study the performance of several newly developed multirate infinitesimal (MRI) methods, implemented in the SUNDIALS solver package, on two reacting flow model problems built on structured mesh frameworks. The first model revisits prior work on a compressible reacting flow problem with complex chemistry that is implemented using BoxLib but where we now include comparisons between a new explicit MRI scheme with the multirate spectral deferred correction (SDC) methods in the original paper. The second problem uses the same complex chemistry as the first problem, combined with a simplified flow model, but runs at a large spatial scale where explicit methods become infeasible due to stability constraints. Two recently developed IMEX MRI multirate methods are tested. These methods rely on advanced features of the AMReX framework on which the model is built, such as multilevel grids and multilevel preconditioners. The results from these two problems show that MRI multirate methods can offer significant performance benefits on complex multiphysics application problems and that these methods may be combined with advanced spatial discretization to compound the advantages of both.},
doi = {10.1177/10943420241227914},
journal = {International Journal of High Performance Computing Applications},
number = ,
volume = ,
place = {United States},
year = {Sun Feb 25 00:00:00 EST 2024},
month = {Sun Feb 25 00:00:00 EST 2024}
}
https://doi.org/10.1177/10943420241227914
Works referenced in this record:
A high-order spectral deferred correction strategy for low Mach number flow with complex chemistry
journal, March 2016
- Pazner, Will E.; Nonaka, Andrew; Bell, John B.
- Combustion Theory and Modelling, Vol. 20, Issue 3
A fourth-order adaptive mesh refinement algorithm for the multicomponent, reacting compressible Navier–Stokes equations
journal, January 2019
- Emmett, Matthew; Motheau, Emmanuel; Zhang, Weiqun
- Combustion Theory and Modelling, Vol. 23, Issue 4
Nyx: A Massively Parallel AMR Code for Computational Cosmology
journal, July 2021
- Sexton, Jean; Lukic, Zarija; Almgren, Ann
- Journal of Open Source Software, Vol. 6, Issue 63
Terascale direct numerical simulations of turbulent combustion using S3D
journal, January 2009
- Chen, J. H.; Choudhary, A.; de Supinski, B.
- Computational Science & Discovery, Vol. 2, Issue 1
Implicit-Explicit Multirate Infinitesimal GARK Methods
journal, January 2021
- Chinomona, Rujeko; Reynolds, Daniel R.
- SIAM Journal on Scientific Computing, Vol. 43, Issue 5
Conservative multi-implicit spectral deferred correction methods for reacting gas dynamics
journal, March 2004
- Layton, Anita T.; Minion, Michael L.
- Journal of Computational Physics, Vol. 194, Issue 2
A comparison of fourth-order operator splitting methods for cardiac simulations
journal, November 2019
- Cervi, Jessica; Spiteri, Raymond J.
- Applied Numerical Mathematics, Vol. 145
Improved Coupling of Hydrodynamics and Nuclear Reactions via Spectral Deferred Corrections
journal, November 2019
- Zingale, M.; Katz, M. P.; Bell, J. B.
- The Astrophysical Journal, Vol. 886, Issue 2
A 3(2) pair of Runge - Kutta formulas
journal, January 1989
- Bogacki, P.; Shampine, L. F.
- Applied Mathematics Letters, Vol. 2, Issue 4
Additive Runge–Kutta schemes for convection–diffusion–reaction equations
journal, January 2003
- Kennedy, Christopher A.; Carpenter, Mark H.
- Applied Numerical Mathematics, Vol. 44, Issue 1-2
Semi-implicit spectral deferred correction methods for ordinary differential equations
journal, January 2003
- Minion, Michael L.
- Communications in Mathematical Sciences, Vol. 1, Issue 3
On balanced approximations for time integration of multiple time scale systems
journal, March 2003
- Knoll, D. A.; Chacon, L.; Margolin, L. G.
- Journal of Computational Physics, Vol. 185, Issue 2
Nth-Order Operator Splitting Schemes and Nonreversible Systems
journal, February 1996
- Goldman, Daniel; Kaper, Tasso J.
- SIAM Journal on Numerical Analysis, Vol. 33, Issue 1
A New Class of High-Order Methods for Multirate Differential Equations
journal, January 2020
- Luan, Vu Thai; Chinomona, Rujeko; Reynolds, Daniel R.
- SIAM Journal on Scientific Computing, Vol. 42, Issue 2
Spectral Deferred Correction Methods for Ordinary Differential Equations
journal, June 2000
- Dutt, Alok; Greengard, Leslie; Rokhlin, Vladimir
- Bit Numerical Mathematics, Vol. 40, Issue 2, p. 241-266
AMReX: a framework for block-structured adaptive mesh refinement
journal, May 2019
- Zhang, Weiqun; Almgren, Ann; Beckner, Vince
- Journal of Open Source Software, Vol. 4, Issue 37
An A Posteriori–A Priori Analysis of Multiscale Operator Splitting
journal, January 2008
- Estep, D.; Ginting, V.; Ropp, D.
- SIAM Journal on Numerical Analysis, Vol. 46, Issue 3
A Class of Multirate Infinitesimal GARK Methods
journal, January 2019
- Sandu, Adrian
- SIAM Journal on Numerical Analysis, Vol. 57, Issue 5
BoxLib with Tiling: An Adaptive Mesh Refinement Software Framework
journal, January 2016
- Zhang, Weiqun; Almgren, Ann; Day, Marcus
- SIAM Journal on Scientific Computing, Vol. 38, Issue 5
xSDK Foundations: Toward an Extreme-scale Scientific Software Development Kit
journal, March 2017
- Bartlett, Roscoe; Demeshko, Irina; Gamblin, Todd
- Supercomputing Frontiers and Innovations, Vol. 4, Issue 1
A variable order Runge-Kutta method for initial value problems with rapidly varying right-hand sides
journal, September 1990
- Cash, J. R.; Karp, Alan H.
- ACM Transactions on Mathematical Software, Vol. 16, Issue 3
Multirate generalized additive Runge Kutta methods
journal, August 2015
- Günther, Michael; Sandu, Adrian
- Numerische Mathematik, Vol. 133, Issue 3
A deferred correction coupling strategy for low Mach number flow with complex chemistry
journal, December 2012
- Nonaka, A.; Bell, J. B.; Day, M. S.
- Combustion Theory and Modelling, Vol. 16, Issue 6
Stability of backward Euler multirate methods and convergence of waveform relaxation
journal, June 1992
- Sand, Jørgen; Skelboe, Stig
- BIT, Vol. 32, Issue 2
GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
journal, July 1986
- Saad, Youcef; Schultz, Martin H.
- SIAM Journal on Scientific and Statistical Computing, Vol. 7, Issue 3
Warp-X: A new exascale computing platform for beam–plasma simulations
journal, November 2018
- Vay, J. -L.; Almgren, A.; Bell, J.
- Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 909
Implicit-explicit Runge-Kutta methods for computing atmospheric reactive flows
journal, October 1998
- Knoth, Oswald; Wolke, Ralf
- Applied Numerical Mathematics, Vol. 28, Issue 2-4
Multirate Runge–Kutta schemes for advection equations
journal, April 2009
- Schlegel, Martin; Knoth, Oswald; Arnold, Martin
- Journal of Computational and Applied Mathematics, Vol. 226, Issue 2
Characteristic Chemical Time Scales for Reactive Flow Modeling
journal, May 2020
- Wartha, Eva-Maria; Bösenhofer, Markus; Harasek, Michael
- Combustion Science and Technology, Vol. 193, Issue 16
Implicit Multirate GARK Methods
journal, February 2021
- Roberts, Steven; Loffeld, John; Sarshar, Arash
- Journal of Scientific Computing, Vol. 87, Issue 1
High-order multi-implicit spectral deferred correction methods for problems of reactive flow
journal, August 2003
- Bourlioux, Anne; Layton, Anita T.; Minion, Michael L.
- Journal of Computational Physics, Vol. 189, Issue 2
On the Construction and Comparison of Difference Schemes
journal, September 1968
- Strang, Gilbert
- SIAM Journal on Numerical Analysis, Vol. 5, Issue 3
Enabling New Flexibility in the SUNDIALS Suite of Nonlinear and Differential/Algebraic Equation Solvers
journal, September 2022
- Gardner, David J.; Reynolds, Daniel R.; Woodward, Carol S.
- ACM Transactions on Mathematical Software, Vol. 48, Issue 3
High-order partitioned spectral deferred correction solvers for multiphysics problems
journal, July 2020
- Huang, Daniel Z.; Pazner, Will; Persson, Per-Olof
- Journal of Computational Physics, Vol. 412
ARKODE: A Flexible IVP Solver Infrastructure for One-step Methods
journal, June 2023
- Reynolds, Daniel R.; Gardner, David J.; Woodward, Carol S.
- ACM Transactions on Mathematical Software, Vol. 49, Issue 2
MAESTROeX: A Massively Parallel Low Mach Number Astrophysical Solver
journal, December 2019
- Fan, Duoming; Nonaka, Andrew; Almgren, Ann S.
- The Astrophysical Journal, Vol. 887, Issue 2
Numerical simulation of laminar reacting flows with complex chemistry
journal, December 2000
- Day, M. S.; Bell, J. B.
- Combustion Theory and Modelling, Vol. 4, Issue 4
Solving Ordinary Differential Equations II
book, September 1996
- Hairer, Ernst; Wanner, Gerhard
- Springer Series in Computational Mathematics
AMReX: Block-structured adaptive mesh refinement for multiphysics applications
journal, June 2021
- Zhang, Weiqun; Myers, Andrew; Gott, Kevin
- The International Journal of High Performance Computing Applications
An algorithm for point clustering and grid generation
journal, January 1991
- Berger, M.; Rigoutsos, I.
- IEEE Transactions on Systems, Man, and Cybernetics, Vol. 21, Issue 5
Low-storage, explicit Runge–Kutta schemes for the compressible Navier–Stokes equations
journal, November 2000
- Kennedy, Christopher A.; Carpenter, Mark H.; Lewis, R. Michael
- Applied Numerical Mathematics, Vol. 35, Issue 3
Implicit-Explicit Methods for Time-Dependent Partial Differential Equations
journal, June 1995
- Ascher, Uri M.; Ruuth, Steven J.; Wetton, Brian T. R.
- SIAM Journal on Numerical Analysis, Vol. 32, Issue 3
Multirate linear multistep methods
journal, December 1984
- Gear, C. W.; Wells, D. R.
- BIT, Vol. 24, Issue 4
Splitting methods
journal, January 2002
- McLachlan, Robert I.; Quispel, G. Reinout W.
- Acta Numerica, Vol. 11
A conservative, thermodynamically consistent numerical approach for low Mach number combustion. Part I: Single-level integration
journal, August 2017
- Nonaka, Andrew; Day, Marcus S.; Bell, John B.
- Combustion Theory and Modelling, Vol. 22, Issue 1
High-order algorithms for compressible reacting flow with complex chemistry
journal, May 2014
- Emmett, Matthew; Zhang, Weiqun; Bell, John B.
- Combustion Theory and Modelling, Vol. 18, Issue 3
SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
journal, September 2005
- Hindmarsh, Alan C.; Brown, Peter N.; Grant, Keith E.
- ACM Transactions on Mathematical Software, Vol. 31, Issue 3
Nyx: A MASSIVELY PARALLEL AMR CODE FOR COMPUTATIONAL COSMOLOGY
journal, February 2013
- Almgren, Ann S.; Bell, John B.; Lijewski, Mike J.
- The Astrophysical Journal, Vol. 765, Issue 1