Enabling New Flexibility in the SUNDIALS Suite of Nonlinear and Differential/Algebraic Equation Solvers

Gardner, Daniel J.; Reynolds, Daniel R.; Woodward, Carol S.; Balos, Cody J.

doi:10.1145/3539801

Enabling New Flexibility in the SUNDIALS Suite of Nonlinear and Differential/Algebraic Equation Solvers

Journal Article · Wed Jun 01 00:00:00 EDT 2022 · ACM Transactions on Mathematical Software

DOI:https://doi.org/10.1145/3539801· OSTI ID:1899425

^[1]; ^[2]; ^[1]; ^[1]

Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Southern Methodist Univ., Dallas, TX (United States)

In recent years, the SUite of Nonlinear and DIfferential/ALgebraic equation Solvers (SUNDIALS) has been redesigned to better enable the use of application-specific and third-party algebraic solvers and data structures. Throughout this work, we have adhered to specific guiding principles that minimized the impact to current users while providing maximum flexibility for later evolution of solvers and data structures. The redesign was done through the addition of new linear and nonlinear solvers classes, enhancements to the vector class, and the creation of modern Fortran interfaces. The vast majority of this work has been performed “behind-the-scenes,” with minimal changes to the user interface and no reduction in solver capabilities or performance. These changes allow SUNDIALS users to more easily utilize external solver libraries and create highly customized solvers, enabling greater flexibility on extreme-scale, heterogeneous computational architectures.

View Accepted Manuscript (DOE)

Research Organization:: Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Southern Methodist Univ., Dallas, TX (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR). Scientific Discovery through Advanced Computing (SciDAC)

Grant/Contract Number:: AC52-07NA27344; SC0021354

OSTI ID:: 1899425

Alternate ID(s):: OSTI ID: 1903124

Report Number(s):: LLNL-JRNL-816631; 1026332

Journal Information:: ACM Transactions on Mathematical Software, Journal Name: ACM Transactions on Mathematical Software Journal Issue: 3 Vol. 48; ISSN 0098-3500

Publisher:: Association for Computing MachineryCopyright Statement

Country of Publication:: United States

Language:: English

References (64)

Multirate Runge–Kutta schemes for advection equations Schlegel, Martin; Knoth, Oswald; Arnold, Martin Journal of Computational and Applied Mathematics, Vol. 226, Issue 2 https://doi.org/10.1016/j.cam.2008.08.009	journal	April 2009
Conservation laws and the numerical solution of ODEs, II Shampine, L. F. Computers & Mathematics with Applications, Vol. 38, Issue 2 https://doi.org/10.1016/s0898-1221(99)00183-2	journal	July 1999
Inexact Newton Methods Dembo, Ron S.; Eisenstat, Stanley C.; Steihaug, Trond SIAM Journal on Numerical Analysis, Vol. 19, Issue 2 https://doi.org/10.1137/0719025	journal	April 1982
Convergence Results for a Coordinate Projection Method Applied to Mechanical Systems with Algebraic Constraints Eich, Edda SIAM Journal on Numerical Analysis, Vol. 30, Issue 5 https://doi.org/10.1137/0730076	journal	October 1993
A Parallel Multigrid Preconditioned Conjugate Gradient Algorithm for Groundwater Flow Simulations Ashby, Steven F.; Falgout, Robert D. Nuclear Science and Engineering, Vol. 124, Issue 1 https://doi.org/10.13182/nse96-a24230	journal	September 1996
ODES: a high level interface to ODE and DAE solvers Malengier, Benny; Kišon, Pavol; Tocknell, James The Journal of Open Source Software, Vol. 3, Issue 22 https://doi.org/10.21105/joss.00165	journal	February 2018
Implementation of multirate time integration methods for air pollution modelling Schlegel, M.; Knoth, O.; Arnold, M. München : European Geopyhsical Union https://doi.org/10.34657/1015	text	January 2012
Implicit–explicit (IMEX) Runge–Kutta methods for non-hydrostatic atmospheric models Gardner, David J.; Guerra, Jorge E.; Hamon, François P. Geoscientific Model Development, Vol. 11, Issue 4 https://doi.org/10.5194/gmd-11-1497-2018	journal	January 2018
Solving Ordinary Differential Equations II Hairer, Ernst; Wanner, Gerhard Springer Series in Computational Mathematics https://doi.org/10.1007/978-3-642-05221-7	book	September 1996
Multigrid on Massively Parallel Architectures Falgout, Robert D.; Jones, Jim E. Lecture Notes in Computational Science and Engineering https://doi.org/10.1007/978-3-642-58312-4_13	book	January 2000
CasADi: a software framework for nonlinear optimization and optimal control Andersson, Joel A. E.; Gillis, Joris; Horn, Greg Mathematical Programming Computation, Vol. 11, Issue 1 https://doi.org/10.1007/s12532-018-0139-4	journal	July 2018
Stiff ODE solvers: A review of current and coming attractions Byrne, George D.; Hindmarsh, Alan C. Journal of Computational Physics, Vol. 70, Issue 1 https://doi.org/10.1016/0021-9991(87)90001-5	journal	May 1987
Reduced storage matrix methods in stiff ODE systems Brown, Peter N.; Hindmarsh, Alan C. Applied Mathematics and Computation, Vol. 31 https://doi.org/10.1016/0096-3003(89)90110-0	journal	May 1989
Numerical methods and software for sensitivity analysis of differential-algebraic systems Maly, Timothy; Petzold, Linda R. Applied Numerical Mathematics, Vol. 20, Issue 1-2 https://doi.org/10.1016/0168-9274(95)00117-4	journal	February 1996
Additive Runge–Kutta schemes for convection–diffusion–reaction equations Kennedy, Christopher A.; Carpenter, Mark H. Applied Numerical Mathematics, Vol. 44, Issue 1-2 https://doi.org/10.1016/S0168-9274(02)00138-1	journal	January 2003
Efficient sensitivity analysis of large-scale differential-algebraic systems Feehery, William F.; Tolsma, John E.; Barton, Paul I. Applied Numerical Mathematics, Vol. 25, Issue 1 https://doi.org/10.1016/S0168-9274(97)00050-0	journal	October 1997
Implicit-explicit Runge-Kutta methods for time-dependent partial differential equations Ascher, Uri M.; Ruuth, Steven J.; Spiteri, Raymond J. Applied Numerical Mathematics, Vol. 25, Issue 2-3 https://doi.org/10.1016/S0168-9274(97)00056-1	journal	November 1997
Software and algorithms for sensitivity analysis of large-scale differential algebraic systems Li, Shengtai; Petzold, Linda Journal of Computational and Applied Mathematics, Vol. 125, Issue 1-2 https://doi.org/10.1016/S0377-0427(00)00464-7	journal	December 2000
Adjoint sensitivity analysis for differential-algebraic equations: algorithms and software Cao, Yang; Li, Shengtai; Petzold, Linda Journal of Computational and Applied Mathematics, Vol. 149, Issue 1 https://doi.org/10.1016/S0377-0427(02)00528-9	journal	December 2002
Conservation laws and the numerical solution of ODEs, II Shampine, L. F. Computers & Mathematics with Applications, Vol. 38, Issue 2 https://doi.org/10.1016/S0898-1221(99)00183-2	journal	July 1999
Numerical solution of multiscale problems in atmospheric modeling Schlegel, Martin; Knoth, Oswald; Arnold, Martin Applied Numerical Mathematics, Vol. 62, Issue 10 https://doi.org/10.1016/j.apnum.2012.06.023	journal	October 2012
Higher-order additive Runge–Kutta schemes for ordinary differential equations Kennedy, Christopher A.; Carpenter, Mark H. Applied Numerical Mathematics, Vol. 136 https://doi.org/10.1016/j.apnum.2018.10.007	journal	February 2019
MFEM: A modular finite element methods library Anderson, Robert; Andrej, Julian; Barker, Andrew Computers & Mathematics with Applications, Vol. 81 https://doi.org/10.1016/j.camwa.2020.06.009	journal	January 2021
BOUT++: A framework for parallel plasma fluid simulations Dudson, B. D.; Umansky, M. V.; Xu, X. Q. Computer Physics Communications, Vol. 180, Issue 9 https://doi.org/10.1016/j.cpc.2009.03.008	journal	September 2009
A numerical algorithm for the solution of a phase-field model of polycrystalline materials Dorr, M. R.; Fattebert, J. -L.; Wickett, M. E. Journal of Computational Physics, Vol. 229, Issue 3 https://doi.org/10.1016/j.jcp.2009.09.041	journal	February 2010
Towards dense linear algebra for hybrid GPU accelerated manycore systems Tomov, Stanimire; Dongarra, Jack; Baboulin, Marc Parallel Computing, Vol. 36, Issue 5-6 https://doi.org/10.1016/j.parco.2009.12.005	journal	June 2010
Enabling GPU accelerated computing in the SUNDIALS time integration library Balos, Cody J.; Gardner, David J.; Woodward, Carol S. Parallel Computing, Vol. 108 https://doi.org/10.1016/j.parco.2021.102836	journal	December 2021
Faster solvers for large kinetic mechanisms using adaptive preconditioners McNenly, Matthew J.; Whitesides, Russell A.; Flowers, Daniel L. Proceedings of the Combustion Institute, Vol. 35, Issue 1 https://doi.org/10.1016/j.proci.2014.05.113	journal	January 2015
Proof of concept of regional scale hydrologic simulations at hydrologic resolution utilizing massively parallel computer resources: RAPID COMMUNICATION Kollet, Stefan J.; Maxwell, Reed M.; Woodward, Carol S. Water Resources Research, Vol. 46, Issue 4 https://doi.org/10.1029/2009WR008730	journal	April 2010
Evaluation of Implicit‐Explicit Additive Runge‐Kutta Integrators for the HOMME‐NH Dynamical Core Vogl, Christopher J.; Steyer, Andrew; Reynolds, Daniel R. Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 12 https://doi.org/10.1029/2019MS001700	journal	December 2019
Algorithms and software for ordinary differential equations and differential- algebraic equations, Part I: Euler methods and error estimation Hindmarsh, Alan C.; Petzold, Linda R. Computers in Physics, Vol. 9, Issue 1 https://doi.org/10.1063/1.168536	journal	January 1995
Algorithms and software for ordinary differential equations and differential- algebraic equations, Part II: Higher-order methods and software packages Hindmarsh, Alan C.; Petzold, Linda R. Computers in Physics, Vol. 9, Issue 2 https://doi.org/10.1063/1.168540	journal	January 1995
Implicit integration methods for dislocation dynamics Gardner, D. J.; Woodward, C. S.; Reynolds, D. R. Modelling and Simulation in Materials Science and Engineering, Vol. 23, Issue 2 https://doi.org/10.1088/0965-0393/23/2/025006	journal	January 2015
SBaddon: high performance simulation for the Systems Biology Toolbox for MATLAB Schmidt, H. Bioinformatics, Vol. 23, Issue 5 https://doi.org/10.1093/bioinformatics/btl668	journal	January 2007
Automated Fortran–C++ Bindings for Large-Scale Scientific Applications Johnson, Seth R.; Prokopenko, Andrey; Evans, Katherine J. Computing in Science & Engineering, Vol. 22, Issue 5 https://doi.org/10.1109/MCSE.2019.2924204	journal	September 2020
CVODES: The Sensitivity-Enabled ODE Solver in SUNDIALS Serban, Radu; Hindmarsh, Alan C. Volume 6: 5th International Conference on Multibody Systems, Nonlinear Dynamics, and Control, Parts A, B, and C https://doi.org/10.1115/DETC2005-85597	conference	January 2005
Matrix-Free Methods for Stiff Systems of ODE’s Brown, Peter N.; Hindmarsh, Alan C. SIAM Journal on Numerical Analysis, Vol. 23, Issue 3 https://doi.org/10.1137/0723039	journal	June 1986
Implicit-Explicit Methods for Time-Dependent Partial Differential Equations Ascher, Uri M.; Ruuth, Steven J.; Wetton, Brian T. R. SIAM Journal on Numerical Analysis, Vol. 32, Issue 3 https://doi.org/10.1137/0732037	journal	June 1995
VODE: A Variable-Coefficient ODE Solver Brown, Peter N.; Byrne, George D.; Hindmarsh, Alan C. SIAM Journal on Scientific and Statistical Computing, Vol. 10, Issue 5 https://doi.org/10.1137/0910062	journal	September 1989
Hybrid Krylov Methods for Nonlinear Systems of Equations Brown, Peter N.; Saad, Youcef SIAM Journal on Scientific and Statistical Computing, Vol. 11, Issue 3 https://doi.org/10.1137/0911026	journal	May 1990
Using Krylov Methods in the Solution of Large-Scale Differential-Algebraic Systems Brown, Peter N.; Hindmarsh, Alan C.; Petzold, Linda R. SIAM Journal on Scientific Computing, Vol. 15, Issue 6 https://doi.org/10.1137/0915088	journal	November 1994
Iterative Solution of Nonlinear Equations in Several Variables Ortega, J. M.; Rheinboldt, W. C. Classics in Applied Mathematics https://doi.org/10.1137/1.9780898719468	book	January 2000
LAPACK Users' Guide Anderson, E.; Bai, Z.; Bischof, C. https://doi.org/10.1137/1.9780898719604	software	January 1999
Numerical Methods for Unconstrained Optimization and Nonlinear Equations Dennis, J. E.; Schnabel, Robert B. Classics in Applied Mathematics https://doi.org/10.1137/1.9781611971200	book	January 1996
Numerical Solution of Initial-Value Problems in Differential-Algebraic Equations Brenan, K. E.; Campbell, S. L.; Petzold, L. R. Classics in Applied Mathematics https://doi.org/10.1137/1.9781611971224	book	January 1995
Anderson Acceleration for Fixed-Point Iterations Walker, Homer F.; Ni, Peng SIAM Journal on Numerical Analysis, Vol. 49, Issue 4 https://doi.org/10.1137/10078356X	journal	January 2011
A Class of Multirate Infinitesimal GARK Methods Sandu, Adrian SIAM Journal on Numerical Analysis, Vol. 57, Issue 5 https://doi.org/10.1137/18M1205492	journal	January 2019
An Asynchronous Parallel Supernodal Algorithm for Sparse Gaussian Elimination Demmel, James W.; Gilbert, John R.; Li, Xiaoye S. SIAM Journal on Matrix Analysis and Applications, Vol. 20, Issue 4 https://doi.org/10.1137/S0895479897317685	journal	January 1999
Consistent Initial Condition Calculation for Differential-Algebraic Systems Brown, Peter N.; Hindmarsh, Alan C.; Petzold, Linda R. SIAM Journal on Scientific Computing, Vol. 19, Issue 5 https://doi.org/10.1137/S1064827595289996	journal	September 1998
NITSOL: A Newton Iterative Solver for Nonlinear Systems Pernice, Michael; Walker, Homer F. SIAM Journal on Scientific Computing, Vol. 19, Issue 1 https://doi.org/10.1137/S1064827596303843	journal	January 1998
SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers Hindmarsh, Alan C.; Brown, Peter N.; Grant, Keith E. ACM Transactions on Mathematical Software, Vol. 31, Issue 3 https://doi.org/10.1145/1089014.1089020	journal	September 2005
LSODE and LSODI, two new initial value ordinary differnetial equation solvers Hindmarsh, Alan C. ACM SIGNUM Newsletter, Vol. 15, Issue 4 https://doi.org/10.1145/1218052.1218054	journal	December 1980
Algorithm 907: KLU, A Direct Sparse Solver for Circuit Simulation Problems Davis, Timothy A.; Palamadai Natarajan, Ekanathan ACM Transactions on Mathematical Software, Vol. 37, Issue 3 https://doi.org/10.1145/1824801.1824814	journal	September 2010
Iterative Procedures for Nonlinear Integral Equations Anderson, Donald G. Journal of the ACM, Vol. 12, Issue 4 https://doi.org/10.1145/321296.321305	journal	October 1965
Preparation and optimization of a diverse workload for a large-scale heterogeneous system Karlin, Ian; Park, Yoonho; de Supinski, Bronis R. SC '19: The International Conference for High Performance Computing, Networking, Storage, and Analysis, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3295500.3356192	conference	November 2019
A Polyalgorithm for the Numerical Solution of Ordinary Differential Equations Byrne, G. D.; Hindmarsh, A. C. ACM Transactions on Mathematical Software, Vol. 1, Issue 1 https://doi.org/10.1145/355626.355636	journal	March 1975
An Alternative Implementation of Variable Step-Size Multistep Formulas for Stiff ODEs Jackson, K. R.; Sacks-Davis, R. ACM Transactions on Mathematical Software, Vol. 6, Issue 3 https://doi.org/10.1145/355900.355903	journal	September 1980
SuperLU_DIST: A scalable distributed-memory sparse direct solver for unsymmetric linear systems Li, Xiaoye S.; Demmel, James W. ACM Transactions on Mathematical Software, Vol. 29, Issue 2 https://doi.org/10.1145/779359.779361	journal	June 2003
AMReX: Block-structured adaptive mesh refinement for multiphysics applications Zhang, Weiqun; Myers, Andrew; Gott, Kevin The International Journal of High Performance Computing Applications https://doi.org/10.1177/10943420211022811	journal	June 2021
A Parallel Multigrid Preconditioned Conjugate Gradient Algorithm for Groundwater Flow Simulations Ashby, Steven F.; Falgout, Robert D. Nuclear Science and Engineering, Vol. 124, Issue 1 https://doi.org/10.13182/NSE96-A24230	journal	September 1996
The deal.II library, Version 9.2 Arndt, Daniel; Bangerth, Wolfgang; Blais, Bruno Journal of Numerical Mathematics, Vol. 28, Issue 3 https://doi.org/10.1515/jnma-2020-0043	journal	September 2020
Implementation of multirate time integration methods for air pollution modelling Schlegel, M.; Knoth, O.; Arnold, M. Geoscientific Model Development, Vol. 5, Issue 6 https://doi.org/10.5194/gmd-5-1395-2012	journal	November 2012
Cantera: An Object-oriented Software Toolkit for Chemical Kinetics, Thermodynamics, and Transport Processes Goodwin, David G.; Speth, Raymond L.; Moffat, Harry K. https://doi.org/10.5281/zenodo.1174508	software	August 2018
DifferentialEquations.jl – A Performant and Feature-Rich Ecosystem for Solving Differential Equations in Julia Rackauckas, Christopher; Nie, Qing Journal of Open Research Software, Vol. 5 https://doi.org/10.5334/jors.151	journal	May 2017

Similar Records

SUNDIALS Multiphysics+MPIManyVector Performance Testing

Technical Report · Thu Sep 26 00:00:00 EDT 2019 · OSTI ID:1567994

Matlab MEX-binding for SUNDIALS v2.1.1

Software · Thu May 19 00:00:00 EDT 2005 · OSTI ID:1230781

Related Subjects

97 MATHEMATICS AND COMPUTING
Numerical software
object-oriented design
time integration
nonlinear solvers
high-performance computing
differential algebraic equations
high-performance computing
mathematics and computing
nonlinear equations
nonlinear solvers
numerical software
object-oriented design
ordinary differential equations
time integration

Enabling New Flexibility in the SUNDIALS Suite of Nonlinear and Differential/Algebraic Equation Solvers

Citation Formats

References (64)

Similar Records

Related Subjects