Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms
Abstract
Here in this work we present a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dynamical system, the proposed approach requires only the non-polynomial terms in analytic form and learns the rest of the dynamics from snapshots computed with a potentially black-box full-model solver. The proposed method learns operators for the linear and polynomially nonlinear dynamics via a least-squares problem, where the given non-polynomial terms are incorporated on the right-hand side. The least-squares problem is linear and thus can be solved efficiently in practice. The proposed method is demonstrated on three problems governed by partial differential equations, namely the diffusion–reaction Chafee–Infante model, a tubular reactor model for reactive flows, and a batch-chromatography model that describes a chemical separation process. The numerical results provide evidence that the proposed approach learns reduced models that achieve comparable accuracy as models constructed with state-of-the-art intrusive model reduction methods that require full knowledge of the governing equations.
- Authors:
-
- Max Planck Institute for Dynamics of Complex Technical Systems, Magdeburg (Germany)
- Univ. of California, San Diego, CA (United States)
- New York Univ. (NYU), NY (United States)
- Univ. of Texas, Austin, TX (United States)
- Publication Date:
- Research Org.:
- Univ. of Texas, Austin, TX (United States); New York Univ. (NYU), NY (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); US Air Force Center of Excellence; US Air Force Office of Scientific Research (AFOSR); National Science Foundation (NSF)
- OSTI Identifier:
- 1853047
- Alternate Identifier(s):
- OSTI ID: 1670814
- Grant/Contract Number:
- SC0019303; SC0019334; FA9550-17-1-0195; FA9550-15-1-0038; FA9550-18-1-0023; 1901091
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Computer Methods in Applied Mechanics and Engineering
- Additional Journal Information:
- Journal Volume: 372; Journal Issue: C; Journal ID: ISSN 0045-7825
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 42 ENGINEERING; 97 MATHEMATICS AND COMPUTING; model reduction; data-driven modeling; nonlinear dynamical systems; scientific machine learning; operator inference
Citation Formats
Benner, Peter, Goyal, Pawan, Kramer, Boris, Peherstorfer, Benjamin, and Willcox, Karen. Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms. United States: N. p., 2020.
Web. doi:10.1016/j.cma.2020.113433.
Benner, Peter, Goyal, Pawan, Kramer, Boris, Peherstorfer, Benjamin, & Willcox, Karen. Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms. United States. https://doi.org/10.1016/j.cma.2020.113433
Benner, Peter, Goyal, Pawan, Kramer, Boris, Peherstorfer, Benjamin, and Willcox, Karen. Wed .
"Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms". United States. https://doi.org/10.1016/j.cma.2020.113433. https://www.osti.gov/servlets/purl/1853047.
@article{osti_1853047,
title = {Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms},
author = {Benner, Peter and Goyal, Pawan and Kramer, Boris and Peherstorfer, Benjamin and Willcox, Karen},
abstractNote = {Here in this work we present a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dynamical system, the proposed approach requires only the non-polynomial terms in analytic form and learns the rest of the dynamics from snapshots computed with a potentially black-box full-model solver. The proposed method learns operators for the linear and polynomially nonlinear dynamics via a least-squares problem, where the given non-polynomial terms are incorporated on the right-hand side. The least-squares problem is linear and thus can be solved efficiently in practice. The proposed method is demonstrated on three problems governed by partial differential equations, namely the diffusion–reaction Chafee–Infante model, a tubular reactor model for reactive flows, and a batch-chromatography model that describes a chemical separation process. The numerical results provide evidence that the proposed approach learns reduced models that achieve comparable accuracy as models constructed with state-of-the-art intrusive model reduction methods that require full knowledge of the governing equations.},
doi = {10.1016/j.cma.2020.113433},
journal = {Computer Methods in Applied Mechanics and Engineering},
number = C,
volume = 372,
place = {United States},
year = {Wed Oct 07 00:00:00 EDT 2020},
month = {Wed Oct 07 00:00:00 EDT 2020}
}
Works referenced in this record:
Quadrature-Based Vector Fitting for Discretized $\mathcal{H}_2$ Approximation
journal, January 2015
- Drmač, Z.; Gugercin, S.; Beattie, C.
- SIAM Journal on Scientific Computing, Vol. 37, Issue 2
The GNAT method for nonlinear model reduction: Effective implementation and application to computational fluid dynamics and turbulent flows
journal, June 2013
- Carlberg, Kevin; Farhat, Charbel; Cortial, Julien
- Journal of Computational Physics, Vol. 242
Data-Driven Reduced Model Construction with Time-Domain Loewner Models
journal, January 2017
- Peherstorfer, Benjamin; Gugercin, Serkan; Willcox, Karen
- SIAM Journal on Scientific Computing, Vol. 39, Issue 5
Dynamic mode decomposition of numerical and experimental data
journal, July 2010
- Schmid, Peter J.
- Journal of Fluid Mechanics, Vol. 656
A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
journal, June 2015
- Williams, Matthew O.; Kevrekidis, Ioannis G.; Rowley, Clarence W.
- Journal of Nonlinear Science, Vol. 25, Issue 6
A bifurcation problem for a nonlinear partial differential equation of parabolic type †
journal, January 1974
- Chafee, N.; Infante, E. F.
- Applicable Analysis, Vol. 4, Issue 1
Data-driven operator inference for nonintrusive projection-based model reduction
journal, July 2016
- Peherstorfer, Benjamin; Willcox, Karen
- Computer Methods in Applied Mechanics and Engineering, Vol. 306
An ‘empirical interpolation’ method: application to efficient reduced-basis discretization of partial differential equations
journal, November 2004
- Barrault, Maxime; Maday, Yvon; Nguyen, Ngoc Cuong
- Comptes Rendus Mathematique, Vol. 339, Issue 9
The important modes of subsystems: A moment-matching approach
journal, January 2007
- Liao, Ben-Shan; Bai, Zhaojun; Gao, Weiguo
- International Journal for Numerical Methods in Engineering, Vol. 70, Issue 13
Accelerating PDE constrained optimization by the reducedbasis method: application to batch chromatography: Accelerating PDE constrained optimization by the reducedbasis method: application to batch chromatography
journal, June 2015
- Zhang, Yongjin; Feng, Lihong; Li, Suzhou
- International Journal for Numerical Methods in Engineering, Vol. 104, Issue 11
Multiplicity, stability, and oscillatory dynamics of the tubular reactor
journal, January 1981
- Heinemann, Robert F.; Poore, Aubrey B.
- Chemical Engineering Science, Vol. 36, Issue 8
Extracting Sparse High-Dimensional Dynamics from Limited Data
journal, January 2018
- Schaeffer, Hayden; Tran, Giang; Ward, Rachel
- SIAM Journal on Applied Mathematics, Vol. 78, Issue 6
Data-Driven Filtered Reduced Order Modeling of Fluid Flows
journal, January 2018
- Xie, X.; Mohebujjaman, M.; Rebholz, L. G.
- SIAM Journal on Scientific Computing, Vol. 40, Issue 3
Calibrated reduced-order POD-Galerkin system for fluid flow modelling
journal, July 2005
- Couplet, M.; Basdevant, C.; Sagaut, P.
- Journal of Computational Physics, Vol. 207, Issue 1
Discovering governing equations from data by sparse identification of nonlinear dynamical systems
journal, March 2016
- Brunton, Steven L.; Proctor, Joshua L.; Kutz, J. Nathan
- Proceedings of the National Academy of Sciences, Vol. 113, Issue 15
Data-driven discovery of partial differential equations
journal, April 2017
- Rudy, Samuel H.; Brunton, Steven L.; Proctor, Joshua L.
- Science Advances, Vol. 3, Issue 4
A ‘best points’ interpolation method for efficient approximation of parametrized functions
journal, January 2008
- Nguyen, N. C.; Patera, A. T.; Peraire, J.
- International Journal for Numerical Methods in Engineering, Vol. 73, Issue 4
Data-driven model order reduction of quadratic-bilinear systems: The Loewner framework for QB systems
journal, July 2018
- Gosea, Ion Victor; Antoulas, Athanasios C.
- Numerical Linear Algebra with Applications, Vol. 25, Issue 6
Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations
journal, May 2007
- Grepl, Martin A.; Maday, Yvon; Nguyen, Ngoc C.
- ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 41, Issue 3
Data-Driven Parametrized Model Reduction in the Loewner Framework
journal, January 2014
- Ionita, A. C.; Antoulas, A. C.
- SIAM Journal on Scientific Computing, Vol. 36, Issue 3
Spectral analysis of nonlinear flows
journal, November 2009
- Rowley, Clarence W.; MeziĆ, Igor; Bagheri, Shervin
- Journal of Fluid Mechanics, Vol. 641
Rational approximation of frequency domain responses by vector fitting
journal, July 1999
- Gustavsen, B.; Semlyen, A.
- IEEE Transactions on Power Delivery, Vol. 14, Issue 3
Constrained sparse Galerkin regression
journal, January 2018
- Loiseau, Jean-Christophe; Brunton, Steven L.
- Journal of Fluid Mechanics, Vol. 838
Data-driven reduced modelling of turbulent Rayleigh–Bénard convection using DMD-enhanced fluctuation–dissipation theorem
journal, August 2018
- Khodkar, M. A.; Hassanzadeh, Pedram
- Journal of Fluid Mechanics, Vol. 852
Tangential interpolation-based eigensystem realization algorithm for MIMO systems
journal, June 2016
- Kramer, B.; Gugercin, S.
- Mathematical and Computer Modelling of Dynamical Systems, Vol. 22, Issue 4
Data-driven structured realization
journal, January 2018
- Schulze, Philipp; Unger, Benjamin; Beattie, Christopher
- Linear Algebra and its Applications, Vol. 537
Reduced-order models for control of fluids using the eigensystem realization algorithm
journal, February 2010
- Ma, Zhanhua; Ahuja, Sunil; Rowley, Clarence W.
- Theoretical and Computational Fluid Dynamics, Vol. 25, Issue 1-4
Transform & Learn: A data-driven approach to nonlinear model reduction
conference, June 2019
- Qian, Elizabeth; Kramer, Boris; Marques, Alexandre N.
- AIAA Aviation 2019 Forum
Generation, propagation, and annihilation of metastable patterns
journal, November 2004
- Chen, Xinfu
- Journal of Differential Equations, Vol. 206, Issue 2
A framework for the solution of the generalized realization problem
journal, September 2007
- Mayo, A. J.; Antoulas, A. C.
- Linear Algebra and its Applications, Vol. 425, Issue 2-3
Turbulence and the dynamics of coherent structures. I. Coherent structures
journal, January 1987
- Sirovich, Lawrence
- Quarterly of Applied Mathematics, Vol. 45, Issue 3
Review and Unification of Methods for Computing Derivatives of Multidisciplinary Computational Models
journal, November 2013
- Martins, Joaquim R. R. A.; Hwang, John T.
- AIAA Journal, Vol. 51, Issue 11
Stability analysis and model order reduction of coupled systems
journal, October 2007
- Reis, Timo; Stykel, Tatjana
- Mathematical and Computer Modelling of Dynamical Systems, Vol. 13, Issue 5
Nonlinear Model Reduction via Discrete Empirical Interpolation
journal, January 2010
- Chaturantabut, Saifon; Sorensen, Danny C.
- SIAM Journal on Scientific Computing, Vol. 32, Issue 5
Learning Physics-Based Reduced-Order Models for a Single-Injector Combustion Process
journal, June 2020
- Swischuk, Renee; Kramer, Boris; Huang, Cheng
- AIAA Journal, Vol. 58, Issue 6
Data-driven model order reduction of quadratic-bilinear systems: The Loewner framework for QB systems
journal, July 2018
- Gosea, Ion Victor; Antoulas, Athanasios C.
- Numerical Linear Algebra with Applications, Vol. 25, Issue 6
An ‘empirical interpolation’ method: application to efficient reduced-basis discretization of partial differential equations
journal, November 2004
- Barrault, Maxime; Maday, Yvon; Nguyen, Ngoc Cuong
- Comptes Rendus Mathematique, Vol. 339, Issue 9
Tangential interpolation-based eigensystem realization algorithm for MIMO systems
journal, June 2016
- Kramer, B.; Gugercin, S.
- Mathematical and Computer Modelling of Dynamical Systems, Vol. 22, Issue 4
Rational approximation of frequency domain responses by vector fitting
journal, July 1999
- Gustavsen, B.; Semlyen, A.
- IEEE Transactions on Power Delivery, Vol. 14, Issue 3
Numerical differentiation of noisy, nonsmooth, multidimensional data
conference, November 2017
- Chartrand, Rick
- 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP)
Two-Sided Projection Methods for Nonlinear Model Order Reduction
journal, January 2015
- Benner, Peter; Breiten, Tobias
- SIAM Journal on Scientific Computing, Vol. 37, Issue 2
Model Reduction of Bilinear Systems in the Loewner Framework
journal, January 2016
- Antoulas, A. C.; Gosea, I. V.; Ionita, A. C.
- SIAM Journal on Scientific Computing, Vol. 38, Issue 5
$\mathcal H_2$-Quasi-Optimal Model Order Reduction for Quadratic-Bilinear Control Systems
journal, January 2018
- Benner, Peter; Goyal, Pawan; Gugercin, Serkan
- SIAM Journal on Matrix Analysis and Applications, Vol. 39, Issue 2
System Identification via CUR-Factored Hankel Approximation
journal, January 2018
- Kramer, Boris; Gorodetsky, Alex A.
- SIAM Journal on Scientific Computing, Vol. 40, Issue 2
Data-driven reduced modelling of turbulent Rayleigh-Benard convection using DMD-enhanced Fluctuation-Dissipation Theorem
text, January 2018
- Khodkar, M. A.; Hassanzadeh, Pedram
- arXiv
Works referencing / citing this record:
Toward fitting structured nonlinear systems by means of dynamic mode decomposition
preprint, January 2020
- Gosea, Ion Victor; Duff, Igor Pontes
- arXiv
Learning reduced-order models of quadratic control systems from input-output data
preprint, January 2020
- Gosea, Ion Victor; Karachalios, Dimitrios S.; Antoulas, Athanasios C.
- arXiv
Operator inference of non-Markovian terms for learning reduced models from partially observed state trajectories
preprint, January 2021
- Uy, Wayne Isaac Tan; Peherstorfer, Benjamin
- arXiv
LQResNet: A Deep Neural Network Architecture for Learning Dynamic Processes
preprint, January 2021
- Goyal, Pawan; Benner, Peter
- arXiv