DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms

Abstract

Here in this work we present a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dynamical system, the proposed approach requires only the non-polynomial terms in analytic form and learns the rest of the dynamics from snapshots computed with a potentially black-box full-model solver. The proposed method learns operators for the linear and polynomially nonlinear dynamics via a least-squares problem, where the given non-polynomial terms are incorporated on the right-hand side. The least-squares problem is linear and thus can be solved efficiently in practice. The proposed method is demonstrated on three problems governed by partial differential equations, namely the diffusion–reaction Chafee–Infante model, a tubular reactor model for reactive flows, and a batch-chromatography model that describes a chemical separation process. The numerical results provide evidence that the proposed approach learns reduced models that achieve comparable accuracy as models constructed with state-of-the-art intrusive model reduction methods that require full knowledge of the governing equations.

Authors:
 [1]; ORCiD logo [1]; ORCiD logo [2];  [3];  [4]
  1. Max Planck Institute for Dynamics of Complex Technical Systems, Magdeburg (Germany)
  2. Univ. of California, San Diego, CA (United States)
  3. New York Univ. (NYU), NY (United States)
  4. Univ. of Texas, Austin, TX (United States)
Publication Date:
Research Org.:
Univ. of Texas, Austin, TX (United States); New York Univ. (NYU), NY (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); US Air Force Center of Excellence; US Air Force Office of Scientific Research (AFOSR); National Science Foundation (NSF)
OSTI Identifier:
1853047
Alternate Identifier(s):
OSTI ID: 1670814
Grant/Contract Number:  
SC0019303; SC0019334; FA9550-17-1-0195; FA9550-15-1-0038; FA9550-18-1-0023; 1901091
Resource Type:
Accepted Manuscript
Journal Name:
Computer Methods in Applied Mechanics and Engineering
Additional Journal Information:
Journal Volume: 372; Journal Issue: C; Journal ID: ISSN 0045-7825
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; 97 MATHEMATICS AND COMPUTING; model reduction; data-driven modeling; nonlinear dynamical systems; scientific machine learning; operator inference

Citation Formats

Benner, Peter, Goyal, Pawan, Kramer, Boris, Peherstorfer, Benjamin, and Willcox, Karen. Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms. United States: N. p., 2020. Web. doi:10.1016/j.cma.2020.113433.
Benner, Peter, Goyal, Pawan, Kramer, Boris, Peherstorfer, Benjamin, & Willcox, Karen. Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms. United States. https://doi.org/10.1016/j.cma.2020.113433
Benner, Peter, Goyal, Pawan, Kramer, Boris, Peherstorfer, Benjamin, and Willcox, Karen. Wed . "Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms". United States. https://doi.org/10.1016/j.cma.2020.113433. https://www.osti.gov/servlets/purl/1853047.
@article{osti_1853047,
title = {Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms},
author = {Benner, Peter and Goyal, Pawan and Kramer, Boris and Peherstorfer, Benjamin and Willcox, Karen},
abstractNote = {Here in this work we present a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dynamical system, the proposed approach requires only the non-polynomial terms in analytic form and learns the rest of the dynamics from snapshots computed with a potentially black-box full-model solver. The proposed method learns operators for the linear and polynomially nonlinear dynamics via a least-squares problem, where the given non-polynomial terms are incorporated on the right-hand side. The least-squares problem is linear and thus can be solved efficiently in practice. The proposed method is demonstrated on three problems governed by partial differential equations, namely the diffusion–reaction Chafee–Infante model, a tubular reactor model for reactive flows, and a batch-chromatography model that describes a chemical separation process. The numerical results provide evidence that the proposed approach learns reduced models that achieve comparable accuracy as models constructed with state-of-the-art intrusive model reduction methods that require full knowledge of the governing equations.},
doi = {10.1016/j.cma.2020.113433},
journal = {Computer Methods in Applied Mechanics and Engineering},
number = C,
volume = 372,
place = {United States},
year = {Wed Oct 07 00:00:00 EDT 2020},
month = {Wed Oct 07 00:00:00 EDT 2020}
}

Works referenced in this record:

Quadrature-Based Vector Fitting for Discretized $\mathcal{H}_2$ Approximation
journal, January 2015

  • Drmač, Z.; Gugercin, S.; Beattie, C.
  • SIAM Journal on Scientific Computing, Vol. 37, Issue 2
  • DOI: 10.1137/140961511

The GNAT method for nonlinear model reduction: Effective implementation and application to computational fluid dynamics and turbulent flows
journal, June 2013

  • Carlberg, Kevin; Farhat, Charbel; Cortial, Julien
  • Journal of Computational Physics, Vol. 242
  • DOI: 10.1016/j.jcp.2013.02.028

Data-Driven Reduced Model Construction with Time-Domain Loewner Models
journal, January 2017

  • Peherstorfer, Benjamin; Gugercin, Serkan; Willcox, Karen
  • SIAM Journal on Scientific Computing, Vol. 39, Issue 5
  • DOI: 10.1137/16M1094750

Dynamic mode decomposition of numerical and experimental data
journal, July 2010


A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
journal, June 2015

  • Williams, Matthew O.; Kevrekidis, Ioannis G.; Rowley, Clarence W.
  • Journal of Nonlinear Science, Vol. 25, Issue 6
  • DOI: 10.1007/s00332-015-9258-5

A bifurcation problem for a nonlinear partial differential equation of parabolic type
journal, January 1974


Data-driven operator inference for nonintrusive projection-based model reduction
journal, July 2016

  • Peherstorfer, Benjamin; Willcox, Karen
  • Computer Methods in Applied Mechanics and Engineering, Vol. 306
  • DOI: 10.1016/j.cma.2016.03.025

An ‘empirical interpolation’ method: application to efficient reduced-basis discretization of partial differential equations
journal, November 2004

  • Barrault, Maxime; Maday, Yvon; Nguyen, Ngoc Cuong
  • Comptes Rendus Mathematique, Vol. 339, Issue 9
  • DOI: 10.1016/j.crma.2004.08.006

The important modes of subsystems: A moment-matching approach
journal, January 2007

  • Liao, Ben-Shan; Bai, Zhaojun; Gao, Weiguo
  • International Journal for Numerical Methods in Engineering, Vol. 70, Issue 13
  • DOI: 10.1002/nme.1940

Multiplicity, stability, and oscillatory dynamics of the tubular reactor
journal, January 1981


Extracting Sparse High-Dimensional Dynamics from Limited Data
journal, January 2018

  • Schaeffer, Hayden; Tran, Giang; Ward, Rachel
  • SIAM Journal on Applied Mathematics, Vol. 78, Issue 6
  • DOI: 10.1137/18M116798X

Data-Driven Filtered Reduced Order Modeling of Fluid Flows
journal, January 2018

  • Xie, X.; Mohebujjaman, M.; Rebholz, L. G.
  • SIAM Journal on Scientific Computing, Vol. 40, Issue 3
  • DOI: 10.1137/17M1145136

Calibrated reduced-order POD-Galerkin system for fluid flow modelling
journal, July 2005


Discovering governing equations from data by sparse identification of nonlinear dynamical systems
journal, March 2016

  • Brunton, Steven L.; Proctor, Joshua L.; Kutz, J. Nathan
  • Proceedings of the National Academy of Sciences, Vol. 113, Issue 15
  • DOI: 10.1073/pnas.1517384113

Data-driven discovery of partial differential equations
journal, April 2017

  • Rudy, Samuel H.; Brunton, Steven L.; Proctor, Joshua L.
  • Science Advances, Vol. 3, Issue 4
  • DOI: 10.1126/sciadv.1602614

A ‘best points’ interpolation method for efficient approximation of parametrized functions
journal, January 2008

  • Nguyen, N. C.; Patera, A. T.; Peraire, J.
  • International Journal for Numerical Methods in Engineering, Vol. 73, Issue 4
  • DOI: 10.1002/nme.2086

Data-driven model order reduction of quadratic-bilinear systems: The Loewner framework for QB systems
journal, July 2018

  • Gosea, Ion Victor; Antoulas, Athanasios C.
  • Numerical Linear Algebra with Applications, Vol. 25, Issue 6
  • DOI: 10.1002/nla.2200

Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations
journal, May 2007

  • Grepl, Martin A.; Maday, Yvon; Nguyen, Ngoc C.
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 41, Issue 3
  • DOI: 10.1051/m2an:2007031

Data-Driven Parametrized Model Reduction in the Loewner Framework
journal, January 2014

  • Ionita, A. C.; Antoulas, A. C.
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 3
  • DOI: 10.1137/130914619

Spectral analysis of nonlinear flows
journal, November 2009


Rational approximation of frequency domain responses by vector fitting
journal, July 1999

  • Gustavsen, B.; Semlyen, A.
  • IEEE Transactions on Power Delivery, Vol. 14, Issue 3
  • DOI: 10.1109/61.772353

Constrained sparse Galerkin regression
journal, January 2018

  • Loiseau, Jean-Christophe; Brunton, Steven L.
  • Journal of Fluid Mechanics, Vol. 838
  • DOI: 10.1017/jfm.2017.823

Data-driven reduced modelling of turbulent Rayleigh–Bénard convection using DMD-enhanced fluctuation–dissipation theorem
journal, August 2018

  • Khodkar, M. A.; Hassanzadeh, Pedram
  • Journal of Fluid Mechanics, Vol. 852
  • DOI: 10.1017/jfm.2018.586

Tangential interpolation-based eigensystem realization algorithm for MIMO systems
journal, June 2016


Data-driven structured realization
journal, January 2018

  • Schulze, Philipp; Unger, Benjamin; Beattie, Christopher
  • Linear Algebra and its Applications, Vol. 537
  • DOI: 10.1016/j.laa.2017.09.030

Reduced-order models for control of fluids using the eigensystem realization algorithm
journal, February 2010

  • Ma, Zhanhua; Ahuja, Sunil; Rowley, Clarence W.
  • Theoretical and Computational Fluid Dynamics, Vol. 25, Issue 1-4
  • DOI: 10.1007/s00162-010-0184-8

Transform & Learn: A data-driven approach to nonlinear model reduction
conference, June 2019

  • Qian, Elizabeth; Kramer, Boris; Marques, Alexandre N.
  • AIAA Aviation 2019 Forum
  • DOI: 10.2514/6.2019-3707

Generation, propagation, and annihilation of metastable patterns
journal, November 2004


A framework for the solution of the generalized realization problem
journal, September 2007


Turbulence and the dynamics of coherent structures. I. Coherent structures
journal, January 1987

  • Sirovich, Lawrence
  • Quarterly of Applied Mathematics, Vol. 45, Issue 3
  • DOI: 10.1090/qam/910462

Review and Unification of Methods for Computing Derivatives of Multidisciplinary Computational Models
journal, November 2013

  • Martins, Joaquim R. R. A.; Hwang, John T.
  • AIAA Journal, Vol. 51, Issue 11
  • DOI: 10.2514/1.J052184

Stability analysis and model order reduction of coupled systems
journal, October 2007

  • Reis, Timo; Stykel, Tatjana
  • Mathematical and Computer Modelling of Dynamical Systems, Vol. 13, Issue 5
  • DOI: 10.1080/13873950701189071

Nonlinear Model Reduction via Discrete Empirical Interpolation
journal, January 2010

  • Chaturantabut, Saifon; Sorensen, Danny C.
  • SIAM Journal on Scientific Computing, Vol. 32, Issue 5
  • DOI: 10.1137/090766498

Learning Physics-Based Reduced-Order Models for a Single-Injector Combustion Process
journal, June 2020

  • Swischuk, Renee; Kramer, Boris; Huang, Cheng
  • AIAA Journal, Vol. 58, Issue 6
  • DOI: 10.2514/1.J058943

Data-driven model order reduction of quadratic-bilinear systems: The Loewner framework for QB systems
journal, July 2018

  • Gosea, Ion Victor; Antoulas, Athanasios C.
  • Numerical Linear Algebra with Applications, Vol. 25, Issue 6
  • DOI: 10.1002/nla.2200

An ‘empirical interpolation’ method: application to efficient reduced-basis discretization of partial differential equations
journal, November 2004

  • Barrault, Maxime; Maday, Yvon; Nguyen, Ngoc Cuong
  • Comptes Rendus Mathematique, Vol. 339, Issue 9
  • DOI: 10.1016/j.crma.2004.08.006

Tangential interpolation-based eigensystem realization algorithm for MIMO systems
journal, June 2016


Rational approximation of frequency domain responses by vector fitting
journal, July 1999

  • Gustavsen, B.; Semlyen, A.
  • IEEE Transactions on Power Delivery, Vol. 14, Issue 3
  • DOI: 10.1109/61.772353

Numerical differentiation of noisy, nonsmooth, multidimensional data
conference, November 2017


Two-Sided Projection Methods for Nonlinear Model Order Reduction
journal, January 2015

  • Benner, Peter; Breiten, Tobias
  • SIAM Journal on Scientific Computing, Vol. 37, Issue 2
  • DOI: 10.1137/14097255x

Model Reduction of Bilinear Systems in the Loewner Framework
journal, January 2016

  • Antoulas, A. C.; Gosea, I. V.; Ionita, A. C.
  • SIAM Journal on Scientific Computing, Vol. 38, Issue 5
  • DOI: 10.1137/15m1041432

$\mathcal H_2$-Quasi-Optimal Model Order Reduction for Quadratic-Bilinear Control Systems
journal, January 2018

  • Benner, Peter; Goyal, Pawan; Gugercin, Serkan
  • SIAM Journal on Matrix Analysis and Applications, Vol. 39, Issue 2
  • DOI: 10.1137/16m1098280

System Identification via CUR-Factored Hankel Approximation
journal, January 2018

  • Kramer, Boris; Gorodetsky, Alex A.
  • SIAM Journal on Scientific Computing, Vol. 40, Issue 2
  • DOI: 10.1137/17m1137632

Works referencing / citing this record:

Toward fitting structured nonlinear systems by means of dynamic mode decomposition
preprint, January 2020


Learning reduced-order models of quadratic control systems from input-output data
preprint, January 2020


Determinant of a Sum of Certain Kronecker Products
preprint, January 2020