DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Operator inference for non-intrusive model reduction with quadratic manifolds

Abstract

This paper proposes a novel approach for learning a data-driven quadratic manifold from high-dimensional data, then employing this quadratic manifold to derive efficient physics-based reduced-order models. The key ingredient of the approach is a polynomial mapping between high-dimensional states and a low-dimensional embedding. This mapping consists of two parts: a representation in a linear subspace (computed in this work using the proper orthogonal decomposition) and a quadratic component. The approach can be viewed as a form of data-driven closure modeling, since the quadratic component introduces directions into the approximation that lie in the orthogonal complement of the linear subspace, but without introducing any additional degrees of freedom to the low-dimensional representation. Combining the quadratic manifold approximation with the operator inference method for projection-based model reduction leads to a scalable non-intrusive approach for learning reduced-order models of dynamical systems. Applying the new approach to transport-dominated systems of partial differential equations illustrates the gains in efficiency that can be achieved over approximation in a linear subspace.

Authors:
ORCiD logo [1];  [2];  [1]
  1. Univ. of Texas, Austin, TX (United States). Oden Institute for Computational Engineering and Sciences
  2. Univ. of Wisconsin, Madison, WI (United States)
Publication Date:
Research Org.:
Univ. of Texas, Austin, TX (United States). Oden Institute for Computational Engineering and Sciences; Univ. of Texas, Austin, TX (United States)
Sponsoring Org.:
USDOE; US Air Force Office of Scientific Research (AFOSR)
OSTI Identifier:
1905877
Alternate Identifier(s):
OSTI ID: 1899717; OSTI ID: 2340144
Grant/Contract Number:  
SC0019303; FA9550-21-1-0084
Resource Type:
Accepted Manuscript
Journal Name:
Computer Methods in Applied Mechanics and Engineering
Additional Journal Information:
Journal Volume: 403; Journal ID: ISSN 0045-7825
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; Data-driven model reduction; Nonlinear manifolds; Operator inference; Proper orthogonal decomposition

Citation Formats

Geelen, Rudy, Wright, Stephen, and Willcox, Karen. Operator inference for non-intrusive model reduction with quadratic manifolds. United States: N. p., 2022. Web. doi:10.1016/j.cma.2022.115717.
Geelen, Rudy, Wright, Stephen, & Willcox, Karen. Operator inference for non-intrusive model reduction with quadratic manifolds. United States. https://doi.org/10.1016/j.cma.2022.115717
Geelen, Rudy, Wright, Stephen, and Willcox, Karen. Sat . "Operator inference for non-intrusive model reduction with quadratic manifolds". United States. https://doi.org/10.1016/j.cma.2022.115717. https://www.osti.gov/servlets/purl/1905877.
@article{osti_1905877,
title = {Operator inference for non-intrusive model reduction with quadratic manifolds},
author = {Geelen, Rudy and Wright, Stephen and Willcox, Karen},
abstractNote = {This paper proposes a novel approach for learning a data-driven quadratic manifold from high-dimensional data, then employing this quadratic manifold to derive efficient physics-based reduced-order models. The key ingredient of the approach is a polynomial mapping between high-dimensional states and a low-dimensional embedding. This mapping consists of two parts: a representation in a linear subspace (computed in this work using the proper orthogonal decomposition) and a quadratic component. The approach can be viewed as a form of data-driven closure modeling, since the quadratic component introduces directions into the approximation that lie in the orthogonal complement of the linear subspace, but without introducing any additional degrees of freedom to the low-dimensional representation. Combining the quadratic manifold approximation with the operator inference method for projection-based model reduction leads to a scalable non-intrusive approach for learning reduced-order models of dynamical systems. Applying the new approach to transport-dominated systems of partial differential equations illustrates the gains in efficiency that can be achieved over approximation in a linear subspace.},
doi = {10.1016/j.cma.2022.115717},
journal = {Computer Methods in Applied Mechanics and Engineering},
number = ,
volume = 403,
place = {United States},
year = {Sat Nov 19 00:00:00 EST 2022},
month = {Sat Nov 19 00:00:00 EST 2022}
}

Works referenced in this record:

Model order reduction assisted by deep neural networks (ROM-net)
journal, April 2020

  • Daniel, Thomas; Casenave, Fabien; Akkari, Nissrine
  • Advanced Modeling and Simulation in Engineering Sciences, Vol. 7, Issue 1
  • DOI: 10.1186/s40323-020-00153-6

Kernel learning for robust dynamic mode decomposition: linear and nonlinear disambiguation optimization
journal, April 2022

  • Baddoo, Peter J.; Herrmann, Benjamin; McKeon, Beverley J.
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 478, Issue 2260
  • DOI: 10.1098/rspa.2021.0830

Breaking the Kolmogorov Barrier with Nonlinear Model Reduction
journal, May 2022

  • Peherstorfer, Benjamin
  • Notices of the American Mathematical Society, Vol. 69, Issue 05
  • DOI: 10.1090/noti2475

Sparse Reconstruction by Separable Approximation
journal, July 2009

  • Wright, S. J.; Nowak, R. D.; Figueiredo, M. A. T.
  • IEEE Transactions on Signal Processing, Vol. 57, Issue 7
  • DOI: 10.1109/TSP.2009.2016892

Nonlinear dimensionality reduction for parametric problems: A kernel proper orthogonal decomposition
journal, October 2021

  • Díez, Pedro; Muixí, Alba; Zlotnik, Sergio
  • International Journal for Numerical Methods in Engineering, Vol. 122, Issue 24
  • DOI: 10.1002/nme.6831

Nonlinear model order reduction based on local reduced-order bases: NONLINEAR MODEL REDUCTION BASED ON LOCAL REDUCED-ORDER BASES
journal, June 2012

  • Amsallem, David; Zahr, Matthew J.; Farhat, Charbel
  • International Journal for Numerical Methods in Engineering, Vol. 92, Issue 10
  • DOI: 10.1002/nme.4371

A priori estimation of memory effects in reduced-order models of nonlinear systems using the Mori–Zwanzig formalism
journal, September 2017

  • Gouasmi, Ayoub; Parish, Eric J.; Duraisamy, Karthik
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 473, Issue 2205
  • DOI: 10.1098/rspa.2017.0385

Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems
journal, May 2020


Interpolation of Functions with Parameter Dependent Jumps by Transformed Snapshots
journal, January 2017

  • Welper, G.
  • SIAM Journal on Scientific Computing, Vol. 39, Issue 4
  • DOI: 10.1137/16M1059904

Data-Driven Discovery of Closure Models
journal, January 2018

  • Pan, Shaowu; Duraisamy, Karthik
  • SIAM Journal on Applied Dynamical Systems, Vol. 17, Issue 4
  • DOI: 10.1137/18M1177263

Localized Discrete Empirical Interpolation Method
journal, January 2014

  • Peherstorfer, Benjamin; Butnaru, Daniel; Willcox, Karen
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 1
  • DOI: 10.1137/130924408

Nonlinear reduced basis approximation of parameterized evolution equations via the method of freezing
journal, December 2013


Data-driven operator inference for nonintrusive projection-based model reduction
journal, July 2016

  • Peherstorfer, Benjamin; Willcox, Karen
  • Computer Methods in Applied Mechanics and Engineering, Vol. 306
  • DOI: 10.1016/j.cma.2016.03.025

A quadratic manifold for model order reduction of nonlinear structural dynamics
journal, August 2017


Simultaneous Variable Selection
journal, August 2005


Space-time registration-based model reduction of parameterized one-dimensional hyperbolic PDEs
journal, January 2021

  • Taddei, Tommaso; Zhang, Lei
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 55, Issue 1
  • DOI: 10.1051/m2an/2020073

Advection modes by optimal mass transfer
journal, February 2014


A Registration Method for Model Order Reduction: Data Compression and Geometry Reduction
journal, January 2020

  • Taddei, Tommaso
  • SIAM Journal on Scientific Computing, Vol. 42, Issue 2
  • DOI: 10.1137/19M1271270

Data-driven reduced-order models via regularised Operator Inference for a single-injector combustion process
journal, January 2021

  • McQuarrie, Shane A.; Huang, Cheng; Willcox, Karen E.
  • Journal of the Royal Society of New Zealand, Vol. 51, Issue 2
  • DOI: 10.1080/03036758.2020.1863237

LIII. On lines and planes of closest fit to systems of points in space
journal, November 1901

  • Pearson, Karl
  • The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, Vol. 2, Issue 11
  • DOI: 10.1080/14786440109462720

Sampling Low-Dimensional Markovian Dynamics for Preasymptotically Recovering Reduced Models from Data with Operator Inference
journal, January 2020

  • Peherstorfer, Benjamin
  • SIAM Journal on Scientific Computing, Vol. 42, Issue 5
  • DOI: 10.1137/19M1292448

Non intrusive reduced order modeling of parametrized PDEs by kernel POD and neural networks
journal, December 2021


Hamiltonian operator inference: Physics-preserving learning of reduced-order models for canonical Hamiltonian systems
journal, March 2022


On closures for reduced order models—A spectrum of first-principle to machine-learned avenues
journal, September 2021

  • Ahmed, Shady E.; Pawar, Suraj; San, Omer
  • Physics of Fluids, Vol. 33, Issue 9
  • DOI: 10.1063/5.0061577

The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows
journal, January 1993


Generalization of quadratic manifolds for reduced order modeling of nonlinear structural dynamics
journal, November 2017


Adaptive h -refinement for reduced-order models : ADAPTIVE
journal, November 2014

  • Carlberg, Kevin
  • International Journal for Numerical Methods in Engineering, Vol. 102, Issue 5
  • DOI: 10.1002/nme.4800

Transported snapshot model order reduction approach for parametric, steady-state fluid flows containing parameter-dependent shocks: Model order reduction for fluid flows containing shocks
journal, December 2018

  • Nair, Nirmal J.; Balajewicz, Maciej
  • International Journal for Numerical Methods in Engineering, Vol. 117, Issue 12
  • DOI: 10.1002/nme.5998

Model Reduction for Transport-Dominated Problems via Online Adaptive Bases and Adaptive Sampling
journal, January 2020

  • Peherstorfer, Benjamin
  • SIAM Journal on Scientific Computing, Vol. 42, Issue 5
  • DOI: 10.1137/19M1257275

A Comprehensive Deep Learning-Based Approach to Reduced Order Modeling of Nonlinear Time-Dependent Parametrized PDEs
journal, April 2021

  • Fresca, Stefania; Dede’, Luca; Manzoni, Andrea
  • Journal of Scientific Computing, Vol. 87, Issue 2
  • DOI: 10.1007/s10915-021-01462-7

Nonlinear proper orthogonal decomposition for convection-dominated flows
journal, December 2021

  • Ahmed, Shady E.; San, Omer; Rasheed, Adil
  • Physics of Fluids, Vol. 33, Issue 12
  • DOI: 10.1063/5.0074310

Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms
journal, December 2020

  • Benner, Peter; Goyal, Pawan; Kramer, Boris
  • Computer Methods in Applied Mechanics and Engineering, Vol. 372
  • DOI: 10.1016/j.cma.2020.113433

Projection-based model reduction with dynamically transformed modes
journal, October 2020

  • Black, Felix; Schulze, Philipp; Unger, Benjamin
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 54, Issue 6
  • DOI: 10.1051/m2an/2020046

Turbulence and the dynamics of coherent structures. I. Coherent structures
journal, January 1987

  • Sirovich, Lawrence
  • Quarterly of Applied Mathematics, Vol. 45, Issue 3
  • DOI: 10.1090/qam/910462

Nonlinear Model Order Reduction via Lifting Transformations and Proper Orthogonal Decomposition
journal, June 2019

  • Kramer, Boris; Willcox, Karen E.
  • AIAA Journal, Vol. 57, Issue 6
  • DOI: 10.2514/1.J057791

Learning physics-based models from data: perspectives from inverse problems and model reduction
journal, May 2021


Non-intrusive model reduction of large-scale, nonlinear dynamical systems using deep learning
journal, November 2020


Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders
journal, November 2019


Proper orthogonal decomposition closure models for turbulent flows: A numerical comparison
journal, September 2012

  • Wang, Zhu; Akhtar, Imran; Borggaard, Jeff
  • Computer Methods in Applied Mechanics and Engineering, Vol. 237-240
  • DOI: 10.1016/j.cma.2012.04.015

An Explicit Nonlinear Mapping for Manifold Learning
journal, February 2013