DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reduction

Abstract

Least-squares Petrov–Galerkin (LSPG) model-reduction techniques such as the Gauss–Newton with Approximated Tensors (GNAT) method have shown promise, as they have generated stable, accurate solutions for large-scale turbulent, compressible flow problems where standard Galerkin techniques have failed. However, there has been limited comparative analysis of the two approaches. This is due in part to difficulties arising from the fact that Galerkin techniques perform optimal projection associated with residual minimization at the time-continuous level, while LSPG techniques do so at the time-discrete level. Here, this work provides a detailed theoretical and computational comparison of the two techniques for two common classes of time integrators: linear multistep schemes and Runge–Kutta schemes. We present a number of new findings, including conditions under which the LSPG ROM has a time-continuous representation, conditions under which the two techniques are equivalent, and time-discrete error bounds for the two approaches. Perhaps most surprisingly, we demonstrate both theoretically and computationally that decreasing the time step does not necessarily decrease the error for the LSPG ROM; instead, the time step should be ‘matched’ to the spectral content of the reduced basis. In numerical experiments carried out on a turbulent compressible-flow problem with over one million unknowns, we show that increasingmore » the time step to an intermediate value decreases both the error and the simulation time of the LSPG reduced-order model by an order of magnitude.« less

Authors:
 [1];  [2];  [3]
  1. Sandia National Lab. (SNL-CA), Livermore, CA (United States)
  2. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  3. George Mason Univ., Fairfax, VA (United States)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-CA), Livermore, CA (United States); Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1333617
Alternate Identifier(s):
OSTI ID: 1338307; OSTI ID: 1398568
Report Number(s):
SAND-2016-8178J; SAND-2015-10809J
Journal ID: ISSN 0021-9991; 646813; TRN: US1700184
Grant/Contract Number:  
AC04-94AL85000
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational Physics
Additional Journal Information:
Journal Name: Journal of Computational Physics; Journal ID: ISSN 0021-9991
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; model reduction; GNAT; least-squares Petrov–Galerkin projection; Galerkin projection; CFD

Citation Formats

Carlberg, Kevin Thomas, Barone, Matthew F., and Antil, Harbir. Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reduction. United States: N. p., 2016. Web. doi:10.1016/j.jcp.2016.10.033.
Carlberg, Kevin Thomas, Barone, Matthew F., & Antil, Harbir. Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reduction. United States. https://doi.org/10.1016/j.jcp.2016.10.033
Carlberg, Kevin Thomas, Barone, Matthew F., and Antil, Harbir. Thu . "Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reduction". United States. https://doi.org/10.1016/j.jcp.2016.10.033. https://www.osti.gov/servlets/purl/1333617.
@article{osti_1333617,
title = {Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reduction},
author = {Carlberg, Kevin Thomas and Barone, Matthew F. and Antil, Harbir},
abstractNote = {Least-squares Petrov–Galerkin (LSPG) model-reduction techniques such as the Gauss–Newton with Approximated Tensors (GNAT) method have shown promise, as they have generated stable, accurate solutions for large-scale turbulent, compressible flow problems where standard Galerkin techniques have failed. However, there has been limited comparative analysis of the two approaches. This is due in part to difficulties arising from the fact that Galerkin techniques perform optimal projection associated with residual minimization at the time-continuous level, while LSPG techniques do so at the time-discrete level. Here, this work provides a detailed theoretical and computational comparison of the two techniques for two common classes of time integrators: linear multistep schemes and Runge–Kutta schemes. We present a number of new findings, including conditions under which the LSPG ROM has a time-continuous representation, conditions under which the two techniques are equivalent, and time-discrete error bounds for the two approaches. Perhaps most surprisingly, we demonstrate both theoretically and computationally that decreasing the time step does not necessarily decrease the error for the LSPG ROM; instead, the time step should be ‘matched’ to the spectral content of the reduced basis. In numerical experiments carried out on a turbulent compressible-flow problem with over one million unknowns, we show that increasing the time step to an intermediate value decreases both the error and the simulation time of the LSPG reduced-order model by an order of magnitude.},
doi = {10.1016/j.jcp.2016.10.033},
journal = {Journal of Computational Physics},
number = ,
volume = ,
place = {United States},
year = {Thu Oct 20 00:00:00 EDT 2016},
month = {Thu Oct 20 00:00:00 EDT 2016}
}

Journal Article:

Citation Metrics:
Cited by: 107 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Diagonally Implicit Runge–Kutta Methods for Stiff O.D.E.’s
journal, December 1977

  • Alexander, Roger
  • SIAM Journal on Numerical Analysis, Vol. 14, Issue 6
  • DOI: 10.1137/0714068

Fast local reduced basis updates for the efficient reduction of nonlinear systems with hyper-reduction
journal, February 2015

  • Amsallem, David; Zahr, Matthew J.; Washabaugh, Kyle
  • Advances in Computational Mathematics, Vol. 41, Issue 5
  • DOI: 10.1007/s10444-015-9409-0

Optimizing cubature for efficient integration of subspace deformations
journal, December 2008

  • An, Steven S.; Kim, Theodore; James, Doug L.
  • ACM Transactions on Graphics, Vol. 27, Issue 5
  • DOI: 10.1145/1409060.1409118

Two-Step Greedy Algorithm for Reduced Order Quadratures
journal, May 2013

  • Antil, Harbir; Field, Scott E.; Herrmann, Frank
  • Journal of Scientific Computing, Vol. 57, Issue 3
  • DOI: 10.1007/s10915-013-9722-z

Missing Point Estimation in Models Described by Proper Orthogonal Decomposition
journal, November 2008

  • Astrid, Patricia; Weiland, Siep; Willcox, Karen
  • IEEE Transactions on Automatic Control, Vol. 53, Issue 10
  • DOI: 10.1109/TAC.2008.2006102

The dynamics of coherent structures in the wall region of a turbulent boundary layer
journal, July 1988


Stabilization of projection-based reduced order models of the Navier–Stokes
journal, August 2012


Low-dimensional modelling of high-Reynolds-number shear flows incorporating constraints from the Navier–Stokes equation
journal, July 2013

  • Balajewicz, Maciej J.; Dowell, Earl H.; Noack, Bernd R.
  • Journal of Fluid Mechanics, Vol. 729
  • DOI: 10.1017/jfm.2013.278

Stable Galerkin reduced order models for linearized compressible flow
journal, April 2009

  • Barone, Matthew F.; Kalashnikova, Irina; Segalman, Daniel J.
  • Journal of Computational Physics, Vol. 228, Issue 6
  • DOI: 10.1016/j.jcp.2008.11.015

A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems
journal, January 2015

  • Benner, Peter; Gugercin, Serkan; Willcox, Karen
  • SIAM Review, Vol. 57, Issue 4
  • DOI: 10.1137/130932715

Enablers for robust POD models
journal, February 2009

  • Bergmann, M.; Bruneau, C. -H.; Iollo, A.
  • Journal of Computational Physics, Vol. 228, Issue 2
  • DOI: 10.1016/j.jcp.2008.09.024

Model Reduction for Large-Scale Systems with High-Dimensional Parametric Input Space
journal, January 2008

  • Bui-Thanh, T.; Willcox, K.; Ghattas, O.
  • SIAM Journal on Scientific Computing, Vol. 30, Issue 6
  • DOI: 10.1137/070694855

Efficient non-linear model reduction via a least-squares Petrov-Galerkin projection and compressive tensor approximations
journal, October 2010

  • Carlberg, Kevin; Bou-Mosleh, Charbel; Farhat, Charbel
  • International Journal for Numerical Methods in Engineering, Vol. 86, Issue 2
  • DOI: 10.1002/nme.3050

The GNAT method for nonlinear model reduction: Effective implementation and application to computational fluid dynamics and turbulent flows
journal, June 2013

  • Carlberg, Kevin; Farhat, Charbel; Cortial, Julien
  • Journal of Computational Physics, Vol. 242
  • DOI: 10.1016/j.jcp.2013.02.028

Preserving Lagrangian Structure in Nonlinear Model Reduction with Application to Structural Dynamics
journal, January 2015

  • Carlberg, Kevin; Tuminaro, Ray; Boggs, Paul
  • SIAM Journal on Scientific Computing, Vol. 37, Issue 2
  • DOI: 10.1137/140959602

Nonlinear Model Reduction via Discrete Empirical Interpolation
journal, January 2010

  • Chaturantabut, Saifon; Sorensen, Danny C.
  • SIAM Journal on Scientific Computing, Vol. 32, Issue 5
  • DOI: 10.1137/090766498

Residual Minimizing Model Interpolation for Parameterized Nonlinear Dynamical Systems
journal, January 2012

  • Constantine, Paul G.; Wang, Qiqi
  • SIAM Journal on Scientific Computing, Vol. 34, Issue 4
  • DOI: 10.1137/100816717

Reduced Basis Approximation for Nonlinear Parametrized Evolution Equations based on Empirical Operator Interpolation
journal, January 2012

  • Drohmann, Martin; Haasdonk, Bernard; Ohlberger, Mario
  • SIAM Journal on Scientific Computing, Vol. 34, Issue 2
  • DOI: 10.1137/10081157X

Karhunen–Loève procedure for gappy data
journal, January 1995

  • Everson, R.; Sirovich, L.
  • Journal of the Optical Society of America A, Vol. 12, Issue 8
  • DOI: 10.1364/JOSAA.12.001657

Non-linear Petrov–Galerkin methods for reduced order hyperbolic equations and discontinuous finite element methods
journal, February 2013


Application of a three-field nonlinear fluid–structure formulation to the prediction of the aeroelastic parameters of an F-16 fighter
journal, January 2003


Dissipativity of numerical schemes
journal, August 1991


Low-order modelling of laminar flow regimes past a confined square cylinder
journal, January 1999


Aeroelastic Dynamic Analysis of a Full F-16 Configuration for Various Flight Conditions
journal, March 2003

  • Geuzaine, Philippe; Brown, Gregory; Harris, Chuck
  • AIAA Journal, Vol. 41, Issue 3
  • DOI: 10.2514/2.1975

Stability Properties of POD-Galerkin Approximations for the Compressible Navier-Stokes Equations
journal, March 2000

  • Iollo, A.; Lanteri, S.; Désidéri, J. -A.
  • Theoretical and Computational Fluid Dynamics, Vol. 13, Issue 6
  • DOI: 10.1007/s001620050119

Preserving dissipation in approximate inertial forms for the Kuramoto-Sivashinsky equation
journal, April 1991

  • Jolly, M. S.; Kevrekidis, I. G.; Titi, E. S.
  • Journal of Dynamics and Differential Equations, Vol. 3, Issue 2
  • DOI: 10.1007/BF01047708

On the stability and convergence of a Galerkin reduced order model (ROM) of compressible flow with solid wall and far-field boundary treatment
journal, August 2010

  • Kalashnikova, I.; Barone, M. F.
  • International Journal for Numerical Methods in Engineering, Vol. 83, Issue 10
  • DOI: 10.1002/nme.2867

Structure-preserving model reduction for mechanical systems
journal, October 2003


Nonlinear Galerkin Methods
journal, October 1989

  • Marion, Martine; Temam, Roger
  • SIAM Journal on Numerical Analysis, Vol. 26, Issue 5
  • DOI: 10.1137/0726063

The need for a pressure-term representation in empirical Galerkin models of incompressible shear flows
journal, January 1999


Reliable Real-Time Solution of Parametrized Partial Differential Equations: Reduced-Basis Output Bound Methods
journal, November 2001

  • Prud’homme, C.; Rovas, D. V.; Veroy, K.
  • Journal of Fluids Engineering, Vol. 124, Issue 1
  • DOI: 10.1115/1.1448332

A New Look at Proper Orthogonal Decomposition
journal, January 2003


On Low-Dimensional Galerkin Models for Fluid Flow
journal, June 2000


Model reduction for compressible flows using POD and Galerkin projection
journal, February 2004

  • Rowley, Clarence W.; Colonius, Tim; Murray, Richard M.
  • Physica D: Nonlinear Phenomena, Vol. 189, Issue 1-2
  • DOI: 10.1016/j.physd.2003.03.001

A priori hyperreduction method: an adaptive approach
journal, January 2005


Long time stability and convergence for fully discrete nonlinear galerkin methods
journal, January 1990


A spectral viscosity method for correcting the long-term behavior of POD models
journal, February 2004


Turbulence and the dynamics of coherent structures. III. Dynamics and scaling
journal, January 1987

  • Sirovich, Lawrence
  • Quarterly of Applied Mathematics, Vol. 45, Issue 3
  • DOI: 10.1090/qam/910464

Certified real-time solution of the parametrized steady incompressible Navier-Stokes equations: rigorous reduced-basisa posteriori error bounds
journal, January 2005

  • Veroy, K.; Patera, A. T.
  • International Journal for Numerical Methods in Fluids, Vol. 47, Issue 8-9
  • DOI: 10.1002/fld.867

Proper orthogonal decomposition closure models for turbulent flows: A numerical comparison
journal, September 2012

  • Wang, Zhu; Akhtar, Imran; Borggaard, Jeff
  • Computer Methods in Applied Mechanics and Engineering, Vol. 237-240
  • DOI: 10.1016/j.cma.2012.04.015

Works referencing / citing this record:

Constrained sparse Galerkin regression
journal, January 2018

  • Loiseau, Jean-Christophe; Brunton, Steven L.
  • Journal of Fluid Mechanics, Vol. 838
  • DOI: 10.1017/jfm.2017.823

Exploration of Reduced-Order Models for Rocket Combustion Applications
conference, January 2018

  • Huang, Cheng; Xu, Jiayang; Duraisamy, Karthik
  • 2018 AIAA Aerospace Sciences Meeting, 2018 AIAA Aerospace Sciences Meeting
  • DOI: 10.2514/6.2018-1183

Sparse reduced-order modelling: sensor-based dynamics to full-state estimation
journal, April 2018

  • Loiseau, Jean-Christophe; Noack, Bernd R.; Brunton, Steven L.
  • Journal of Fluid Mechanics, Vol. 844
  • DOI: 10.1017/jfm.2018.147

Challenges in Reduced Order Modeling of Reacting Flows
conference, July 2018

  • Huang, Cheng; Duraisamy, Karthik; Merkle, Charles
  • 2018 Joint Propulsion Conference
  • DOI: 10.2514/6.2018-4675

Commutation error in reduced order modeling of fluid flows
journal, December 2019

  • Koc, Birgul; Mohebujjaman, Muhammad; Mou, Changhong
  • Advances in Computational Mathematics, Vol. 45, Issue 5-6
  • DOI: 10.1007/s10444-019-09739-0

Investigations and Improvement of Robustness of Reduced-Order Models of Reacting Flow
journal, December 2019

  • Huang, Cheng; Duraisamy, Karthik; Merkle, Charles L.
  • AIAA Journal, Vol. 57, Issue 12
  • DOI: 10.2514/1.j058392

Assessment of reduced-order modeling strategies for convective heat transfer
journal, January 2020

  • Zucatti, Victor; Lui, Hugo F. S.; Pitz, Diogo B.
  • Numerical Heat Transfer, Part A: Applications, Vol. 77, Issue 7
  • DOI: 10.1080/10407782.2020.1714330

Randomized methods to characterize large-scale vortical flow networks
journal, November 2019


Randomized low‐rank approximation methods for projection‐based model order reduction of large nonlinear dynamical problems
journal, January 2019

  • Bach, C.; Ceglia, D.; Song, L.
  • International Journal for Numerical Methods in Engineering, Vol. 118, Issue 4
  • DOI: 10.1002/nme.6009

Investigations and Improvement of Robustness of Reduced-Order Models of Reacting Flow
conference, January 2019

  • Huang, Cheng; Duraisamy, Karthik; Merkle, Charles
  • AIAA Scitech 2019 Forum
  • DOI: 10.2514/6.2019-2012

Sparse reduced-order modeling : Sensor-based dynamics to full-state estimation
text, January 2017


Randomized methods to characterize large-scale vortical flow network
text, January 2019


Randomized methods to characterize large-scale vortical flow network
text, January 2019