DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives

Abstract

In this study, we consider two proper orthogonal decomposition (POD) methods for dimension reduction of dynamical systems. The first method (M1) uses only time snapshots of the solution, while the second method (M2) augments the snapshot set with time-derivative snapshots. The goal of the paper is to analyze and compare the approximation errors resulting from the two methods by using error bounds. We derive several new bounds of the error from POD model reduction by each of the two methods. The new error bounds involve a multiplicative factor depending on the time steps between the snapshots. For method M1 the factor depends on the second power of the time step, while for method 2 the dependence is on the fourth power of the time step, suggesting that method M2 can be more accurate for small between-snapshot intervals. However, three other factors also affect the size of the error bounds. These include (i) the norm of the second (for M1) and fourth derivatives (M2); (ii) the first neglected singular value and (iii) the spectral properties of the projection of the system’s Jacobian in the reduced space. Because of the interplay of these factors neither method is more accurate than the othermore » in all cases. Finally, we present numerical examples demonstrating that when the number of collected snapshots is small and the first neglected singular value has a value of zero, method M2 results in a better approximation.« less

Authors:
;
Publication Date:
Research Org.:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1846851
Alternate Identifier(s):
OSTI ID: 1409976; OSTI ID: 1549927
Report Number(s):
LLNL-JRNL-720257
Journal ID: ISSN 0377-0427; S0377042717304181; PII: S0377042717304181
Grant/Contract Number:  
LDRD 13-ERD-031; 17-ERD-026; AC52-07NA27344
Resource Type:
Published Article
Journal Name:
Journal of Computational and Applied Mathematics
Additional Journal Information:
Journal Name: Journal of Computational and Applied Mathematics Journal Volume: 330 Journal Issue: C; Journal ID: ISSN 0377-0427
Publisher:
Elsevier
Country of Publication:
Belgium
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; Model reduction; Proper orthogonal decomposition; Error bound

Citation Formats

Kostova-Vassilevska, Tanya, and Oxberry, Geoffrey M. Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives. Belgium: N. p., 2018. Web. doi:10.1016/j.cam.2017.09.001.
Kostova-Vassilevska, Tanya, & Oxberry, Geoffrey M. Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives. Belgium. https://doi.org/10.1016/j.cam.2017.09.001
Kostova-Vassilevska, Tanya, and Oxberry, Geoffrey M. Thu . "Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives". Belgium. https://doi.org/10.1016/j.cam.2017.09.001.
@article{osti_1846851,
title = {Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives},
author = {Kostova-Vassilevska, Tanya and Oxberry, Geoffrey M.},
abstractNote = {In this study, we consider two proper orthogonal decomposition (POD) methods for dimension reduction of dynamical systems. The first method (M1) uses only time snapshots of the solution, while the second method (M2) augments the snapshot set with time-derivative snapshots. The goal of the paper is to analyze and compare the approximation errors resulting from the two methods by using error bounds. We derive several new bounds of the error from POD model reduction by each of the two methods. The new error bounds involve a multiplicative factor depending on the time steps between the snapshots. For method M1 the factor depends on the second power of the time step, while for method 2 the dependence is on the fourth power of the time step, suggesting that method M2 can be more accurate for small between-snapshot intervals. However, three other factors also affect the size of the error bounds. These include (i) the norm of the second (for M1) and fourth derivatives (M2); (ii) the first neglected singular value and (iii) the spectral properties of the projection of the system’s Jacobian in the reduced space. Because of the interplay of these factors neither method is more accurate than the other in all cases. Finally, we present numerical examples demonstrating that when the number of collected snapshots is small and the first neglected singular value has a value of zero, method M2 results in a better approximation.},
doi = {10.1016/j.cam.2017.09.001},
journal = {Journal of Computational and Applied Mathematics},
number = C,
volume = 330,
place = {Belgium},
year = {Thu Mar 01 00:00:00 EST 2018},
month = {Thu Mar 01 00:00:00 EST 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1016/j.cam.2017.09.001

Citation Metrics:
Cited by: 13 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

A Reduced-Order Method for Simulation and Control of Fluid Flows
journal, July 1998


New POD Error Expressions, Error Bounds, and Asymptotic Results for Reduced Order Models of Parabolic PDEs
journal, January 2014

  • Singler, John R.
  • SIAM Journal on Numerical Analysis, Vol. 52, Issue 2
  • DOI: 10.1137/120886947

The logarithmic norm. History and modern theory
journal, August 2006


Limited-memory adaptive snapshot selection for proper orthogonal decomposition: ADAPTIVE SNAPSHOT SELECTION FOR POD
journal, July 2016

  • Oxberry, Geoffrey M.; Kostova-Vassilevska, Tanya; Arrighi, William
  • International Journal for Numerical Methods in Engineering, Vol. 109, Issue 2
  • DOI: 10.1002/nme.5283

Dimension Reduction of Dynamical Systems: Methods, Models, Applications
journal, August 2005


The measure of a matrix as a tool to analyze computer algorithms for circuit analysis
journal, January 1972


Are the Snapshot Difference Quotients Needed in the Proper Orthogonal Decomposition?
journal, January 2014

  • Iliescu, Traian; Wang, Zhu
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 3
  • DOI: 10.1137/130925141

Mixed Finite Element Formulation and Error Estimates Based on Proper Orthogonal Decomposition for the Nonstationary Navier–Stokes Equations
journal, January 2009

  • Luo, Zhendong; Chen, Jing; Navon, I. M.
  • SIAM Journal on Numerical Analysis, Vol. 47, Issue 1
  • DOI: 10.1137/070689498

Control of laser surface hardening by a reduced-order approach using proper orthogonal decomposition
journal, November 2003


Galerkin approximation with proper orthogonal decomposition : new error estimates and illustrative examples
journal, February 2012

  • Chapelle, Dominique; Gariah, Asven; Sainte-Marie, Jacques
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 46, Issue 4
  • DOI: 10.1051/m2an/2011053

Note on the Derivatives with Respect to a Parameter of the Solutions of a System of Differential Equations
journal, July 1919

  • Gronwall, T. H.
  • The Annals of Mathematics, Vol. 20, Issue 4
  • DOI: 10.2307/1967124

POD and CVT-based reduced-order modeling of Navier–Stokes flows
journal, December 2006

  • Burkardt, John; Gunzburger, Max; Lee, Hyung-Chun
  • Computer Methods in Applied Mechanics and Engineering, Vol. 196, Issue 1-3
  • DOI: 10.1016/j.cma.2006.04.004

On Logarithmic Norms
journal, October 1975

  • Ström, Torsten
  • SIAM Journal on Numerical Analysis, Vol. 12, Issue 5
  • DOI: 10.1137/0712055

A low-cost, goal-oriented ‘compact proper orthogonal decomposition’ basis for model reduction of static systems
journal, December 2010

  • Carlberg, Kevin; Farhat, Charbel
  • International Journal for Numerical Methods in Engineering, Vol. 86, Issue 3
  • DOI: 10.1002/nme.3074

Gradient-enhanced surrogate modeling based on proper orthogonal decomposition
journal, January 2013


A New Look at Proper Orthogonal Decomposition
journal, January 2003


Fitzhugh–Nagumo Revisited: Types of Bifurcations, Periodical Forcing and Stability Regions by a Lyapunov Functional
journal, March 2004

  • Kostova, Tanya; Ravindran, Renuka; Schonbek, Maria
  • International Journal of Bifurcation and Chaos, Vol. 14, Issue 03
  • DOI: 10.1142/S0218127404009685

Inertial manifolds for nonlinear evolutionary equations
journal, June 1988


The Effect of Problem Perturbations on Nonlinear Dynamical Systems and their Reduced-Order Models
journal, January 2007

  • Serban, Radu; Homescu, Chris; Petzold, Linda R.
  • SIAM Journal on Scientific Computing, Vol. 29, Issue 6
  • DOI: 10.1137/050625278

Galerkin Proper Orthogonal Decomposition Methods for a General Equation in Fluid Dynamics
journal, January 2002


Turbulence and the dynamics of coherent structures. I. Coherent structures
journal, January 1987

  • Sirovich, Lawrence
  • Quarterly of Applied Mathematics, Vol. 45, Issue 3
  • DOI: 10.1090/qam/910462

Galerkin proper orthogonal decomposition methods for parabolic problems
journal, November 2001


Nonlinear Model Reduction via Discrete Empirical Interpolation
journal, January 2010

  • Chaturantabut, Saifon; Sorensen, Danny C.
  • SIAM Journal on Scientific Computing, Vol. 32, Issue 5
  • DOI: 10.1137/090766498

A State Space Error Estimate for POD-DEIM Nonlinear Model Reduction
journal, January 2012

  • Chaturantabut, Saifon; Sorensen, Danny C.
  • SIAM Journal on Numerical Analysis, Vol. 50, Issue 1
  • DOI: 10.1137/110822724

Error Estimation for Reduced‐Order Models of Dynamical Systems
journal, January 2007

  • Homescu, Chris; Petzold, Linda R.; Serban, Radu
  • SIAM Review, Vol. 49, Issue 2
  • DOI: 10.1137/070684392