skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives [Proper orthogonal decomposition model reduction of dynamical systems: error bounds and comparison of methods using snapshots from the solution and the time derivatives]

Abstract

In this study, we consider two proper orthogonal decomposition (POD) methods for dimension reduction of dynamical systems. The first method (M1) uses only time snapshots of the solution, while the second method (M2) augments the snapshot set with time-derivative snapshots. The goal of the paper is to analyze and compare the approximation errors resulting from the two methods by using error bounds. We derive several new bounds of the error from POD model reduction by each of the two methods. The new error bounds involve a multiplicative factor depending on the time steps between the snapshots. For method M1 the factor depends on the second power of the time step, while for method 2 the dependence is on the fourth power of the time step, suggesting that method M2 can be more accurate for small between-snapshot intervals. However, three other factors also affect the size of the error bounds. These include (i) the norm of the second (for M1) and fourth derivatives (M2); (ii) the first neglected singular value and (iii) the spectral properties of the projection of the system’s Jacobian in the reduced space. Because of the interplay of these factors neither method is more accurate than the othermore » in all cases. Finally, we present numerical examples demonstrating that when the number of collected snapshots is small and the first neglected singular value has a value of zero, method M2 results in a better approximation.« less

Authors:
 [1];  [2]
  1. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States). Center for Applied Scientific Computing
  2. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States). Computational Engineering Division
Publication Date:
Research Org.:
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1409976
Alternate Identifier(s):
OSTI ID: 1549927
Report Number(s):
LLNL-JRNL-720257
Journal ID: ISSN 0377-0427
Grant/Contract Number:  
AC52-07NA27344; LDRD 13-ERD-031; 17-ERD-026
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational and Applied Mathematics
Additional Journal Information:
Journal Volume: 330; Journal Issue: C; Journal ID: ISSN 0377-0427
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; Model reduction; Proper orthogonal decomposition; Error bound

Citation Formats

Kostova-Vassilevska, Tanya, and Oxberry, Geoffrey M. Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives [Proper orthogonal decomposition model reduction of dynamical systems: error bounds and comparison of methods using snapshots from the solution and the time derivatives]. United States: N. p., 2017. Web. https://doi.org/10.1016/j.cam.2017.09.001.
Kostova-Vassilevska, Tanya, & Oxberry, Geoffrey M. Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives [Proper orthogonal decomposition model reduction of dynamical systems: error bounds and comparison of methods using snapshots from the solution and the time derivatives]. United States. https://doi.org/10.1016/j.cam.2017.09.001
Kostova-Vassilevska, Tanya, and Oxberry, Geoffrey M. Sun . "Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives [Proper orthogonal decomposition model reduction of dynamical systems: error bounds and comparison of methods using snapshots from the solution and the time derivatives]". United States. https://doi.org/10.1016/j.cam.2017.09.001. https://www.osti.gov/servlets/purl/1409976.
@article{osti_1409976,
title = {Model reduction of dynamical systems by proper orthogonal decomposition: Error bounds and comparison of methods using snapshots from the solution and the time derivatives [Proper orthogonal decomposition model reduction of dynamical systems: error bounds and comparison of methods using snapshots from the solution and the time derivatives]},
author = {Kostova-Vassilevska, Tanya and Oxberry, Geoffrey M.},
abstractNote = {In this study, we consider two proper orthogonal decomposition (POD) methods for dimension reduction of dynamical systems. The first method (M1) uses only time snapshots of the solution, while the second method (M2) augments the snapshot set with time-derivative snapshots. The goal of the paper is to analyze and compare the approximation errors resulting from the two methods by using error bounds. We derive several new bounds of the error from POD model reduction by each of the two methods. The new error bounds involve a multiplicative factor depending on the time steps between the snapshots. For method M1 the factor depends on the second power of the time step, while for method 2 the dependence is on the fourth power of the time step, suggesting that method M2 can be more accurate for small between-snapshot intervals. However, three other factors also affect the size of the error bounds. These include (i) the norm of the second (for M1) and fourth derivatives (M2); (ii) the first neglected singular value and (iii) the spectral properties of the projection of the system’s Jacobian in the reduced space. Because of the interplay of these factors neither method is more accurate than the other in all cases. Finally, we present numerical examples demonstrating that when the number of collected snapshots is small and the first neglected singular value has a value of zero, method M2 results in a better approximation.},
doi = {10.1016/j.cam.2017.09.001},
journal = {Journal of Computational and Applied Mathematics},
number = C,
volume = 330,
place = {United States},
year = {2017},
month = {9}
}

Works referenced in this record:

Inertial manifolds for nonlinear evolutionary equations
journal, June 1988


Dimension Reduction of Dynamical Systems: Methods, Models, Applications
journal, August 2005


Turbulence and the dynamics of coherent structures. I. Coherent structures
journal, January 1987

  • Sirovich, Lawrence
  • Quarterly of Applied Mathematics, Vol. 45, Issue 3
  • DOI: 10.1090/qam/910462

POD and CVT-based reduced-order modeling of Navier–Stokes flows
journal, December 2006

  • Burkardt, John; Gunzburger, Max; Lee, Hyung-Chun
  • Computer Methods in Applied Mechanics and Engineering, Vol. 196, Issue 1-3
  • DOI: 10.1016/j.cma.2006.04.004

Galerkin proper orthogonal decomposition methods for parabolic problems
journal, November 2001


Galerkin Proper Orthogonal Decomposition Methods for a General Equation in Fluid Dynamics
journal, January 2002


Nonlinear Model Reduction via Discrete Empirical Interpolation
journal, January 2010

  • Chaturantabut, Saifon; Sorensen, Danny C.
  • SIAM Journal on Scientific Computing, Vol. 32, Issue 5
  • DOI: 10.1137/090766498

A State Space Error Estimate for POD-DEIM Nonlinear Model Reduction
journal, January 2012

  • Chaturantabut, Saifon; Sorensen, Danny C.
  • SIAM Journal on Numerical Analysis, Vol. 50, Issue 1
  • DOI: 10.1137/110822724

Control of laser surface hardening by a reduced-order approach using proper orthogonal decomposition
journal, November 2003


Galerkin approximation with proper orthogonal decomposition : new error estimates and illustrative examples
journal, February 2012

  • Chapelle, Dominique; Gariah, Asven; Sainte-Marie, Jacques
  • ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 46, Issue 4
  • DOI: 10.1051/m2an/2011053

Mixed Finite Element Formulation and Error Estimates Based on Proper Orthogonal Decomposition for the Nonstationary Navier–Stokes Equations
journal, January 2009

  • Luo, Zhendong; Chen, Jing; Navon, I. M.
  • SIAM Journal on Numerical Analysis, Vol. 47, Issue 1
  • DOI: 10.1137/070689498

New POD Error Expressions, Error Bounds, and Asymptotic Results for Reduced Order Models of Parabolic PDEs
journal, January 2014

  • Singler, John R.
  • SIAM Journal on Numerical Analysis, Vol. 52, Issue 2
  • DOI: 10.1137/120886947

Are the Snapshot Difference Quotients Needed in the Proper Orthogonal Decomposition?
journal, January 2014

  • Iliescu, Traian; Wang, Zhu
  • SIAM Journal on Scientific Computing, Vol. 36, Issue 3
  • DOI: 10.1137/130925141

A New Look at Proper Orthogonal Decomposition
journal, January 2003


Error Estimation for Reduced‐Order Models of Dynamical Systems
journal, January 2007

  • Homescu, Chris; Petzold, Linda R.; Serban, Radu
  • SIAM Review, Vol. 49, Issue 2
  • DOI: 10.1137/070684392

The Effect of Problem Perturbations on Nonlinear Dynamical Systems and their Reduced-Order Models
journal, January 2007

  • Serban, Radu; Homescu, Chris; Petzold, Linda R.
  • SIAM Journal on Scientific Computing, Vol. 29, Issue 6
  • DOI: 10.1137/050625278

A low-cost, goal-oriented ‘compact proper orthogonal decomposition’ basis for model reduction of static systems
journal, December 2010

  • Carlberg, Kevin; Farhat, Charbel
  • International Journal for Numerical Methods in Engineering, Vol. 86, Issue 3
  • DOI: 10.1002/nme.3074

Gradient-enhanced surrogate modeling based on proper orthogonal decomposition
journal, January 2013


A Reduced-Order Method for Simulation and Control of Fluid Flows
journal, July 1998


Note on the Derivatives with Respect to a Parameter of the Solutions of a System of Differential Equations
journal, July 1919

  • Gronwall, T. H.
  • The Annals of Mathematics, Vol. 20, Issue 4
  • DOI: 10.2307/1967124

The measure of a matrix as a tool to analyze computer algorithms for circuit analysis
journal, January 1972


The logarithmic norm. History and modern theory
journal, August 2006


On Logarithmic Norms
journal, October 1975

  • Ström, Torsten
  • SIAM Journal on Numerical Analysis, Vol. 12, Issue 5
  • DOI: 10.1137/0712055

Fitzhugh–Nagumo Revisited: Types of Bifurcations, Periodical Forcing and Stability Regions by a Lyapunov Functional
journal, March 2004

  • Kostova, Tanya; Ravindran, Renuka; Schonbek, Maria
  • International Journal of Bifurcation and Chaos, Vol. 14, Issue 03
  • DOI: 10.1142/S0218127404009685

Limited-memory adaptive snapshot selection for proper orthogonal decomposition: ADAPTIVE SNAPSHOT SELECTION FOR POD
journal, July 2016

  • Oxberry, Geoffrey M.; Kostova-Vassilevska, Tanya; Arrighi, William
  • International Journal for Numerical Methods in Engineering, Vol. 109, Issue 2
  • DOI: 10.1002/nme.5283