skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders

Abstract

Nearly all model-reduction techniques project the governing equations onto a linear subspace of the original state space. Such subspaces are typically computed using methods such as balanced truncation, rational interpolation, the reduced-basis method, and (balanced) proper orthogonal decomposition (POD). Unfortunately, restricting the state to evolve in a linear subspace imposes a fundamental limitation to the accuracy of the resulting reduced-order model (ROM). In particular, linear-subspace ROMs can be expected to produce low-dimensional models with high accuracy only if the problem admits a fast decaying Kolmogorov n-width (e.g., diffusion-dominated problems). Unfortunately, many problems of interest exhibit a slowly decaying Kolmogorov n-width (e.g., advection-dominated problems). To address this, we propose a novel framework for projecting dynamical systems onto nonlinear manifolds using minimum-residual formulations at the time-continuous and time-discrete levels; the former leads to manifold Galerkin projection, while the latter leads to manifold least-squares Petrov–Galerkin (LSPG) projection. We perform analyses that provide insight into the relationship between these proposed approaches and classical linear-subspace reduced-order models; we also derive a posteriori discrete-time error bounds for the proposed approaches. In addition, we propose a computationally practical approach for computing the nonlinear manifold, which is based on convolutional autoencoders from deep learning. Lastly, we demonstrate themore » ability of the method to significantly outperform even the optimal linear-subspace ROM on benchmark advection-dominated problems, thereby demonstrating the method's ability to overcome the intrinsic n-width limitations of linear subspaces.« less

Authors:
 [1];  [1]
  1. Sandia National Lab. (SNL-CA), Livermore, CA (United States)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-CA), Livermore, CA (United States)
Sponsoring Org.:
Sandia's Advanced Simulation and Computing (ASC) Verification and Validation (V&V) Project; USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1574441
Alternate Identifier(s):
OSTI ID: 1691627
Report Number(s):
SAND-2019-12375J; SAND-2019-0003J
Journal ID: ISSN 0021-9991; 680333; TRN: US2001261
Grant/Contract Number:  
AC04-94AL85000; NA0003525
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational Physics
Additional Journal Information:
Journal Volume: 404; Journal ID: ISSN 0021-9991
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; Model reduction; Deep learning; Autoencoders; Machine learning; Nonlinear manifolds; Optimal projection

Citation Formats

Lee, Kookjin, and Carlberg, Kevin T. Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders. United States: N. p., 2019. Web. doi:10.1016/j.jcp.2019.108973.
Lee, Kookjin, & Carlberg, Kevin T. Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders. United States. doi:10.1016/j.jcp.2019.108973.
Lee, Kookjin, and Carlberg, Kevin T. Fri . "Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders". United States. doi:10.1016/j.jcp.2019.108973. https://www.osti.gov/servlets/purl/1574441.
@article{osti_1574441,
title = {Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders},
author = {Lee, Kookjin and Carlberg, Kevin T.},
abstractNote = {Nearly all model-reduction techniques project the governing equations onto a linear subspace of the original state space. Such subspaces are typically computed using methods such as balanced truncation, rational interpolation, the reduced-basis method, and (balanced) proper orthogonal decomposition (POD). Unfortunately, restricting the state to evolve in a linear subspace imposes a fundamental limitation to the accuracy of the resulting reduced-order model (ROM). In particular, linear-subspace ROMs can be expected to produce low-dimensional models with high accuracy only if the problem admits a fast decaying Kolmogorov n-width (e.g., diffusion-dominated problems). Unfortunately, many problems of interest exhibit a slowly decaying Kolmogorov n-width (e.g., advection-dominated problems). To address this, we propose a novel framework for projecting dynamical systems onto nonlinear manifolds using minimum-residual formulations at the time-continuous and time-discrete levels; the former leads to manifold Galerkin projection, while the latter leads to manifold least-squares Petrov–Galerkin (LSPG) projection. We perform analyses that provide insight into the relationship between these proposed approaches and classical linear-subspace reduced-order models; we also derive a posteriori discrete-time error bounds for the proposed approaches. In addition, we propose a computationally practical approach for computing the nonlinear manifold, which is based on convolutional autoencoders from deep learning. Lastly, we demonstrate the ability of the method to significantly outperform even the optimal linear-subspace ROM on benchmark advection-dominated problems, thereby demonstrating the method's ability to overcome the intrinsic n-width limitations of linear subspaces.},
doi = {10.1016/j.jcp.2019.108973},
journal = {Journal of Computational Physics},
number = ,
volume = 404,
place = {United States},
year = {2019},
month = {11}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 10 works
Citation information provided by
Web of Science

Save / Share:

Works referencing / citing this record:

A framework for self‐evolving computational material models inspired by deep learning
journal, August 2019

  • Cho, In Ho
  • International Journal for Numerical Methods in Engineering, Vol. 120, Issue 10
  • DOI: 10.1002/nme.6177