DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Weak-form latent space dynamics identification

Journal Article · · Computer Methods in Applied Mechanics and Engineering

Recent work in data-driven modeling has demonstrated that a weak formulation of model equations enhances the noise robustness of a wide range of computational methods. In this paper, we demonstrate the power of the weak form to enhance the LaSDI (Latent Space Dynamics Identification) algorithm, a recently developed data-driven reduced order modeling technique. We introduce a weak form-based version WLaSDI (Weak-form Latent Space Dynamics Identification). WLaSDI first compresses data, then projects onto the test functions and learns the local latent space models. Notably, WLaSDI demonstrates significantly enhanced robustness to noise. With WLaSDI, the local latent space is obtained using weak-form equation learning techniques. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form guarantees a robust and precise latent space recovery, hence allowing for a fast, robust, and accurate simulation. We demonstrate the efficacy of WLaSDI vs. LaSDI on several common benchmark examples including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in the case of 1D inviscid Burgers' simulations with the addition of up to 100% Gaussian white noise, the relative error remains consistently below 6% for WLaSDI, while it can exceed 10,000% for LaSDI. Similarly, for radial advection simulations, the relative errors stay below 15% for WLaSDI, in stark contrast to the potential errors of up to 10,000% with LaSDI. Moreover, speedups of several orders of magnitude can be obtained with WLaSDI. For example applying WLaSDI to 1D Burgers' yields a 140X speedup compared to the corresponding full order model.

Research Organization:
Michigan State Univ., East Lansing, MI (United States); Univ. of Colorado, Boulder, CO (United States); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
SC0023164; SC0023346; AC52-07NA27344
OSTI ID:
2221795
Alternate ID(s):
OSTI ID: 2377906
Journal Information:
Computer Methods in Applied Mechanics and Engineering, Journal Name: Computer Methods in Applied Mechanics and Engineering Vol. 427; ISSN 0045-7825
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (39)

Gradient-based constrained optimization using a database of linear reduced-order models journal December 2020
PySINDy: A comprehensive Python package for robust sparse system identification journal January 2022
Learning mean-field equations from particle data using WSINDy journal November 2022
Weak SINDy for partial differential equations journal October 2021
Deep Fluids: A Generative Network for Parameterized Fluid Simulations journal May 2019
Hydraulic Turbine Diffuser Shape Optimization by Multiple Surrogate Model Approximations of Pareto Fronts journal April 2007
Data-driven discovery of coordinates and governing equations journal October 2019
Building Surrogate Models Based on Detailed and Approximate Simulations journal June 2005
Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders journal March 2021
Learning sparse nonlinear dynamics via mixed-integer optimization journal January 2023
SNS: A Solution-Based Nonlinear Subspace Method for Time-Dependent Model Order Reduction journal January 2020
Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders journal November 2019
Space–time reduced order model for large-scale linear dynamical systems with application to Boltzmann transport problems journal January 2021
GPLaSDI: Gaussian Process-based interpretable Latent Space Dynamics Identification through deep autoencoder journal January 2024
Sparse model selection via integral terms journal August 2017
Weak SINDy: Galerkin-Based Data-Driven Model Selection journal January 2021
LaSDI: Parametric Latent Space Dynamics Identification journal September 2022
A Schur method for balanced-truncation model reduction journal July 1989
Non-intrusive reduced order modeling of natural convection in porous media using convolutional autoencoders: Comparison with linear subspace techniques journal February 2022
Reduced Basis Approximation and a Posteriori Error Estimation for Affinely Parametrized Elliptic Coercive Partial Differential Equations: Application to Transport and Continuum Mechanics journal May 2008
Sparse regression for plasma physics journal March 2023
A Comprehensive Deep Learning-Based Approach to Reduced Order Modeling of Nonlinear Time-Dependent Parametrized PDEs journal April 2021
A parameterized non-intrusive reduced order model and error analysis for general time-dependent nonlinear partial differential equations and its applications journal April 2017
Learning anisotropic interaction rules from individual trajectories in a heterogeneous cellular population journal October 2022
Deep learning journal May 2015
gLaSDI: Parametric physics-informed greedy latent space dynamics identification journal September 2023
Data-driven discovery of partial differential equations journal April 2017
Improving variable-fidelity surrogate modeling via gradient-enhanced kriging and a generalized hybrid bridge function journal March 2013
Gaussian process-based surrogate modeling framework for process planning in laser powder-bed fusion additive manufacturing of 316L stainless steel journal September 2017
A fast and accurate physics-informed neural network reduced order model with shallow masked autoencoder journal February 2022
Discovering governing equations from data by sparse identification of nonlinear dynamical systems journal March 2016
Data-driven discovery and extrapolation of parameterized pattern-forming dynamics journal November 2023
Benchmarking sparse system identification with low-dimensional chaos journal May 2023
Non-Intrusive Inference Reduced Order Model for Fluids Using Deep Multistep Neural Network journal August 2019
Space--Time Least-Squares Petrov--Galerkin Projection for Nonlinear Model Reduction journal January 2019
Local Lagrangian reduced-order modeling for the Rayleigh-Taylor instability by solution manifold decomposition journal January 2023
PySINDy: A Python package for the sparse identification of nonlinear dynamical systems from data journal May 2020
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows journal January 1993
Hierarchical Kriging Model for Variable-Fidelity Surrogate Modeling journal September 2012