Title: Sampling and resolution characteristics in reduced order models of shallow water equations: Intrusive vs nonintrusive

Journal Article · · International Journal for Numerical Methods in Fluids
DOI: https://doi.org/10.1002/fld.4815 · OSTI ID:1737500
ORCiD logo [1]; ORCiD logo [2];  [3]; ORCiD logo [4]
  1. Oklahoma State Univ., Stillwater, OK (United States); Oklahoma State University Stillwater
  2. Oklahoma State Univ., Stillwater, OK (United States)
  3. Univ. “Politechnica” of Timisoara, Hunedoara (Romania)
  4. Florida State Univ., Tallahassee, FL (United States)

We investigate the sensitivity of reduced order models (ROMs) to training data spatial resolution as well as sampling rate. In particular, we consider proper orthogonal decomposition (POD), coupled with Galerkin projection (POD-GP), as an intrusive reduced order modeling technique. For non-intrusive ROMs, we consider two frameworks. The first is using dynamic mode decomposition (DMD), and the second is based on artificial neural networks (ANNs). For ANN, we utilized a residual deep neural network, and for DMD we have studied two versions of DMD approaches; one with hard thresholding and the other with sorted bases selection. Also, we highlight the differences between mean-subtracting the data (centering) and using the data without mean-subtraction. We tested these ROMs using a system of 2D shallow water equations for four different numerical experiments, adopting combinations of sampling rates and spatial resolutions. For these cases, we found that the DMD basis obtained with hard threshodling is sensitive to sampling rate. The sorted DMD algorithm helps to mitigate this problem and yields more stabilized and converging solution. Furthermore, we demonstrate that both DMD approaches without mean subtraction provide significantly more accurate results than DMD with mean-subtracting the data. On the other hand, POD is relatively insensitive to sampling rate and yields better representation of the flow field. Meanwhile, spatial resolution has little effect on both POD and DMD performances. Here, the numerical results reveal that an ANN on POD subspace (POD-ANN) performs remarkably better than POD-GP and DMD in capturing system dynamics, even with a small number of modes.

Research Organization:
Oklahoma State Univ., Stillwater, OK (United States)
Sponsoring Organization:
USDOE; USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
SC0019290
OSTI ID:
1737500
Journal Information:
International Journal for Numerical Methods in Fluids, Journal Name: International Journal for Numerical Methods in Fluids Journal Issue: 8 Vol. 92; ISSN 0271-2091
Publisher:
WileyCopyright Statement
Country of Publication:
United States
Language:
English

References (112)

A deep learning enabler for non-intrusive reduced order modeling of fluid flows text January 2019
Optimal control of vortex shedding using low-order models. Part I?open-loop model development journal March 1999
Optimal control of vortex shedding using low-order models. Part II?model-based control journal March 1999
A reduced-order approach for optimal control of fluids using proper orthogonal decomposition journal January 2000
Reduced-order modeling for cardiac electrophysiology. Application to parameter identification: REDUCED-ORDER MODELING IN CARDIAC ELECTROPHYSIOLOGY
  • Boulakia, M.; Schenone, E.; Gerbeau, J-F.
  • International Journal for Numerical Methods in Biomedical Engineering, Vol. 28, Issue 6-7 https://doi.org/10.1002/cnm.2465
journal March 2012
Efficiency of a POD-based reduced second-order adjoint model in 4D-Var data assimilation journal January 2007
A reduced-order approach to four-dimensional variational data assimilation using proper orthogonal decomposition journal January 2007
An improved algorithm for the shallow water equations model reduction: Dynamic Mode Decomposition vs POD: AN IMPROVED ALGORITHM FOR DYNAMIC MODE DECOMPOSITION VS POD journal April 2015
On linear and nonlinear aspects of dynamic mode decomposition: Linear and Nonlinear Aspects of Dynamic Mode Decomposition journal February 2016
2D Burgers equation with large Reynolds number using POD/DEIM and calibration: 2D BURGERS EQUATIONS USING POD/DEIM AND TIKHONOV REGULARIZATION journal June 2016
The method of dynamic mode decomposition in shallow water and a swirling flow problem: THE DMD METHOD IN SHALLOW WATER AND A SWIRLING FLOW PROBLEM journal June 2016
Physically constrained data‐driven correction for reduced‐order modeling of fluid flows journal October 2018
POD-Galerkin approximations in PDE-constrained optimization journal October 2010
Non-linear model reduction for uncertainty quantification in large-scale inverse problems journal January 2009
Randomized dynamic mode decomposition for nonintrusive reduced order modelling: RANDOMIZED DYNAMIC MODE DECOMPOSITION FOR NIROM journal February 2017
A Reduced-Order Method for Simulation and Control of Fluid Flows journal July 1998
Neural Network Modeling for Near Wall Turbulent Flow journal October 2002
Pattern Recognition and Machine Learning book January 2006
Data Assimilation for Numerical Weather Prediction: A Review book January 2009
Data Assimilation book January 2009
On the hidden beauty of the proper orthogonal decomposition journal August 1991
Spatiotemporal analysis of complex signals: Theory and applications journal August 1991
Stochastic approaches to uncertainty quantification in CFD simulations journal March 2005
On the stability and extension of reduced-order Galerkin models in incompressible flows: A numerical study of vortex shedding journal June 2009
POD-spectral decomposition for fluid flow analysis and model reduction journal February 2013
De-biasing the dynamic mode decomposition for applied Koopman spectral analysis of noisy datasets journal April 2017
Stability Properties of POD-Galerkin Approximations for the Compressible Navier-Stokes Equations journal March 2000
Balanced POD for model reduction of linear PDE systems: convergence theory journal November 2011
Variants of Dynamic Mode Decomposition: Boundary Condition, Koopman, and Fourier Analyses journal April 2012
Characterizing and correcting for the effect of sensor noise in the dynamic mode decomposition journal February 2016
Neural network closures for nonlinear model order reduction journal January 2018
POD/DEIM Reduced-Order Modeling of Time-Fractional Partial Differential Equations with Applications in Parameter Identification journal April 2017
Spectral Properties of Dynamical Systems, Model Reduction and Decompositions journal August 2005
Computational design for long-term numerical integration of the equations of fluid motion: Two-dimensional incompressible flow. Part I journal August 1966
Neural networks and principal component analysis: Learning from examples without local minima journal January 1989
Multilayer feedforward networks are universal approximators journal January 1989
Truncated-Newton training algorithm for neurocomputational viscoplastic model journal May 2003
Pressure velocity coupling in a subsonic round jet journal June 2000
Machine learning closures for model order reduction of thermal fluids journal August 2018
Proper orthogonal decomposition closure models for turbulent flows: A numerical comparison journal September 2012
An artificial neural network framework for reduced order modeling of transient flows journal October 2019
A modified proper orthogonal decomposition method for flow dynamic analysis journal March 2019
Optimal control of the cylinder wake in the laminar regime by trust-region methods and POD reduced-order models journal August 2008
Stable Galerkin reduced order models for linearized compressible flow journal April 2009
POD/DEIM nonlinear model order reduction of an ADI implicit shallow water equations model journal March 2013
Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reduction journal February 2017
Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders journal November 2019
Data-driven POD-Galerkin reduced order model for turbulent flows journal September 2020
pyROM: A computational framework for reduced order modeling journal January 2019
Artificial viscosity proper orthogonal decomposition journal January 2011
Model reduction for compressible flows using POD and Galerkin projection journal February 2004
Data-Driven Science and Engineering book February 2019
Fundamentals of Engineering Numerical Analysis book January 2010
Atmospheric and Oceanic Fluid Dynamics book January 2006
Turbulence, Coherent Structures, Dynamical Systems and Symmetry book January 2012
Spectral analysis of nonlinear flows journal November 2009
Dynamic mode decomposition of numerical and experimental data journal July 2010
Koopman-mode decomposition of the cylinder wake journal June 2013
On the need for a nonlinear subscale turbulence term in POD models as exemplified for a high-Reynolds-number flow over an Ahmed body journal April 2014
Spectral proper orthogonal decomposition journal March 2016
Recursive dynamic mode decomposition of transient and post-transient wake flows journal November 2016
Deep learning in fluid dynamics journal January 2017
Sparse reduced-order modelling: sensor-based dynamics to full-state estimation journal April 2018
Spectral proper orthogonal decomposition and its relationship to dynamic mode decomposition and resolvent analysis journal May 2018
Multi-scale proper orthogonal decomposition of complex fluid flows journal May 2019
Super-resolution reconstruction of turbulent flows with machine learning journal May 2019
Sparsity-promoting dynamic mode decomposition journal February 2014
Dynamic mode decomposition for large and streaming datasets journal November 2014
A dynamic closure modeling framework for model order reduction of geophysical flows journal April 2019
A deep learning enabler for nonintrusive reduced order modeling of fluid flows journal August 2019
Hamiltonian Systems and Transformation in Hilbert Space journal May 1931
A proper orthogonal decomposition approach to approximate balanced truncation of infinite dimensional linear systems journal February 2009
Implications of the selection of a particular modal decomposition technique for the analysis of shallow flows journal March 2018
Reduced Basis Method for Optimal Control of Unsteady Viscous Flows journal October 2001
Efficiency of randomised dynamic mode decomposition for reduced order modelling journal March 2018
LIII. On lines and planes of closest fit to systems of points in space journal November 1901
Stable architectures for deep neural networks journal December 2017
Total variation diminishing Runge-Kutta schemes journal January 1998
Turbulence and the dynamics of coherent structures. I. Coherent structures journal January 1987
Dynamic mode decomposition for multiscale nonlinear physics journal June 2019
Identification and control of dynamical systems using neural networks journal March 1990
Certain Topics in Telegraph Transmission Theory journal April 1928
Principal component analysis in linear systems: Controllability, observability, and model reduction journal February 1981
Deep Fluids: A Generative Network for Parameterized Fluid Simulations journal May 2019
Receptive fields, binocular interaction and functional architecture in the cat's visual cortex journal January 1962
Closed-Loop Turbulence Control: Progress and Challenges journal August 2015
Dynamic Mode Decomposition book January 2016
Hybrid Reduced-Order Integration with Proper Orthogonal Decomposition and Dynamic Mode Decomposition journal January 2013
Multiresolution Dynamic Mode Decomposition journal January 2016
pyMOR -- Generic Algorithms and Interfaces for Model Order Reduction journal January 2016
Nonlinear Model Order Reduction via Dynamic Mode Decomposition journal January 2017
Feedback Control for Systems with Uncertain Parameters Using Online-Adaptive Reduced Models journal January 2017
Linearly Recurrent Autoencoder Networks for Learning Dynamics journal January 2019
Variable Projection Methods for an Optimized Dynamic Mode Decomposition journal January 2018
Model Reduction for Fluids, Using Balanced Proper Orthogonal Decomposition journal March 2005
Fluid control using the adjoint method conference January 2004
Analysis of Fluid Flows via Spectral Properties of the Koopman Operator journal January 2013
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows journal January 1993
Uncertainty Quantification and Polynomial Chaos Techniques in Computational Fluid Dynamics journal January 2009
A Survey of Finite-Difference Schemes for the Primitive Equations for a Barotropic Fluid journal May 1969
Data Assimilation Using an Ensemble Kalman Filter Technique journal March 1998
A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation journal January 2001
The Weather Research and Forecasting Model: Overview, System Efforts, and Future Directions journal August 2017
Evaluating Data Assimilation Algorithms journal November 2012
Use of Reduced-order Models for Improved Data Assimilation within an EnKF Context conference April 2013
Uber Die Beste Annaherung Von Funktionen Einer Gegebenen Funktionenklasse journal January 1936
Modal Analysis of Fluid Flows: An Overview journal December 2017
Balanced Model Reduction via the Proper Orthogonal Decomposition journal November 2002
Optimized Dynamic Mode Decomposition via Non-Convex Regularization and Multiscale Permutation Entropy journal February 2018
A Hybrid Approach for Model Order Reduction of Barotropic Quasi-Geostrophic Turbulence journal October 2018
Reduced Order Galerkin Models of flow Around Naca‐0012 Airfoil journal March 2008
On dynamic mode decomposition: Theory and applications journal December 2014