DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: An artificial neural network framework for reduced order modeling of transient flows

Journal Article · · Communications in Nonlinear Science and Numerical Simulation
ORCiD logo [1];  [2];  [2]
  1. Oklahoma State Univ., Stillwater, OK (United States); Oklahoma State University Stillwater
  2. Oklahoma State Univ., Stillwater, OK (United States)

Here, this paper proposes a supervised machine learning framework for the non-intrusive model order reduction of unsteady fluid flows to provide accurate predictions of non-stationary state variables when the control parameter values vary. Our approach utilizes a training process from full-order scale direct numerical simulation data projected on proper orthogonal decomposition (POD) modes to achieve an artificial neural network (ANN) model with reduced memory requirements. This data-driven ANN framework allows for a nonlinear time evolution of the modal coefficients without performing a Galerkin projection. Our POD-ANN framework can thus be considered an equation-free approach for latent space dynamics evolution of nonlinear transient systems and can be applied to a wide range of physical and engineering applications. Within this framework we introduce two architectures, namely sequential network (SN) and residual network (RN), to train the trajectory of modal coefficients. We perform a systematic analysis of the performance of the proposed reduced order modeling approaches on prediction of a nonlinear wave-propagation problem governed by the viscous Burgers equation, a simplified prototype setting for transient flows. We find that the POD-ANN-RN yields stable and accurate results for test problems assessed both within inside and outside of the database range and performs significantly better than the standard intrusive Galerkin projection model. Finally, our results show that the proposed framework provides a non-intrusive alternative to the evolution of transient physics in a POD basis spanned space, and can be used as a robust predictive model order reduction tool for nonlinear dynamical systems.

Research Organization:
Oklahoma State Univ., Stillwater, OK (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
Grant/Contract Number:
SC0019290
OSTI ID:
1593569
Journal Information:
Communications in Nonlinear Science and Numerical Simulation, Journal Name: Communications in Nonlinear Science and Numerical Simulation Journal Issue: C Vol. 77; ISSN 1007-5704
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (87)

A reduced-order approach for optimal control of fluids using proper orthogonal decomposition journal January 2000
Principal interval decomposition framework for POD reduced-order modeling of convective Boussinesq flows: PRINCIPAL INTERVAL DECOMPOSITION MODEL REDUCTION FRAMEWORK journal February 2015
An improved algorithm for the shallow water equations model reduction: Dynamic Mode Decomposition vs POD: AN IMPROVED ALGORITHM FOR DYNAMIC MODE DECOMPOSITION VS POD journal April 2015
Non-intrusive reduced-order modelling of the Navier-Stokes equations based on RBF interpolation: Non-intrusive reduced-order modelling of the Navier-Stokes equations based on RBF interpolation journal July 2015
Non-intrusive reduced order modelling with least squares fitting on a sparse grid: NON-INTRUSIVE REDUCED ORDER MODELLING WITH LEAST SQUARES FITTING journal July 2016
An evolve-then-filter regularized reduced order model for convection-dominated flows: EVOLVE-THEN-FILTER REGULARIZED REDUCED ORDER MODEL journal February 2017
Model identification of reduced order fluid dynamics systems using deep learning: Model identification in fluid dynamics using deep learning journal August 2017
A low-cost, goal-oriented ‘compact proper orthogonal decomposition’ basis for model reduction of static systems journal December 2010
Stabilization of projection-based reduced-order models: STABILIZATION OF PROJECTION-BASED REDUCED-ORDER MODELS journal February 2012
Randomized dynamic mode decomposition for nonintrusive reduced order modelling: RANDOMIZED DYNAMIC MODE DECOMPOSITION FOR NIROM journal February 2017
Nonintrusive reduced-order modeling of parametrized time-dependent partial differential equations journal February 2013
Neural Network Modeling for Near Wall Turbulent Flow journal October 2002
Stability Properties of POD-Galerkin Approximations for the Compressible Navier-Stokes Equations journal March 2000
Analysis of finite difference schemes for unsteady Navier-Stokes equations in vorticity formulation journal May 2002
Identification strategies for model-based control journal July 2013
A stabilized proper orthogonal decomposition reduced-order model for large scale quasigeostrophic ocean circulation journal May 2015
Neural network closures for nonlinear model order reduction journal January 2018
The Method of Proper Orthogonal Decomposition for Dynamical Characterization and Order Reduction of Mechanical Systems: An Overview journal August 2005
Stabilized principal interval decomposition method for model reduction of nonlinear convective systems with moving shocks journal September 2018
Compact finite difference schemes with spectral-like resolution journal November 1992
Stable and accurate boundary treatments for compact, high-order finite-difference schemes journal May 1993
Forecasting with artificial neural networks: journal March 1998
Modeling and control of physical processes using proper orthogonal decomposition journal January 2001
Machine learning closures for model order reduction of thermal fluids journal August 2018
Numerical analysis of the Leray reduced order model journal January 2018
Proper orthogonal decomposition closure models for turbulent flows: A numerical comparison journal September 2012
Non-intrusive reduced order modelling of the Navier–Stokes equations journal August 2015
Data-driven operator inference for nonintrusive projection-based model reduction journal July 2016
Approximate deconvolution reduced order modeling journal January 2017
Leapfrogging and synoptic Leapfrogging: A new optimization approach journal May 2012
A domain decomposition non-intrusive reduced order model for turbulent flows journal March 2019
Goal-oriented, model-constrained optimization for reduction of large-scale systems journal June 2007
Acceleration techniques for reduced-order models based on proper orthogonal decomposition journal August 2008
Two-level discretizations of nonlinear closure models for proper orthogonal decomposition journal January 2011
Machine learning strategies for systems with invariance properties journal August 2016
Energy balance and mass conservation in reduced order models of fluid flows journal October 2017
Non-intrusive reduced order modeling of nonlinear problems using neural networks journal June 2018
Practical error bounds for a non-intrusive bi-fidelity approach to parametric/stochastic model reduction journal September 2018
Non-intrusive reduced order modeling of unsteady flows using artificial neural networks with application to a combustion problem journal May 2019
A review of indirect/non-intrusive reduced order modeling of nonlinear geometric structures journal May 2013
Artificial viscosity proper orthogonal decomposition journal January 2011
A POD reduced order unstructured mesh ocean modelling method for moderate Reynolds number flows journal January 2009
Reduced-order modeling: new approaches for computational physics journal February 2004
Low-dimensional modelling of a confined three-dimensional wake flow journal November 2006
The dynamics of coherent structures in the wall region of a turbulent boundary layer journal July 1988
Low-dimensional control of the circular cylinder wake journal September 1998
On the need for a nonlinear subscale turbulence term in POD models as exemplified for a high-Reynolds-number flow over an Ahmed body journal April 2014
Using functional gains for effective sensor location in flow control: a reduced-order modelling approach journal September 2015
Closed-loop separation control using machine learning journal April 2015
Reynolds averaged turbulence modelling using deep neural networks with embedded invariance journal October 2016
A neural network approach for the blind deconvolution of turbulent flows journal October 2017
Construction of reduced-order models for fluid flows using deep feedforward neural networks journal June 2019
Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces journal January 1997
Analysis of a complex of statistical variables into principal components. journal January 1933
Optimal snapshot location for computing POD basis functions journal February 2010
Nonlinear Model for Drought Forecasting Based on a Conjunction of Wavelet Transforms and Neural Networks journal November 2003
Compressive sensing based machine learning strategy for characterizing the flow around a cylinder with limited pressure measurements journal December 2013
Evaluation of machine learning algorithms for prediction of regions of high Reynolds averaged Navier Stokes uncertainty journal August 2015
Using field inversion to quantify functional errors in turbulence closures journal April 2016
Application of neural networks to turbulence control for drag reduction journal June 1997
An artificial neural network approach to rainfall-runoff modelling journal February 1998
Optimal flow control using a POD-based reduced-order model journal June 2016
Modeling and control of magnetorheological dampers for seismic response reduction journal October 1996
Stable architectures for deep neural networks journal December 2017
Total variation diminishing Runge-Kutta schemes journal January 1998
A method for the solution of certain non-linear problems in least squares journal January 1944
Turbulence and the dynamics of coherent structures. I. Coherent structures journal January 1987
Extreme learning machine for reduced order modeling of turbulent geophysical flows journal April 2018
Searching for turbulence models by artificial neural network journal May 2017
Pricing and hedging derivative securities with neural networks: Bayesian regularization, early stopping, and bagging journal July 2001
Reduced-order modeling of time-varying systems journal January 1999
Efficient reduced-order modeling of frequency-dependent coupling inductances associated with 3-D interconnect structures
  • Miguel Silveira, L.; Kamon, M.; White, J.
  • IEEE Transactions on Components, Packaging, and Manufacturing Technology: Part B, Vol. 19, Issue 2 https://doi.org/10.1109/96.496030
journal May 1996
Experimental Turbulent Field Modeling by Visualization and Neural Networks journal May 2004
Closed-Loop Turbulence Control: Progress and Challenges journal August 2015
A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems journal January 2015
Sparse Sensing and DMD-Based Identification of Flow Regimes and Bifurcations in Complex Flows journal January 2017
Data-Driven Filtered Reduced Order Modeling of Fluid Flows journal January 2018
Galerkin Proper Orthogonal Decomposition Methods for a General Equation in Fluid Dynamics journal January 2002
Neural networks: applications in industry, business and science journal March 1994
Model Reduction for Flow Analysis and Control journal January 2017
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows journal January 1993
Data-assisted reduced-order modeling of extreme events in complex dynamical systems journal May 2018
Modal Analysis of Fluid Flows: An Overview journal December 2017
Greedy Nonintrusive Reduced Order Model for Fluid Dynamics journal December 2018
Multiple Sensor Control of Vortex Shedding journal April 2001
Unsteady Fluid Mechanics Applications of Neural Networks journal January 1997
New Regularization Method for Calibrated pod Reduced-Order Models journal January 2016

Cited By (3)

A deep learning enabler for nonintrusive reduced order modeling of fluid flows journal August 2019
Nonintrusive reduced order modeling framework for quasigeostrophic turbulence journal November 2019
A deep learning enabler for non-intrusive reduced order modeling of fluid flows text January 2019