skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Nonintrusive reduced order modeling framework for quasigeostrophic turbulence

Journal Article · · Physical Review E

In this study, we present a nonintrusive reduced order modeling (ROM) framework for large-scale quasistationary systems. The framework proposed in this work exploits the time series prediction capability of long short-term memory (LSTM) recurrent neural network architecture such that (1) in the training phase, the LSTM model is trained on the modal coefficients extracted from the high-resolution data snapshots using proper orthogonal decomposition (POD) transform, and (2) in the testing phase, the trained model predicts the modal coefficients for the total time recursively based on the initial time history. Hence, no prior information about the underlying governing equations is required to generate the ROM. To illustrate the predictive performance of the proposed framework, the mean flow fields and time series response of the field values are reconstructed from the predicted modal coefficients by using an inverse POD transform. As a representative benchmark test case, we consider a two-dimensional quasigeostrophic ocean circulation model which, in general, displays an enormous range of fluctuating spatial and temporal scales. We first demonstrate that the conventional Galerkin projection-based reduced order modeling of such systems requires a high number of POD modes to obtain a stable flow physics. In addition, ROM-Galerkin projection (ROM-GP) does not seem to capture the intermittent bursts appearing in the dynamics of the first few most energetic modes. However, the proposed nonintrusive ROM framework based on LSTM (ROM-LSTM) yields a stable solution even for a small number of POD modes. We also observe that the ROM-LSTM model is able to capture quasiperiodic intermittent bursts accurately, and yields a stable and accurate mean flow dynamics using the time history of a few previous time states, denoted as the lookback time window in this paper. We show several features of ROM-LSTM framework such as significantly higher accuracy than ROM-GP, and faster performance using larger time step size. Throughout the paper, we demonstrate our findings in terms of time series evolution of the field values and mean flow patterns, which suggest that the proposed fully nonintrusive ROM framework is robust and capable of predicting chaotic nonlinear fluid flows in an extremely efficient way compared to the conventional projection-based ROM framework.

Research Organization:
Oklahoma State Univ., Stillwater, OK (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
SC0019290
OSTI ID:
1593558
Journal Information:
Physical Review E, Vol. 100, Issue 5; ISSN 2470-0045
Publisher:
American Physical Society (APS)Copyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 40 works
Citation information provided by
Web of Science

References (107)

A Reduced-Order Method for Simulation and Control of Fluid Flows journal July 1998
Learning long-term dependencies with gradient descent is difficult journal March 1994
Data-assisted reduced-order modeling of extreme events in complex dynamical systems journal May 2018
Spatio-temporal symmetries and bifurcations via bi-orthogonal decompositions journal June 1992
A reduced-order model for heat transfer in multiphase flow and practical aspects of the proper orthogonal decomposition journal August 2012
Non-linear dynamics and statistical theories for basic geophysical flows book January 2006
Reduced Basis Methods for Parameterized Partial Differential Equations with Stochastic Influences Using the Karhunen--Loève Expansion journal January 2013
Deep learning journal May 2015
A neural network approach for the blind deconvolution of turbulent flows journal October 2017
Dynamics of three-dimensional coherent structures in a flat-plate boundary layer journal September 1994
On the stability and extension of reduced-order Galerkin models in incompressible flows: A numerical study of vortex shedding journal June 2009
Hybrid forecasting of chaotic processes: Using machine learning in conjunction with a knowledge-based model journal April 2018
Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks
  • Vlachas, Pantelis R.; Byeon, Wonmin; Wan, Zhong Y.
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 474, Issue 2213 https://doi.org/10.1098/rspa.2017.0844
journal May 2018
A Short Review on Model Order Reduction Based on Proper Generalized Decomposition journal October 2011
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
Unsteady Fluid Mechanics Applications of Neural Networks journal January 1997
Climate change, the Hurst phenomenon, and hydrological statistics journal February 2003
Data-Driven Filtered Reduced Order Modeling of Fluid Flows journal January 2018
Identification strategies for model-based control journal July 2013
Turbulence Modeling in the Age of Data journal January 2019
An improved algorithm for the shallow water equations model reduction: Dynamic Mode Decomposition vs POD: AN IMPROVED ALGORITHM FOR DYNAMIC MODE DECOMPOSITION VS POD journal April 2015
Application of neural networks to turbulence control for drag reduction journal June 1997
LSTM: A Search Space Odyssey journal October 2017
A hierarchy of low-dimensional models for the transient and post-transient cylinder wake journal December 2003
Model Reduction for Flow Analysis and Control journal January 2017
POD and CVT-based reduced-order modeling of Navier–Stokes flows journal December 2006
A dynamic closure modeling framework for model order reduction of geophysical flows journal April 2019
Approximate deconvolution reduced order modeling journal January 2017
On Low-Dimensional Galerkin Models for Fluid Flow journal June 2000
Reduced order models based on local POD plus Galerkin projection journal April 2010
An artificial neural network framework for reduced order modeling of transient flows journal October 2019
Total variation diminishing Runge-Kutta schemes journal January 1998
Non-intrusive reduced order modeling of unsteady flows using artificial neural networks with application to a combustion problem journal May 2019
Dispersive–Dissipative Eddy Parameterization in a Barotropic Model journal August 2001
Numerical assessments of ocean energy extraction from western boundary currents using a quasi-geostrophic ocean circulation model journal December 2016
Long Short-Term Memory journal November 1997
A reduced-order approach to four-dimensional variational data assimilation using proper orthogonal decomposition journal January 2007
A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems journal January 2015
A spectral viscosity method for correcting the long-term behavior of POD models journal February 2004
Galerkin Proper Orthogonal Decomposition Methods for a General Equation in Fluid Dynamics journal January 2002
Spectral proper orthogonal decomposition journal March 2016
Some Recent Developments in Turbulence Closure Modeling journal January 2018
Observing the Ocean in the 1990s journal October 1982
A proper orthogonal decomposition method for nonlinear flows with deforming meshes journal December 2014
Proper orthogonal decomposition and low-dimensional models for driven cavity flows journal July 1998
Proper orthogonal decomposition closure models for turbulent flows: A numerical comparison journal September 2012
Robustness of the rescaled range R/S in the measurement of noncyclic long run statistical dependence journal October 1969
Neural network closures for nonlinear model order reduction journal January 2018
Noah, Joseph, and Operational Hydrology journal October 1968
Wind-driven ocean circulation and equilibrium statistical mechanics journal August 1989
The End of Moore's Law: A New Beginning for Information Technology journal March 2017
Four-Gyre Circulation in a Barotropic Model with Double-Gyre Wind Forcing journal June 2000
A new algorithm for high-dimensional uncertainty quantification based on dimension-adaptive sparse grid approximation and reduced basis methods journal October 2015
Closed-Loop Turbulence Control: Progress and Challenges journal August 2015
Data-driven deconvolution for large eddy simulations of Kraichnan turbulence journal December 2018
Fifty Years of Moore's Law journal May 2011
The dynamics of coherent structures in the wall region of a turbulent boundary layer journal July 1988
Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication journal April 2004
On the need for a nonlinear subscale turbulence term in POD models as exemplified for a high-Reynolds-number flow over an Ahmed body journal April 2014
Machine Learning for Fluid Mechanics journal September 2019
Emergence of Inertial Gyres in a Two-Layer Quasigeostrophic Ocean Model journal March 1998
An Example of Eddy-Induced Ocean Circulation journal July 1980
Reduced-order modeling: new approaches for computational physics journal February 2004
Deep learning algorithm for data-driven simulation of noisy dynamical system journal January 2019
New approach for automatic classification of Alzheimer's disease, mild cognitive impairment and healthy brain magnetic resonance images journal January 2014
Computational design for long-term numerical integration of the equations of fluid motion: Two-dimensional incompressible flow. Part I journal August 1966
Efficient non-linear model reduction via a least-squares Petrov-Galerkin projection and compressive tensor approximations
  • Carlberg, Kevin; Bou-Mosleh, Charbel; Farhat, Charbel
  • International Journal for Numerical Methods in Engineering, Vol. 86, Issue 2 https://doi.org/10.1002/nme.3050
journal October 2010
Approximate deconvolution large eddy simulation of a barotropic ocean circulation model journal January 2011
Model reduction for compressible flows using POD and Galerkin projection journal February 2004
A survey of model reduction methods for large-scale systems book January 2001
The chips are down for Moore’s law journal February 2016
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows journal January 1993
Wind-Driven Currents in a Baroclinic Ocean; with Application to the Equatorial Currents of the Eastern Pacific journal November 1947
A Hybrid Approach for Model Order Reduction of Barotropic Quasi-Geostrophic Turbulence journal October 2018
Extreme learning machine for reduced order modeling of turbulent geophysical flows journal April 2018
Stability Properties of POD-Galerkin Approximations for the Compressible Navier-Stokes Equations journal March 2000
A stabilized proper orthogonal decomposition reduced-order model for large scale quasigeostrophic ocean circulation journal May 2015
Towards a topological–geometrical theory of group equivariant non-expansive operators for data analysis and machine learning journal September 2019
Model identification of reduced order fluid dynamics systems using deep learning: Model identification in fluid dynamics using deep learning journal August 2017
Turbulence and the dynamics of coherent structures. I. Coherent structures journal January 1987
Markov processes, Hurst exponents, and nonlinear diffusion equations: With application to finance journal September 2006
Time-dependent Hurst exponent in financial time series journal December 2004
Deep learning in fluid dynamics journal January 2017
Inertial gyres in decaying and forced geostrophic turbulence journal November 1992
Modeling Mesoscale Turbulence in the Barotropic Double-Gyre Circulation journal November 2003
Dynamics and Control of High-Reynolds-Number flow over open Cavities journal January 2006
A First Course in Turbulence January 1972
Spectral proper orthogonal decomposition text January 2016
Unsteady fluid mechanics applications of neural networks conference August 1995
A Proper Orthogonal Decomposition Method for Nonlinear Flows with Deforming Meshes conference January 2013
Computational Design for Long-Term Numerical Integration of the Equations of Fluid Motion: Two-Dimensional Incompressible Flow. Part I journal August 1997
Data-assisted reduced-order modeling of extreme events in complex dynamical systems text January 2018
Deep Learning text January 2018
Approximate deconvolution large eddy simulation of a barotropic ocean circulation model text January 2011
Proper Orthogonal Decomposition Closure Models For Turbulent Flows: A Numerical Comparison text January 2011
On the need for a nonlinear subscale turbulence term in POD models as exemplified for a high Reynolds number flow over an Ahmed body text January 2013
LSTM: A Search Space Odyssey text January 2015
Numerical assessments of ocean energy extraction from western boundary currents using a quasi-geostrophic ocean circulation model text January 2016
Modal Analysis of Fluid Flows: An Overview preprint January 2017
A neural network approach for the blind deconvolution of turbulent flows text January 2017
Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks text January 2018
An artificial neural network framework for reduced order modeling of transient flows text January 2018
Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Model text January 2018
Data-driven deconvolution for large eddy simulations of Kraichnan turbulence preprint January 2018
A dynamic closure modeling framework for model order reduction of geophysical flows preprint January 2019
Machine Learning for Fluid Mechanics text January 2019
Markov Processes, Hurst Exponents, and Nonlinear Diffusion Equations with application to finance text January 2006

Similar Records

An artificial neural network framework for reduced order modeling of transient flows
Journal Article · Thu Apr 25 00:00:00 EDT 2019 · Communications in Nonlinear Science and Numerical Simulation · OSTI ID:1593558

Data-driven recovery of hidden physics in reduced order modeling of fluid flows
Journal Article · Tue Mar 10 00:00:00 EDT 2020 · Physics of Fluids · OSTI ID:1593558

Sampling and resolution characteristics in reduced order models of shallow water equations: Intrusive vs nonintrusive
Journal Article · Fri Jan 24 00:00:00 EST 2020 · International Journal for Numerical Methods in Fluids · OSTI ID:1593558

Related Subjects