Data-driven learning of Mori–Zwanzig operators for isotropic turbulence
Abstract
Developing reduced-order models for turbulent flows, which contain dynamics over a wide range of scales, is an extremely challenging problem. In statistical mechanics, the Mori–Zwanzig (MZ) formalism provides a mathematically exact procedure for constructing reduced-order representations of high-dimensional dynamical systems, where the effects due to the unresolved dynamics are captured in the memory kernel and orthogonal dynamics. Turbulence models based on MZ formalism have been scarce due to the limited knowledge of the MZ operators, which originates from the difficulty in deriving MZ kernels for complex nonlinear dynamical systems. In this work, we apply a recently developed data-driven learning algorithm, which is based on Koopman's description of dynamical systems and Mori's linear projection operator, on a set of fully resolved isotropic turbulence datasets to extract the Mori–Zwanzig operators. With data augmentation using known turbulence symmetries, the extracted Markov term, memory kernel, and orthogonal dynamics are statistically converged and the generalized fluctuation–dissipation relation can be verified. The properties of the memory kernel and orthogonal dynamics, and their dependence on the choices of observables are investigated to address the modeling assumptions that are commonly used in MZ-based models. A series of numerical experiments are then constructed using the extracted kernels to evaluatemore »
- Authors:
-
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA); USDOE Laboratory Directed Research and Development (LDRD) Program
- OSTI Identifier:
- 1874192
- Alternate Identifier(s):
- OSTI ID: 1834961
- Report Number(s):
- LA-UR-21-28283
Journal ID: ISSN 1070-6631; TRN: US2307113
- Grant/Contract Number:
- 89233218CNA000001
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Physics of Fluids
- Additional Journal Information:
- Journal Volume: 33; Journal Issue: 12; Journal ID: ISSN 1070-6631
- Publisher:
- American Institute of Physics (AIP)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; turbulence simulations; nonequilibrium statistical mechanics; computational fluid dynamics; turbulent flows; Navier Stokes equations; turbulence theory and modelling; nonlinear systems
Citation Formats
Tian, Yifeng, Lin, Yen Ting, Anghel, Marian, and Livescu, Daniel. Data-driven learning of Mori–Zwanzig operators for isotropic turbulence. United States: N. p., 2021.
Web. doi:10.1063/5.0070548.
Tian, Yifeng, Lin, Yen Ting, Anghel, Marian, & Livescu, Daniel. Data-driven learning of Mori–Zwanzig operators for isotropic turbulence. United States. https://doi.org/10.1063/5.0070548
Tian, Yifeng, Lin, Yen Ting, Anghel, Marian, and Livescu, Daniel. Thu .
"Data-driven learning of Mori–Zwanzig operators for isotropic turbulence". United States. https://doi.org/10.1063/5.0070548. https://www.osti.gov/servlets/purl/1874192.
@article{osti_1874192,
title = {Data-driven learning of Mori–Zwanzig operators for isotropic turbulence},
author = {Tian, Yifeng and Lin, Yen Ting and Anghel, Marian and Livescu, Daniel},
abstractNote = {Developing reduced-order models for turbulent flows, which contain dynamics over a wide range of scales, is an extremely challenging problem. In statistical mechanics, the Mori–Zwanzig (MZ) formalism provides a mathematically exact procedure for constructing reduced-order representations of high-dimensional dynamical systems, where the effects due to the unresolved dynamics are captured in the memory kernel and orthogonal dynamics. Turbulence models based on MZ formalism have been scarce due to the limited knowledge of the MZ operators, which originates from the difficulty in deriving MZ kernels for complex nonlinear dynamical systems. In this work, we apply a recently developed data-driven learning algorithm, which is based on Koopman's description of dynamical systems and Mori's linear projection operator, on a set of fully resolved isotropic turbulence datasets to extract the Mori–Zwanzig operators. With data augmentation using known turbulence symmetries, the extracted Markov term, memory kernel, and orthogonal dynamics are statistically converged and the generalized fluctuation–dissipation relation can be verified. The properties of the memory kernel and orthogonal dynamics, and their dependence on the choices of observables are investigated to address the modeling assumptions that are commonly used in MZ-based models. A series of numerical experiments are then constructed using the extracted kernels to evaluate the memory effects on prediction. The results show that the prediction errors are strongly affected by the choice of observables and can be further reduced by including the past history of the observables in the memory kernel.},
doi = {10.1063/5.0070548},
journal = {Physics of Fluids},
number = 12,
volume = 33,
place = {United States},
year = {Thu Dec 09 00:00:00 EST 2021},
month = {Thu Dec 09 00:00:00 EST 2021}
}
Works referenced in this record:
A priori estimation of memory effects in reduced-order models of nonlinear systems using the Mori–Zwanzig formalism
journal, September 2017
- Gouasmi, Ayoub; Parish, Eric J.; Duraisamy, Karthik
- Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 473, Issue 2205
A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
journal, June 2015
- Williams, Matthew O.; Kevrekidis, Ioannis G.; Rowley, Clarence W.
- Journal of Nonlinear Science, Vol. 25, Issue 6
Dynamic mode decomposition of numerical and experimental data
journal, July 2010
- Schmid, Peter J.
- Journal of Fluid Mechanics, Vol. 656
Statistical Mechanics of Nonequilibrium Liquids
book, January 2007
- Evans, Denis J.; Morriss, Gary P.
- ANU Press
Renormalized reduced models for singular PDEs
journal, January 2013
- Stinis, Panos
- Communications in Applied Mathematics and Computational Science, Vol. 8, Issue 1
Existence proof for orthogonal dynamics and the Mori-Zwanzig formalism
journal, December 2005
- Givon, Dror; Kupferman, Raz; Hald, Ole H.
- Israel Journal of Mathematics, Vol. 145, Issue 1
Renormalized Mori–Zwanzig-reduced models for systems without scale separation
journal, April 2015
- Stinis, Panos
- Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 471, Issue 2176
A dynamic subgrid scale model for Large Eddy Simulations based on the Mori–Zwanzig formalism
journal, November 2017
- Parish, Eric J.; Duraisamy, Karthik
- Journal of Computational Physics, Vol. 349
Hamiltonian Systems and Transformation in Hilbert Space
journal, May 1931
- Koopman, B. O.
- Proceedings of the National Academy of Sciences, Vol. 17, Issue 5
Non-Markovian out-of-equilibrium dynamics: A general numerical procedure to construct time-dependent memory kernels for coarse-grained observables
journal, November 2019
- Meyer, Hugues; Pelagejcev, Philipp; Schilling, Tanja
- EPL (Europhysics Letters), Vol. 128, Issue 4
Extracting and Modeling the Effects of Small-Scale Fluctuations on Large-Scale Fluctuations by Mori–Zwanzig Projection Operator Method
journal, February 2020
- Maeyama, Shinya; Watanabe, Tomo-Hiko
- Journal of the Physical Society of Japan, Vol. 89, Issue 2
General Circulation Experiments with the Primitive Equations: i. the Basic Experiment*
journal, March 1963
- Smagorinsky, J.
- Monthly Weather Review, Vol. 91, Issue 3
Decay of Isotropic Turbulence in the Direct-Interaction Approximation
journal, January 1964
- Kraichnan, Robert H.
- Physics of Fluids, Vol. 7, Issue 7
A dynamic subgrid‐scale eddy viscosity model
journal, July 1991
- Germano, Massimo; Piomelli, Ugo; Moin, Parviz
- Physics of Fluids A: Fluid Dynamics, Vol. 3, Issue 7
Problem reduction, renormalization, and memory
journal, January 2006
- Chorin, Alexandre; Stinis, Panagiotis
- Communications in Applied Mathematics and Computational Science, Vol. 1, Issue 1
Optimal prediction and the Mori-Zwanzig representation of irreversible processes
journal, March 2000
- Chorin, A. J.; Hald, O. H.; Kupferman, R.
- Proceedings of the National Academy of Sciences, Vol. 97, Issue 7
Optimal Prediction of Burgers’s Equation
journal, January 2007
- Bernstein, David
- Multiscale Modeling & Simulation, Vol. 6, Issue 1
The t -Model as a Large Eddy Simulation Model for the Navier–Stokes Equations
journal, January 2010
- Chandy, Abhilash J.; Frankel, Steven H.
- Multiscale Modeling & Simulation, Vol. 8, Issue 2
Dynamic structures of the time correlation functions of chaotic nonequilibrium fluctuations
journal, December 2007
- Mori, Hazime; Okamura, Makoto
- Physical Review E, Vol. 76, Issue 6
A Statistically-Derived Subgrid-Scale Kinetic Energy Model for the Large-Eddy Simulation of Turbulent Flows
journal, August 1985
- Yoshizawa, Akira; Horiuti, Kiyosi
- Journal of the Physical Society of Japan, Vol. 54, Issue 8
A Numerical Procedure to Evaluate Memory Effects in Non‐Equilibrium Coarse‐Grained Models
journal, November 2020
- Meyer, Hugues; Wolf, Steffen; Stock, Gerhard
- Advanced Theory and Simulations, Vol. 4, Issue 4
Lagrangian-History Closure Approximation for Turbulence
journal, January 1965
- Kraichnan, Robert H.
- Physics of Fluids, Vol. 8, Issue 4
Dynamical Systems of Continuous Spectra
journal, March 1932
- Koopman, B. O.; Neumann, J. v.
- Proceedings of the National Academy of Sciences, Vol. 18, Issue 3
Nonlinear generalized Langevin equations
journal, November 1973
- Zwanzig, Robert
- Journal of Statistical Physics, Vol. 9, Issue 3
Reaction analogy based forcing for incompressible scalar turbulence
journal, September 2018
- Daniel, Don; Livescu, Daniel; Ryu, Jaiyoung
- Physical Review Fluids, Vol. 3, Issue 9
Transport, Collective Motion, and Brownian Motion
journal, March 1965
- Mori, Hazime
- Progress of Theoretical Physics, Vol. 33, Issue 3
Turbulence: the filtering approach
journal, May 1992
- Germano, M.
- Journal of Fluid Mechanics, Vol. 238
Optimal prediction and the rate of decay for solutions of the Euler equations in two and three dimensions
journal, April 2007
- Hald, O. H.; Stinis, P.
- Proceedings of the National Academy of Sciences, Vol. 104, Issue 16
Forcing for statistically stationary compressible isotropic turbulence
journal, November 2010
- Petersen, Mark R.; Livescu, Daniel
- Physics of Fluids, Vol. 22, Issue 11
Derivation of delay equation climate models using the Mori-Zwanzig formalism
journal, July 2019
- Falkena, Swinda K. J.; Quinn, Courtney; Sieber, Jan
- Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 475, Issue 2227
Non-Markovian closure models for large eddy simulations using the Mori-Zwanzig formalism
journal, January 2017
- Parish, Eric J.; Duraisamy, Karthik
- Physical Review Fluids, Vol. 2, Issue 1
Validity of the essential assumption in a projection operator method
journal, October 2006
- Okamura, Makoto
- Physical Review E, Vol. 74, Issue 4
Optimal prediction with memory
journal, June 2002
- Chorin, Alexandre J.; Hald, Ole H.; Kupferman, Raz
- Physica D: Nonlinear Phenomena, Vol. 166, Issue 3-4
Data-Driven Learning for the Mori--Zwanzig Formalism: A Generalization of the Koopman Learning Framework
journal, January 2021
- Lin, Yen Ting; Tian, Yifeng; Livescu, Daniel
- SIAM Journal on Applied Dynamical Systems, Vol. 20, Issue 4
Computing generalized Langevin equations and generalized Fokker-Planck equations
journal, June 2009
- Darve, E.; Solomon, J.; Kia, A.
- Proceedings of the National Academy of Sciences, Vol. 106, Issue 27
Lagrangian Markovianized field approximation for turbulence
journal, January 2013
- Bos, Wouter J. T.; Bertoglio, Jean-Pierre
- Journal of Turbulence, Vol. 14, Issue 1
Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism
journal, January 2021
- Lin, Kevin K.; Lu, Fei
- Journal of Computational Physics, Vol. 424