DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Data-driven learning of Mori–Zwanzig operators for isotropic turbulence

Abstract

Developing reduced-order models for turbulent flows, which contain dynamics over a wide range of scales, is an extremely challenging problem. In statistical mechanics, the Mori–Zwanzig (MZ) formalism provides a mathematically exact procedure for constructing reduced-order representations of high-dimensional dynamical systems, where the effects due to the unresolved dynamics are captured in the memory kernel and orthogonal dynamics. Turbulence models based on MZ formalism have been scarce due to the limited knowledge of the MZ operators, which originates from the difficulty in deriving MZ kernels for complex nonlinear dynamical systems. In this work, we apply a recently developed data-driven learning algorithm, which is based on Koopman's description of dynamical systems and Mori's linear projection operator, on a set of fully resolved isotropic turbulence datasets to extract the Mori–Zwanzig operators. With data augmentation using known turbulence symmetries, the extracted Markov term, memory kernel, and orthogonal dynamics are statistically converged and the generalized fluctuation–dissipation relation can be verified. The properties of the memory kernel and orthogonal dynamics, and their dependence on the choices of observables are investigated to address the modeling assumptions that are commonly used in MZ-based models. A series of numerical experiments are then constructed using the extracted kernels to evaluatemore » the memory effects on prediction. The results show that the prediction errors are strongly affected by the choice of observables and can be further reduced by including the past history of the observables in the memory kernel.« less

Authors:
ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [1]
  1. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Publication Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); USDOE Laboratory Directed Research and Development (LDRD) Program
OSTI Identifier:
1874192
Alternate Identifier(s):
OSTI ID: 1834961
Report Number(s):
LA-UR-21-28283
Journal ID: ISSN 1070-6631; TRN: US2307113
Grant/Contract Number:  
89233218CNA000001
Resource Type:
Accepted Manuscript
Journal Name:
Physics of Fluids
Additional Journal Information:
Journal Volume: 33; Journal Issue: 12; Journal ID: ISSN 1070-6631
Publisher:
American Institute of Physics (AIP)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; turbulence simulations; nonequilibrium statistical mechanics; computational fluid dynamics; turbulent flows; Navier Stokes equations; turbulence theory and modelling; nonlinear systems

Citation Formats

Tian, Yifeng, Lin, Yen Ting, Anghel, Marian, and Livescu, Daniel. Data-driven learning of Mori–Zwanzig operators for isotropic turbulence. United States: N. p., 2021. Web. doi:10.1063/5.0070548.
Tian, Yifeng, Lin, Yen Ting, Anghel, Marian, & Livescu, Daniel. Data-driven learning of Mori–Zwanzig operators for isotropic turbulence. United States. https://doi.org/10.1063/5.0070548
Tian, Yifeng, Lin, Yen Ting, Anghel, Marian, and Livescu, Daniel. Thu . "Data-driven learning of Mori–Zwanzig operators for isotropic turbulence". United States. https://doi.org/10.1063/5.0070548. https://www.osti.gov/servlets/purl/1874192.
@article{osti_1874192,
title = {Data-driven learning of Mori–Zwanzig operators for isotropic turbulence},
author = {Tian, Yifeng and Lin, Yen Ting and Anghel, Marian and Livescu, Daniel},
abstractNote = {Developing reduced-order models for turbulent flows, which contain dynamics over a wide range of scales, is an extremely challenging problem. In statistical mechanics, the Mori–Zwanzig (MZ) formalism provides a mathematically exact procedure for constructing reduced-order representations of high-dimensional dynamical systems, where the effects due to the unresolved dynamics are captured in the memory kernel and orthogonal dynamics. Turbulence models based on MZ formalism have been scarce due to the limited knowledge of the MZ operators, which originates from the difficulty in deriving MZ kernels for complex nonlinear dynamical systems. In this work, we apply a recently developed data-driven learning algorithm, which is based on Koopman's description of dynamical systems and Mori's linear projection operator, on a set of fully resolved isotropic turbulence datasets to extract the Mori–Zwanzig operators. With data augmentation using known turbulence symmetries, the extracted Markov term, memory kernel, and orthogonal dynamics are statistically converged and the generalized fluctuation–dissipation relation can be verified. The properties of the memory kernel and orthogonal dynamics, and their dependence on the choices of observables are investigated to address the modeling assumptions that are commonly used in MZ-based models. A series of numerical experiments are then constructed using the extracted kernels to evaluate the memory effects on prediction. The results show that the prediction errors are strongly affected by the choice of observables and can be further reduced by including the past history of the observables in the memory kernel.},
doi = {10.1063/5.0070548},
journal = {Physics of Fluids},
number = 12,
volume = 33,
place = {United States},
year = {Thu Dec 09 00:00:00 EST 2021},
month = {Thu Dec 09 00:00:00 EST 2021}
}

Works referenced in this record:

A priori estimation of memory effects in reduced-order models of nonlinear systems using the Mori–Zwanzig formalism
journal, September 2017

  • Gouasmi, Ayoub; Parish, Eric J.; Duraisamy, Karthik
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 473, Issue 2205
  • DOI: 10.1098/rspa.2017.0385

A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
journal, June 2015

  • Williams, Matthew O.; Kevrekidis, Ioannis G.; Rowley, Clarence W.
  • Journal of Nonlinear Science, Vol. 25, Issue 6
  • DOI: 10.1007/s00332-015-9258-5

Dynamic mode decomposition of numerical and experimental data
journal, July 2010


Statistical Mechanics of Nonequilibrium Liquids
book, January 2007


Renormalized reduced models for singular PDEs
journal, January 2013

  • Stinis, Panos
  • Communications in Applied Mathematics and Computational Science, Vol. 8, Issue 1
  • DOI: 10.2140/camcos.2013.8.39

Existence proof for orthogonal dynamics and the Mori-Zwanzig formalism
journal, December 2005

  • Givon, Dror; Kupferman, Raz; Hald, Ole H.
  • Israel Journal of Mathematics, Vol. 145, Issue 1
  • DOI: 10.1007/BF02786691

Renormalized Mori–Zwanzig-reduced models for systems without scale separation
journal, April 2015

  • Stinis, Panos
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 471, Issue 2176
  • DOI: 10.1098/rspa.2014.0446

A dynamic subgrid scale model for Large Eddy Simulations based on the Mori–Zwanzig formalism
journal, November 2017


Hamiltonian Systems and Transformation in Hilbert Space
journal, May 1931

  • Koopman, B. O.
  • Proceedings of the National Academy of Sciences, Vol. 17, Issue 5
  • DOI: 10.1073/pnas.17.5.315

Non-Markovian out-of-equilibrium dynamics: A general numerical procedure to construct time-dependent memory kernels for coarse-grained observables
journal, November 2019


Extracting and Modeling the Effects of Small-Scale Fluctuations on Large-Scale Fluctuations by Mori–Zwanzig Projection Operator Method
journal, February 2020

  • Maeyama, Shinya; Watanabe, Tomo-Hiko
  • Journal of the Physical Society of Japan, Vol. 89, Issue 2
  • DOI: 10.7566/JPSJ.89.024401

Decay of Isotropic Turbulence in the Direct-Interaction Approximation
journal, January 1964


A dynamic subgrid‐scale eddy viscosity model
journal, July 1991

  • Germano, Massimo; Piomelli, Ugo; Moin, Parviz
  • Physics of Fluids A: Fluid Dynamics, Vol. 3, Issue 7
  • DOI: 10.1063/1.857955

Problem reduction, renormalization, and memory
journal, January 2006

  • Chorin, Alexandre; Stinis, Panagiotis
  • Communications in Applied Mathematics and Computational Science, Vol. 1, Issue 1
  • DOI: 10.2140/camcos.2006.1.1

Optimal prediction and the Mori-Zwanzig representation of irreversible processes
journal, March 2000

  • Chorin, A. J.; Hald, O. H.; Kupferman, R.
  • Proceedings of the National Academy of Sciences, Vol. 97, Issue 7
  • DOI: 10.1073/pnas.97.7.2968

Optimal Prediction of Burgers’s Equation
journal, January 2007

  • Bernstein, David
  • Multiscale Modeling & Simulation, Vol. 6, Issue 1
  • DOI: 10.1137/060651720

The t -Model as a Large Eddy Simulation Model for the Navier–Stokes Equations
journal, January 2010

  • Chandy, Abhilash J.; Frankel, Steven H.
  • Multiscale Modeling & Simulation, Vol. 8, Issue 2
  • DOI: 10.1137/090760787

Dynamic structures of the time correlation functions of chaotic nonequilibrium fluctuations
journal, December 2007


A Statistically-Derived Subgrid-Scale Kinetic Energy Model for the Large-Eddy Simulation of Turbulent Flows
journal, August 1985

  • Yoshizawa, Akira; Horiuti, Kiyosi
  • Journal of the Physical Society of Japan, Vol. 54, Issue 8
  • DOI: 10.1143/JPSJ.54.2834

A Numerical Procedure to Evaluate Memory Effects in Non‐Equilibrium Coarse‐Grained Models
journal, November 2020

  • Meyer, Hugues; Wolf, Steffen; Stock, Gerhard
  • Advanced Theory and Simulations, Vol. 4, Issue 4
  • DOI: 10.1002/adts.202000197

Lagrangian-History Closure Approximation for Turbulence
journal, January 1965


Dynamical Systems of Continuous Spectra
journal, March 1932

  • Koopman, B. O.; Neumann, J. v.
  • Proceedings of the National Academy of Sciences, Vol. 18, Issue 3
  • DOI: 10.1073/pnas.18.3.255

Nonlinear generalized Langevin equations
journal, November 1973


Reaction analogy based forcing for incompressible scalar turbulence
journal, September 2018


Transport, Collective Motion, and Brownian Motion
journal, March 1965


Turbulence: the filtering approach
journal, May 1992


Optimal prediction and the rate of decay for solutions of the Euler equations in two and three dimensions
journal, April 2007

  • Hald, O. H.; Stinis, P.
  • Proceedings of the National Academy of Sciences, Vol. 104, Issue 16
  • DOI: 10.1073/pnas.0700084104

Forcing for statistically stationary compressible isotropic turbulence
journal, November 2010

  • Petersen, Mark R.; Livescu, Daniel
  • Physics of Fluids, Vol. 22, Issue 11
  • DOI: 10.1063/1.3488793

Derivation of delay equation climate models using the Mori-Zwanzig formalism
journal, July 2019

  • Falkena, Swinda K. J.; Quinn, Courtney; Sieber, Jan
  • Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 475, Issue 2227
  • DOI: 10.1098/rspa.2019.0075

Non-Markovian closure models for large eddy simulations using the Mori-Zwanzig formalism
journal, January 2017


Validity of the essential assumption in a projection operator method
journal, October 2006


Optimal prediction with memory
journal, June 2002


Data-Driven Learning for the Mori--Zwanzig Formalism: A Generalization of the Koopman Learning Framework
journal, January 2021

  • Lin, Yen Ting; Tian, Yifeng; Livescu, Daniel
  • SIAM Journal on Applied Dynamical Systems, Vol. 20, Issue 4
  • DOI: 10.1137/21M1401759

Computing generalized Langevin equations and generalized Fokker-Planck equations
journal, June 2009

  • Darve, E.; Solomon, J.; Kia, A.
  • Proceedings of the National Academy of Sciences, Vol. 106, Issue 27
  • DOI: 10.1073/pnas.0902633106

Lagrangian Markovianized field approximation for turbulence
journal, January 2013


Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism
journal, January 2021