Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Data-Driven Learning for the Mori--Zwanzig Formalism: A Generalization of the Koopman Learning Framework

Journal Article · · SIAM Journal on Applied Dynamical Systems
DOI:https://doi.org/10.1137/21m1401759· OSTI ID:1872339

A theoretical framework which unifies the conventional Mori--Zwanzig formalism and the approximate Koopman learning of deterministic dynamical systems from noiseless observation is presented. In this framework, the Mori--Zwanzig formalism, developed in statistical mechanics to tackle the hard problem of construction of reduced-order dynamics for high-dimensional dynamical systems, can be considered as a natural generalization of the Koopman description of the dynamical system. We next show that, similar to the approximate Koopman learning methods, data-driven methods can be developed for the Mori--Zwanzig formalism with Mori's linear projection operator. We have developed two algorithms to extract the key operators, the Markov and the memory kernel, using time series of a reduced set of observables in a dynamical system. We have adopted the Lorenz `96 system as a test problem and solved for the above operators. These operators exhibit complex behaviors, which are unlikely to be captured by traditional modeling approaches in Mori--Zwanzig analysis. The nontrivial generalized fluctuation-dissipation relationship, which relates the memory kernel with the two-time correlation statistics of the orthogonal dynamics, was numerically verified as a validation of the solved operators. Here we present numerical evidence that the generalized Langevin equation, a key construct in the Mori--Zwanzig formalism, is more advantageous in predicting the evolution of the reduced set of observables than the conventional approximate Koopman operators.

Research Organization:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE Laboratory Directed Research and Development (LDRD) Program. Los Alamos National Laboratory (LANL)
Grant/Contract Number:
89233218CNA000001
OSTI ID:
1872339
Report Number(s):
LA-UR-21-20187
Journal Information:
SIAM Journal on Applied Dynamical Systems, Journal Name: SIAM Journal on Applied Dynamical Systems Journal Issue: 4 Vol. 20; ISSN 1536-0040
Publisher:
Society for Industrial and Applied Mathematics (SIAM)Copyright Statement
Country of Publication:
United States
Language:
English

References (40)

Spectral Properties of Dynamical Systems, Model Reduction and Decompositions journal August 2005
Dynamical Systems of Continuous Spectra journal March 1932
Higher Order Dynamic Mode Decomposition journal January 2017
Nonlinear generalized Langevin equations journal November 1973
Application de la théorie des équations intégrales linéaires aux systèmes d'équations différentielles non linéaires journal January 1932
Applications of the dynamic mode decomposition journal August 2010
A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition journal June 2015
Data-Driven Model Reduction and Transfer Operator Approximation journal January 2018
Variational Approach for Learning Markov Processes from Time Series Data journal August 2019
The liapunov dimension of strange attractors journal August 1983
Optimal prediction with memory journal June 2002
Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism journal January 2021
Spectral analysis of nonlinear flows journal November 2009
Dynamic mode decomposition of numerical and experimental data journal July 2010
Variational Approach to Molecular Kinetics journal March 2014
Chaos as an intermittently forced linear system journal May 2017
Implicit-solvent coarse-grained modeling for polymer solutions via Mori-Zwanzig formalism journal January 2019
A general moment expansion method for stochastic kinetic models journal May 2013
Identification of slow molecular order parameters for Markov model construction journal July 2013
Computation of the memory functions in the generalized Langevin models for collective dynamics of macromolecules journal August 2014
Comparison of different moment-closure approximations for stochastic chemical kinetics journal November 2015
Incorporation of memory effects in coarse-grained modeling via the Mori-Zwanzig formalism journal December 2015
Computing the non-Markovian coarse-grained interactions derived from the Mori–Zwanzig formalism in molecular systems: Application to polymer melts journal January 2017
Variational Koopman models: Slow collective variables and molecular kinetics from short off-equilibrium simulations journal April 2017
Data-driven learning of Mori–Zwanzig operators for isotropic turbulence journal December 2021
Data-driven parameterization of the generalized Langevin equation journal November 2016
Hamiltonian Systems and Transformation in Hilbert Space journal May 1931
Optimal prediction and the Mori-Zwanzig representation of irreversible processes journal March 2000
Data-based parameter estimation of generalized multidimensional Langevin processes journal July 2007
Non-Markovian closure models for large eddy simulations using the Mori-Zwanzig formalism journal January 2017
Separation of a mixture of independent signals using time delayed correlations journal June 1994
Global Stability Analysis Using the Eigenfunctions of the Koopman Operator journal November 2016
Stochastic Optimal Prediction for the Kuramoto--Sivashinsky Equation journal January 2004
A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems journal January 2013
Higher Order Dynamic Mode Decomposition journal January 2017
Ergodic Theory, Dynamic Mode Decomposition, and Computation of Spectral Properties of the Koopman Operator journal January 2017
Time-Delay Observables for Koopman: Theory and Applications journal January 2020
Coarse-Graining of Overdamped Langevin Dynamics via the Mori--Zwanzig Formalism journal January 2020
Transport, Collective Motion, and Brownian Motion journal March 1965
Zur Operatorenmethode In Der Klassischen Mechanik journal July 1932