DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: On principles of emergent organization

Journal Article · · Physics Reports
 [1]; ORCiD logo [2]
  1. Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
  2. Univ. of California, Davis, CA (United States)

After more than a century of concerted effort, physics still lacks basic principles of spontaneous organization. To appreciate why, we first state the problem, outline historical approaches, and survey the present state of the physics of self-organization. This frames the particular challenges arising from mathematical intractability and the resulting need for computational approaches, as well as those arising from a chronic failure to define structure. Then an overview of two modern mathematical formulations of organization—intrinsic computation and evolution operators—lays out a way to overcome these challenges. Together, the vantage point they afford shows how to account for the emergence of structured states via a statistical mechanics of systems arbitrarily far from equilibrium. The result is a constructive path forward to principles of organization that builds on mathematical identification of structure.

Research Organization:
Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
Sponsoring Organization:
USDOE; US Army Research Laboratory (USARL); US Army Research Office (ARO)
Grant/Contract Number:
AC05-76RL01830
OSTI ID:
2373125
Report Number(s):
PNNL-SA--198314
Journal Information:
Physics Reports, Journal Name: Physics Reports Vol. 1071; ISSN 0370-1573
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (157)

Qualms Regarding the Range of Validity of the Glansdorff-Prigogine Criterion for Stability of Non-Equilibrium States journal January 1974
Variational tensor approach for approximating the rare-event kinetics of macromolecular systems journal February 2016
The generalized Boltzmann distribution is the only distribution in which the Gibbs-Shannon entropy equals the thermodynamic entropy journal July 2019
Divergent predictive states: The statistical complexity dimension of stationary, ergodic hidden Markov processes journal August 2021
Semi-groups and graphs for sofic systems journal June 1986
Modern Koopman Theory for Dynamical Systems journal May 2022
Between order and chaos journal December 2011
Dynamic mode decomposition of numerical and experimental data journal July 2010
Irreversible processes at nonequilibrium steady states and Lyapounov functions journal December 1979
Comment on “A check of Prigogine’s theorem of minimum entropy production in a rod in a nonequilibrium stationary state” by Irena Danielewicz-Ferchmin and A. Ryszard Ferchmin [Am. J. Phys. 68 (10), 962–965 (2000)] journal July 2001
Information Theory and Statistical Mechanics journal May 1957
More really is different journal May 2009
Local causal states and discrete coherent structures journal July 2018
The mechanics of an organized wave in turbulent shear flow. Part 3. Theoretical models and comparisons with experiments journal July 1972
Lagrangian Coherent Structures journal January 2015
Information Flows? A Critique of Transfer Entropies journal June 2016
Asymptotic Theory of the Boltzmann Equation journal January 1963
Nonequilibrium statistical mechanics and optimal prediction of partially-observed complex systems journal October 2022
On the optimality of the Karhunen-Loève expansion (Corresp.) journal March 1969
Introduction to a General Theory of Elementary Propositions journal July 1921
A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems journal January 2013
The dependence of hurricane intensity on climate journal April 1987
Long-range effects in an elementary cellular automaton journal October 1986
The vortices of two-dimensional turbulence journal October 1990
Boltzmann's Entropy and Time's Arrow journal September 1993
Spectral signature of the pitchfork bifurcation: Liouville equation approach journal January 1995
An almost machine-independent theory of program-length complexity, sophistication, and induction journal August 1991
Recurrent neural network closure of parametric POD-Galerkin reduced-order models based on the Mori-Zwanzig formalism journal June 2020
Some features of the López-Ruiz-Mancini-Calbet (LMC) statistical measure of complexity journal December 1996
Parameter Space Compression Underlies Emergent Theories and Predictive Models journal October 2013
More Is Different journal August 1972
Renormalization Group Theory of Dynamic Critical Phenomena journal June 1974
Differentiable dynamical systems journal January 1967
Turbulent pattern bases for cellular automata journal December 1993
Koopman-mode decomposition of the cylinder wake journal June 2013
Ergodic Theory, Dynamic Mode Decomposition, and Computation of Spectral Properties of the Koopman Operator journal January 2017
The prehistory of the Belousov-Zhabotinsky oscillator journal August 1984
The calculi of emergence: computation, dynamics and induction journal August 1994
LIX. On convection currents in a horizontal layer of fluid, when the higher temperature is on the under side journal December 1916
Dynamical instabilities and the transition to chaotic Taylor vortex flow journal September 1979
What drives nematic order in iron-based superconductors? journal January 2014
Electronic liquid-crystal phases of a doped Mott insulator journal June 1998
An early warning indicator for atmospheric blocking events using transfer operators
  • Tantet, Alexis; van der Burgt, Fiona R.; Dijkstra, Henk A.
  • Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 25, Issue 3 https://doi.org/10.1063/1.4908174
journal March 2015
Modeling by shortest data description journal September 1978
Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism journal January 2021
Nonlinear generalized Langevin equations journal November 1973
Unpredictability and undecidability in dynamical systems journal May 1990
The renormalization group and the ε expansion journal August 1974
Reciprocal Relations in Irreversible Processes. I. journal February 1931
Canonical Forms for Information-Lossless Finite-State Logical Machines journal January 1959
Hilbert’s sixth problem and the failure of the Boltzmann to Euler limit journal March 2018
Long-Range Order in a Two-Dimensional Dynamical XY Model: How Birds Fly Together journal December 1995
On convection cells induced by surface tension journal September 1958
The attractor?basin portrait of a cellular automaton journal March 1992
Optimal prediction with memory journal June 2002
On the nature and origin of complexity in discrete, homogeneous, locally-interacting systems journal June 1986
Prevalence of multistability and nonstationarity in driven chemical networks journal June 2023
Coherent sets for nonautonomous dynamical systems journal August 2010
A Gallavotti–Cohen-Type Symmetry in the Large Deviation Functional for Stochastic Dynamics journal January 1999
Synchronization in complex networks journal December 2008
Spectral Properties of Dynamical Systems, Model Reduction and Decompositions journal August 2005
Evolution of vortex statistics in two-dimensional turbulence journal May 1991
Majority-Vote Cellular Automata, Ising Dynamics, and P-Completeness journal August 1997
A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition journal June 2015
Computational Mechanics: Pattern and Prediction, Structure and Simplicity journal August 2001
Pattern universes journal April 2019
Surface Tension as the Cause of Bénard Cells and Surface Deformation in a Liquid Film journal September 1956
Analysis of Fluid Flows via Spectral Properties of the Koopman Operator journal January 2013
Pattern Formation and Wave-Number Selection by Rayleigh–Bénard Convection in a Cylindrical Container journal January 1985
Measures of statistical complexity: Why? journal February 1998
Detecting Causality in Complex Ecosystems journal September 2012
On the principle of minimal entropy production for Navier-Stokes-Fourier fluids journal October 1999
The Maximum Caliber Variational Principle for Nonequilibria journal April 2020
Irreversible processes at nonequilibrium steady states journal May 1979
New mechanism for deterministic diffusion journal December 1983
The Minimum Entropy Production Principle journal October 1980
Modal Analysis of Fluid Flows: An Overview journal December 2017
Adaptive, locally linear models of complex dynamics journal January 2019
Algebraic Theory of Patterns as Generalized Symmetries journal August 2022
On the nature of turbulence journal September 1971
Compression of individual sequences via variable-rate coding journal September 1978
Time’s Barbed Arrow: Irreversibility, Crypticity, and Stored Information journal August 2009
Exact Solutions for the Entropy Production Rate of Several Irreversible Processes journal October 2005
Hamiltonian Systems and Transformation in Hilbert Space journal May 1931
Gibbs vs Boltzmann Entropies journal May 1965
On the Complexity of Finite Sequences journal January 1976
The Typical Set and Entropy in Stochastic Systems with Arbitrary Phase Space Growth journal February 2023
Local and Global Instabilities in Spatially Developing Flows journal January 1990
Rice's theorem for the limit sets of cellular automata journal May 1994
Towards Direct Simulation of Future Tropical Cyclone Statistics in a High-Resolution Global Atmospheric Model journal January 2010
Kernel-based prediction of non-Markovian time series journal April 2021
Rudolf Clausius and the road to entropy journal December 1986
4. On a Mechanical Theory of Thermo-Electric Currents. journal January 1857
Spurious causalities with transfer entropy journal April 2013
Almost-invariant sets and invariant manifolds — Connecting probabilistic and geometric descriptions of coherent structures in flows journal August 2009
Computational mechanics of cellular automata: An example journal April 1997
Sub-Planck structure in phase space and its relevance for quantum decoherence journal August 2001
Low-Dimensional Chaos in a Hydrodynamic System journal October 1983
The Theory of Hurricanes journal January 1991
Transport in time-dependent dynamical systems: Finite-time coherent sets
  • Froyland, Gary; Santitissadeekorn, Naratip; Monahan, Adam
  • Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 20, Issue 4 https://doi.org/10.1063/1.3502450
journal December 2010
Thermodynamics of information journal February 2015
Entgegnung auf die wärmetheoretischen Betrachtungen des Hrn. E. Zermelo journal January 1896
Pattern formation outside of equilibrium journal July 1993
Anatomy of a bit: Information in a time series observation
  • James, Ryan G.; Ellison, Christopher J.; Crutchfield, James P.
  • Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 21, Issue 3 https://doi.org/10.1063/1.3637494
journal September 2011
Information Thermodynamics of Turing Patterns journal September 2018
The Effects of Shape on the Interaction of Colloidal Particles journal May 1949
Exact complexity: The spectral decomposition of intrinsic computation journal March 2016
Koopman Invariant Subspaces and Finite Linear Representations of Nonlinear Dynamical Systems for Control journal February 2016
Detecting and Locating Near-Optimal Almost-Invariant Sets and Cycles journal January 2003
A history of chemical oscillations and waves journal December 1991
Scaling behavior of crowd flow outside a hall journal March 2001
Model reduction for compressible flows using POD and Galerkin projection journal February 2004
On the Length of Programs for Computing Finite Binary Sequences journal October 1966
Maximally predictive states: From partial observations to long timescales journal February 2023
Structure and Randomness of Continuous-Time, Discrete-Event Processes journal August 2017
Model-Free Prediction of Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing Approach journal January 2018
Empirical orthogonal functions and related techniques in atmospheric science: A review journal January 2007
Detecting and quantifying causal associations in large nonlinear time series datasets journal November 2019
Cosmic structure as the quantum interference of a coherent dark wave journal June 2014
Stochastic thermodynamics, fluctuation theorems and molecular machines journal November 2012
Universality in Elementary Cellular Automata journal March 2004
The climate system and the second law of thermodynamics journal January 2022
Spontaneous fine-tuning to environment in many-species chemical reaction networks journal July 2017
Non-linear properties of thermal convection journal December 1978
Time-Reversed Dynamical Entropy and Irreversibility in Markovian Random Processes journal November 2004
Kernel methods for detecting coherent structures in dynamical data journal December 2019
The “excess entropy” around nonequilibrium steady states, (δ 2 S ) ss , is not a Liapunov function journal July 1980
A note on the Entscheidungsproblem journal March 1936
Multivariate Dependence beyond Shannon Information journal October 2017
Are Biological Systems Poised at Criticality? journal June 2011
Geometry and Morphology of the Cosmic Web: Analyzing Spatial Patterns in the Universe conference June 2009
On Data-Driven Computation of Information Transfer for Causal Inference in Discrete-Time Dynamical Systems journal March 2020
Inadequacy of entropy and entropy derivatives in characterizing the steady state journal August 1975
Stripe order in the underdoped region of the two-dimensional Hubbard model journal November 2017
Subshifts of finite type and sofic systems journal October 1973
On Computable Numbers, with an Application to the Entscheidungsproblem journal January 1937
Principles of maximum entropy and maximum caliber in statistical physics journal July 2013
Reciprocal Relations in Irreversible Processes. II. journal December 1931
Quasilinear cellular automata journal April 1997
General properties of entropy journal April 1978
Novel Type of Phase Transition in a System of Self-Driven Particles journal August 1995
Tropical Cyclone-like Vortices in a Limited Area Model: Comparison with Observed Climatology journal September 1997
Interacting components of the top‐of‐atmosphere energy balance affect changes in regional surface temperature journal October 2014
Thermodynamic depth of causal states: Objective complexity via minimal representations journal January 1999
Discovering causal structure with reproducing-kernel Hilbert space ε-machines journal February 2022
A Mathematical Theory of Communication journal October 1948
On dynamic mode decomposition: Theory and applications journal December 2014
Onset of Surface-Tension-Driven Bénard Convection journal September 1995
Nonlinear problems in physics journal May 1967
The Thermodynamic Stability Theory of Non-Equilibrium States journal January 1974
Time-series learning of latent-space dynamics for reduced-order model closure journal April 2020
Spectral analysis of climate dynamics with operator-theoretic approaches journal November 2021
Possible nematic to smectic phase transition in a two-dimensional electron gas at half-filling journal November 2017
A critical comparison of Lagrangian methods for coherent structure detection
  • Hadjighasem, Alireza; Farazmand, Mohammad; Blazevski, Daniel
  • Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 27, Issue 5 https://doi.org/10.1063/1.4982720
journal May 2017
Bayesian structural inference for hidden processes journal April 2014
Symbolic Dynamics journal October 1938
Fluctuations, stability, and generalized state functions at nonequilibrium steady states journal December 1976