Search Menu
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information
Search Scholarly Publications

Title: Direct evaluation of dynamical large-deviation rate functions using a variational ansatz

Abstract

We describe a simple form of importance sampling designed to bound and compute large-deviation rate functions for time-extensive dynamical observables in continuous-time Markov chains. We start with a model, defined by a set of rates, and a time-extensive dynamical observable. We construct a reference model, a variational ansatz for the behavior of the original model conditioned on atypical values of the observable. Direct simulation of the reference model provides an upper bound on the large-deviation rate function associated with the original model, an estimate of the tightness of the bound, and, if the ansatz is chosen well, the exact rate function. The exact rare behavior of the original model does not need to be known in advance. We use this method to calculate rate functions for currents and counting observables in a set of network- and lattice models taken from the literature. Straightforward ansätze yield bounds that are tighter than bounds obtained from Level 2.5 of large deviations via approximations that involve uniform scalings of rates. Here, we show how to correct these bounds in order to recover the rate functions exactly. Our approach is complementary to more specialized methods and offers a physically transparent framework for approximating and calculatingmore » the likelihood of dynamical large deviations.« less

Authors:
 [1];  [2]
+ Show Author Affiliations
  1. California Inst. of Technology (CalTech), Pasadena, CA (United States)
  2. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Publication Date:
Research Org.:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
OSTI Identifier:
1601210
Grant/Contract Number:  
AC02-05CH11231
Resource Type:
Accepted Manuscript
Journal Name:
Physical Review. E
Additional Journal Information:
Journal Volume: 100; Journal Issue: 5; Journal ID: ISSN 2470-0045
Publisher:
American Physical Society (APS)
Country of Publication:
United States
Language:
English
Subject:
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY

Citation Formats

Jacobson, Daniel, and Whitelam, Stephen. Direct evaluation of dynamical large-deviation rate functions using a variational ansatz. United States: N. p., 2019. Web. doi:10.1103/physreve.100.052139.
Copy to clipboard
Jacobson, Daniel, & Whitelam, Stephen. Direct evaluation of dynamical large-deviation rate functions using a variational ansatz. United States. https://doi.org/10.1103/physreve.100.052139
Copy to clipboard
Jacobson, Daniel, and Whitelam, Stephen. Mon . "Direct evaluation of dynamical large-deviation rate functions using a variational ansatz". United States. https://doi.org/10.1103/physreve.100.052139. https://www.osti.gov/servlets/purl/1601210.
Copy to clipboard
@article{osti_1601210,
title = {Direct evaluation of dynamical large-deviation rate functions using a variational ansatz},
author = {Jacobson, Daniel and Whitelam, Stephen},
abstractNote = {We describe a simple form of importance sampling designed to bound and compute large-deviation rate functions for time-extensive dynamical observables in continuous-time Markov chains. We start with a model, defined by a set of rates, and a time-extensive dynamical observable. We construct a reference model, a variational ansatz for the behavior of the original model conditioned on atypical values of the observable. Direct simulation of the reference model provides an upper bound on the large-deviation rate function associated with the original model, an estimate of the tightness of the bound, and, if the ansatz is chosen well, the exact rate function. The exact rare behavior of the original model does not need to be known in advance. We use this method to calculate rate functions for currents and counting observables in a set of network- and lattice models taken from the literature. Straightforward ansätze yield bounds that are tighter than bounds obtained from Level 2.5 of large deviations via approximations that involve uniform scalings of rates. Here, we show how to correct these bounds in order to recover the rate functions exactly. Our approach is complementary to more specialized methods and offers a physically transparent framework for approximating and calculating the likelihood of dynamical large deviations.},
doi = {10.1103/physreve.100.052139},
journal = {Physical Review. E},
number = 5,
volume = 100,
place = {United States},
year = {Mon Nov 25 00:00:00 EST 2019},
month = {Mon Nov 25 00:00:00 EST 2019}
}
Copy to clipboard
Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1103/physreve.100.052139
Copyright Statement
Other availability
Search WorldCat Search WorldCat to find libraries that may hold this journal
Citation Metrics:
Cited by: 18 works
Citation information provided by
Web of Science
Save / Share:
Export Metadata
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.

Works referenced in this record:

Fluctuations of Power Injection in Randomly Driven Granular Gases
journal, November 2006

  • Visco, Paolo; Puglisi, Andrea; Barrat, Alain
  • Journal of Statistical Physics, Vol. 125, Issue 3
  • DOI: 10.1007/s10955-006-9161-4

Stochastic thermodynamics, fluctuation theorems and molecular machines
journal, November 2012

Effective interactions and large deviations in stochastic processes
journal, June 2015

Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling
journal, February 1977

Finite-Size Scaling of a First-Order Dynamical Phase Transition: Adaptive Population Dynamics and an Effective Model
journal, March 2017

Counterexamples in importance sampling for large deviations probabilities
journal, August 1997

Large deviations of the dynamical activity in the East model: analysing structure in biased trajectories
journal, December 2013

Importance sampling large deviations in nonequilibrium steady states. I
journal, March 2018

  • Ray, Ushnish; Chan, Garnet Kin-Lic; Limmer, David T.
  • The Journal of Chemical Physics, Vol. 148, Issue 12
  • DOI: 10.1063/1.5003151

Large Deviations for Exchangeable Random Vectors
journal, July 1992

Entropy Production along a Stochastic Trajectory and an Integral Fluctuation Theorem
journal, July 2005

Computer simulation study of gas–liquid nucleation in a Lennard-Jones system
journal, December 1998

  • ten Wolde, Pieter Rein; Frenkel, Daan
  • The Journal of Chemical Physics, Vol. 109, Issue 22
  • DOI: 10.1063/1.477658

Importance Sampling for Stochastic Simulations
journal, November 1989

Sampling rare fluctuations of discrete-time Markov chains
journal, March 2018

Rare behavior of growth processes via umbrella sampling of trajectories
journal, March 2018

Anomalous Scaling of Dynamical Large Deviations
journal, August 2018

Geometrical Explanation and Scaling of Dynamical Heterogeneities in Glass Forming Systems
journal, July 2002

Exact stochastic simulation of coupled chemical reactions
journal, December 1977

  • Gillespie, Daniel T.
  • The Journal of Physical Chemistry, Vol. 81, Issue 25
  • DOI: 10.1021/j100540a008

Nonequilibrium Equality for Free Energy Differences
journal, April 1997

Current Fluctuations in Systems with Diffusive Dynamics, in and out of Equilibrium
journal, January 2010

  • Lecomte, Vivien; Imparato, Alberto; van Wijland, Frédéric
  • Progress of Theoretical Physics Supplement, Vol. 184
  • DOI: 10.1143/PTPS.184.276

Adaptive Sampling of Large Deviations
journal, July 2018

Universal bounds on current fluctuations
journal, May 2016

Large deviations in the presence of cooperativity and slow dynamics
journal, June 2018

New Monte Carlo method to compute the free energy of arbitrary solids. Application to the fcc and hcp phases of hard spheres
journal, October 1984

  • Frenkel, Daan; Ladd, Anthony J. C.
  • The Journal of Chemical Physics, Vol. 81, Issue 7
  • DOI: 10.1063/1.448024

Canonical structure of dynamical fluctuations in mesoscopic nonequilibrium steady states
journal, April 2008

Direct Evaluation of Large-Deviation Functions
journal, March 2006

Large deviations of the empirical flow for continuous time Markov chains
journal, August 2015

  • Bertini, Lorenzo; Faggionato, Alessandra; Gabrielli, Davide
  • Annales de l'Institut Henri Poincaré, Probabilités et Statistiques, Vol. 51, Issue 3
  • DOI: 10.1214/14-AIHP601

Large Deviations in Fast–Slow Systems
journal, January 2016

  • Bouchet, Freddy; Grafke, Tobias; Tangarife, Tomás
  • Journal of Statistical Physics, Vol. 162, Issue 4
  • DOI: 10.1007/s10955-016-1449-4

Nonequilibrium Microcanonical and Canonical Ensembles and Their Equivalence
journal, September 2013

The Large Deviations of Estimating Rate Functions
journal, March 2005

  • Duffy, Ken; Metcalfe, Anthony P.
  • Journal of Applied Probability, Vol. 42, Issue 1
  • DOI: 10.1239/jap/1110381386

Allocating dissipation across a molecular machine cycle to maximize flux
journal, October 2017

  • Brown, Aidan I.; Sivak, David A.
  • Proceedings of the National Academy of Sciences, Vol. 114, Issue 42
  • DOI: 10.1073/pnas.1707534114

Fluctuating observation time ensembles in the thermodynamics of trajectories
journal, March 2014

  • Budini, Adrián A.; Turner, Robert M.; Garrahan, Juan P.
  • Journal of Statistical Mechanics: Theory and Experiment, Vol. 2014, Issue 3
  • DOI: 10.1088/1742-5468/2014/03/P03012

Fluctuation theorems for stochastic dynamics
journal, July 2007

On large deviations theory and asymptotically efficient Monte Carlo estimation
journal, May 1990

  • Sadowsky, J. S.; Bucklew, J. A.
  • IEEE Transactions on Information Theory, Vol. 36, Issue 3
  • DOI: 10.1109/18.54903

Monte Carlo simulation and large deviations theory for uniformly recurrent Markov chains
journal, March 1990

  • Bucklew, James A.; Ney, Peter; Sadowsky, John S.
  • Journal of Applied Probability, Vol. 27, Issue 1
  • DOI: 10.2307/3214594

Phase diagram of one-dimensional driven lattice gases with open boundaries
journal, August 1998

  • Kolomeisky, Anatoly B.; Schütz, Gunter M.; Kolomeisky, Eugene B.
  • Journal of Physics A: Mathematical and General, Vol. 31, Issue 33
  • DOI: 10.1088/0305-4470/31/33/003

Large deviations of the current for driven periodic diffusions
journal, September 2016

Dynamical Ensembles in Nonequilibrium Statistical Mechanics
journal, April 1995

Trajectory reweighting for non-equilibrium steady states
journal, May 2018

Exact solution of a partially asymmetric exclusion model using a deformed oscillator algebra
journal, March 2000

  • Blythe, R. A.; Evans, M. R.; Colaiori, F.
  • Journal of Physics A: Mathematical and General, Vol. 33, Issue 12
  • DOI: 10.1088/0305-4470/33/12/301

Large Deviations and Importance Sampling for Systems of Slow-Fast Motion
journal, October 2012

Non-equilibrium statistical mechanics: from a paradigmatic model to biological transport
journal, October 2011

Dynamical First-Order Phase Transition in Kinetically Constrained Models of Glasses
journal, May 2007

Fluctuation theorem for stochastic dynamics
journal, April 1998

An exactly soluble non-equilibrium system: The asymmetric simple exclusion process
journal, July 1998

On large deviations theory and asymptotically efficient Monte Carlo estimation
conference, January 1990

  • Sadowsky, J. S.; Bucklew, J. A.
  • Proceedings of the 32nd Midwest Symposium on Circuits and Systems
  • DOI: 10.1109/mwscas.1989.102059

Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences
journal, September 1999

Nonequilibrium Glassy Dynamics of Self-Propelled Hard Disks
journal, June 2014

Application of importance sampling to the computation of large deviations in nonequilibrium processes
journal, March 2011

Multi-point nonequilibrium umbrella sampling and associated fluctuation relations
journal, June 2018

  • Whitelam, Stephen
  • Journal of Statistical Mechanics: Theory and Experiment, Vol. 2018, Issue 6
  • DOI: 10.1088/1742-5468/aac915

The large deviation function for entropy production: the optimal trajectory and the role of fluctuations
journal, December 2012

  • Speck, Thomas; Engel, Andreas; Seifert, Udo
  • Journal of Statistical Mechanics: Theory and Experiment, Vol. 2012, Issue 12
  • DOI: 10.1088/1742-5468/2012/12/P12001

Biochemical Machines for the Interconversion of Mutual Information and Work
journal, January 2017

Dissipation Bounds All Steady-State Current Fluctuations
journal, March 2016

Stochastic Simulation of Chemical Kinetics
journal, May 2007

Activity-driven fluctuations in living cells
journal, May 2015

Kinetic Ising Model of the Glass Transition
journal, September 1984

Dynamic phase transitions in simple driven kinetic networks
journal, June 2014

  • Vaikuntanathan, Suriyanarayanan; Gingrich, Todd R.; Geissler, Phillip L.
  • Physical Review E, Vol. 89, Issue 6
  • DOI: 10.1103/PhysRevE.89.062108

The Large Deviations of Estimating Rate Functions
journal, March 2005

Fundamental Bounds on First Passage Time Fluctuations for Currents
journal, October 2017

The large deviation approach to statistical mechanics
journal, July 2009

Exact Fluctuations of Nonequilibrium Steady States from Approximate Auxiliary Dynamics
journal, May 2018

First-order dynamical phase transition in models of glasses: an approach based on ensembles of histories
journal, January 2009

  • Garrahan, Juan P.; Jack, Robert L.; Lecomte, Vivien
  • Journal of Physics A: Mathematical and Theoretical, Vol. 42, Issue 7
  • DOI: 10.1088/1751-8113/42/7/075007

Fluctuations in interacting particle systems with memory
journal, July 2015

A numerical approach to large deviations in continuous time
journal, March 2007

Variational and optimal control representations of conditioned and driven processes
journal, December 2015

Convergence of large-deviation estimators
journal, November 2015

Monte Carlo simulation and large deviations theory for uniformly recurrent Markov chains
journal, March 1990

  • Bucklew, James A.; Ney, Peter; Sadowsky, John S.
  • Journal of Applied Probability, Vol. 27, Issue 01
  • DOI: 10.1017/s0021900200038419

Monte Carlo Methods in Statistical Physics
journal, June 2001

  • Strawderman, Robert L.
  • Journal of the American Statistical Association, Vol. 96, Issue 454
  • DOI: 10.1198/jasa.2001.s394

Current fluctuations in systems with diffusive dynamics, in and out of equilibrium
text, January 2009

Large deviations of the empirical flow for continuous time Markov chains
preprint, January 2012

Nonequilibrium microcanonical and canonical ensembles and their equivalence
text, January 2013

Dynamic phase transitions in simple driven kinetic networks
text, January 2013

Convergence of large deviation estimators
text, January 2014

Effective interactions and large deviations in stochastic processes
text, January 2015

Activity driven fluctuations in living cells
text, January 2015

Fluctuations in interacting particle systems with memory
text, January 2015

Dissipation bounds all steady-state current fluctuations
text, January 2015

Biochemical machines for the interconversion of mutual information and work
text, January 2016

Allocating dissipation across a molecular machine cycle to maximize flux
text, January 2017

Fundamental Bounds on First Passage Time Fluctuations for Currents
text, January 2017

Rare behavior of growth processes via umbrella sampling of trajectories
text, January 2017

Importance sampling large deviations in nonequilibrium steady states. I
text, January 2017

Dynamical Ensembles in Nonequilibrium Statistical Mechanics
text, January 1994

Direct evaluation of large-deviation functions
text, January 2005

A numerical approach to large deviations in continuous-time
text, January 2006

Fluctuation theorems for stochastic dynamics
text, January 2007

Heat and work fluctuations for a harmonic oscillator
text, January 2012

    Sort by:
    [ × clear filter / sort ]

    Works referencing / citing this record:

    Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations
    journal, December 2019

    • Das, Avishek; Limmer, David T.
    • The Journal of Chemical Physics, Vol. 151, Issue 24
    • DOI: 10.1063/1.5128956

    Efficient Large Deviation Estimation Based on Importance Sampling
    journal, July 2020

    A deep learning functional estimator of optimal dynamics for sampling large deviations
    journal, July 2020

    • Oakes, Tom H. E.; Moss, Adam; Garrahan, Juan P.
    • Machine Learning: Science and Technology, Vol. 1, Issue 3
    • DOI: 10.1088/2632-2153/ab95a1
      Sort by:
      [ × clear filter / sort ]

      Similar Records in DOE PAGES and OSTI.GOV collections: