Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations
Abstract
We introduce a variational algorithm to estimate the likelihood of a rare event within a nonequilibrium molecular dynamics simulation through the evaluation of an optimal control force. Optimization of a control force within a chosen basis is made possible by explicit forms for the gradients of a cost function in terms of the susceptibility of driven trajectories to changes in variational parameters. We consider probabilities of time-integrated dynamical observables as characterized by their large deviation functions and find that in many cases, the variational estimate is quantitatively accurate. Additionally, we provide expressions to exactly correct the variational estimate that can be evaluated directly. We benchmark this algorithm against the numerically exact solution of a model of a driven particle in a periodic potential, where the control force can be represented with a complete basis. Additionally, we then demonstrate the utility of the algorithm in a model of repulsive particles on a line, which undergo a dynamical phase transition, resulting in singular changes to the form of the optimal control force. In both systems, we find fast convergence and are able to evaluate large deviation functions with significant increases in statistical efficiency over alternative Monte Carlo approaches.
- Authors:
-
- Univ. of California, Berkeley, CA (United States)
- Univ. of California, Berkeley, CA (United States); Kavli Energy NanoScience Institute, Berkeley, CA (United States); Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Publication Date:
- Research Org.:
- Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Basic Energy Sciences (BES), Chemical Sciences, Geosciences & Biosciences Division; USDOE
- OSTI Identifier:
- 1721632
- Alternate Identifier(s):
- OSTI ID: 1580664
- Grant/Contract Number:
- AC02-05CH11231; SC0019375
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Chemical Physics
- Additional Journal Information:
- Journal Volume: 151; Journal Issue: 24; Journal ID: ISSN 0021-9606
- Publisher:
- American Institute of Physics (AIP)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY; Probability theory; Monte Carlo methods; path integral formulation; molecular dynamics; many body systems; optimization algorithms; control theory; nonequilibrium statistical mechanics
Citation Formats
Das, Avishek, and Limmer, David T. Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations. United States: N. p., 2019.
Web. doi:10.1063/1.5128956.
Das, Avishek, & Limmer, David T. Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations. United States. https://doi.org/10.1063/1.5128956
Das, Avishek, and Limmer, David T. Sat .
"Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations". United States. https://doi.org/10.1063/1.5128956. https://www.osti.gov/servlets/purl/1721632.
@article{osti_1721632,
title = {Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations},
author = {Das, Avishek and Limmer, David T.},
abstractNote = {We introduce a variational algorithm to estimate the likelihood of a rare event within a nonequilibrium molecular dynamics simulation through the evaluation of an optimal control force. Optimization of a control force within a chosen basis is made possible by explicit forms for the gradients of a cost function in terms of the susceptibility of driven trajectories to changes in variational parameters. We consider probabilities of time-integrated dynamical observables as characterized by their large deviation functions and find that in many cases, the variational estimate is quantitatively accurate. Additionally, we provide expressions to exactly correct the variational estimate that can be evaluated directly. We benchmark this algorithm against the numerically exact solution of a model of a driven particle in a periodic potential, where the control force can be represented with a complete basis. Additionally, we then demonstrate the utility of the algorithm in a model of repulsive particles on a line, which undergo a dynamical phase transition, resulting in singular changes to the form of the optimal control force. In both systems, we find fast convergence and are able to evaluate large deviation functions with significant increases in statistical efficiency over alternative Monte Carlo approaches.},
doi = {10.1063/1.5128956},
journal = {Journal of Chemical Physics},
number = 24,
volume = 151,
place = {United States},
year = {Sat Dec 28 00:00:00 EST 2019},
month = {Sat Dec 28 00:00:00 EST 2019}
}
Web of Science
Works referenced in this record:
An Automatic Adaptive Importance Sampling Algorithm for Molecular Dynamics in Reaction Coordinates
journal, January 2018
- Quer, J.; Donati, L.; Keller, B. G.
- SIAM Journal on Scientific Computing, Vol. 40, Issue 2
Robust nonequilibrium pathways to microcompartment assembly
journal, June 2018
- Rotskoff, Grant M.; Geissler, Phillip L.
- Proceedings of the National Academy of Sciences, Vol. 115, Issue 25
Population dynamics method with a multi-canonical feedback control
text, January 2016
- Nemoto, Takahiro; Bouchet, Freddy; Jack, Robert L.
- arXiv
Multivariate fluctuation relations for currents
journal, November 2013
- Gaspard, Pierre
- New Journal of Physics, Vol. 15, Issue 11
Forward Flux Sampling for rare event simulations
text, January 2009
- Allen, Rosalind J.; Valeriani, Chantal; Wolde, Pieter Rein ten
- arXiv
A list-based algorithm for evaluation of large deviation functions
journal, February 2010
- Tchernookov, Martin; Dinner, Aaron R.
- Journal of Statistical Mechanics: Theory and Experiment, Vol. 2010, Issue 02
Dynamical phase behavior of the single- and multi-lane asymmetric simple exclusion process via matrix product states
journal, August 2019
- Helms, Phillip; Ray, Ushnish; Chan, Garnet Kin-Lic
- Physical Review E, Vol. 100, Issue 2
Inverse optimization techniques for targeted self-assembly
journal, January 2009
- Torquato, Salvatore
- Soft Matter, Vol. 5, Issue 6
T RANSITION P ATH S AMPLING : Throwing Ropes Over Rough Mountain Passes, in the Dark
journal, October 2002
- Bolhuis, Peter G.; Chandler, David; Dellago, Christoph
- Annual Review of Physical Chemistry, Vol. 53, Issue 1
Dynamical phase transitions in supercooled liquids: interpreting measurements of dynamical activity
text, January 2013
- Fullerton, Christopher J.; Jack, Robert L.
- arXiv
Rayleigh-Ritz Calculation of Effective Potential Far from Equilibrium
journal, January 1997
- Alexander, Francis J.; Eyink, Gregory L.
- Physical Review Letters, Vol. 78, Issue 1
Nonlinear transport coefficients from large deviation functions
journal, July 2019
- Gao, Chloe Ya; Limmer, David T.
- The Journal of Chemical Physics, Vol. 151, Issue 1
Exact Fluctuations of Nonequilibrium Steady States from Approximate Auxiliary Dynamics
journal, May 2018
- Ray, Ushnish; Chan, Garnet Kin-Lic; Limmer, David T.
- Physical Review Letters, Vol. 120, Issue 21
Large Deviation Function for a Driven Underdamped Particle in a Periodic Potential
text, January 2017
- Fischer, Lukas P.; Pietzonka, Patrick; Seifert, Udo
- arXiv
Nonlinear transport coefficients from large deviation functions
text, January 2018
- Gao, Chloe Ya; Limmer, David T.
- arXiv
Current fluctuations of interacting active Brownian particles
text, January 2018
- GrandPre, Trevor; Limmer, David T.
- arXiv
Studying rare nonadiabatic dynamics with transition path sampling quantum jump trajectories
text, January 2018
- Schile, Addison J.; Limmer, David T.
- arXiv
Using Matrix Product States to Study the Dynamical Large Deviations of Kinetically Constrained Models
journal, November 2019
- Bañuls, Mari Carmen; Garrahan, Juan P.
- Physical Review Letters, Vol. 123, Issue 20
Topological mechanics of gyroscopic metamaterials
journal, November 2015
- Nash, Lisa M.; Kleckner, Dustin; Read, Alismari
- Proceedings of the National Academy of Sciences, Vol. 112, Issue 47
Computation of Large Deviation Statistics via Iterative Measurement-and-Feedback Procedure
text, January 2013
- Nemoto, Takahiro; Sasa, Shin-ichi
- arXiv
Understanding Gelation as a Nonequilibrium Self-Assembly Process
journal, April 2018
- Arango-Restrepo, Andrés; Rubi, J. Miguel; Barragán, Daniel
- The Journal of Physical Chemistry B, Vol. 122, Issue 18
Model reduction algorithms for optimal control and importance sampling of diffusions
journal, June 2016
- Hartmann, Carsten; Schütte, Christof; Zhang, Wei
- Nonlinearity, Vol. 29, Issue 8
Dynamical phase behavior of the single- and multi-lane asymmetric simple exclusion process via matrix product states
text, January 2019
- Helms, Phillip; Ray, Ushnish; Chan, Garnet Kin-Lic
- arXiv
Asymptotics for the wiener sausage
journal, July 1975
- Donsker, M. D.; Varadhan, S. R. S.
- Communications on Pure and Applied Mathematics, Vol. 28, Issue 4
Dynamical phase transitions in supercooled liquids: Interpreting measurements of dynamical activity
journal, June 2013
- Fullerton, Christopher J.; Jack, Robert L.
- The Journal of Chemical Physics, Vol. 138, Issue 22
Finite-time and finite-size scalings in the evaluation of large-deviation functions: Numerical approach in continuous time
journal, June 2017
- Guevara Hidalgo, Esteban; Nemoto, Takahiro; Lecomte, Vivien
- Physical Review E, Vol. 95, Issue 6
The Jastrow antisymmetric geminal power in Hilbert space: theory, benchmarking, and application to a novel transition state
text, January 2013
- Neuscamman, Eric
- arXiv
Effective interactions and large deviations in stochastic processes
text, January 2015
- Jack, Robert L.; Sollich, Peter
- arXiv
Malliavin Weight Sampling: A Practical Guide
journal, December 2013
- Warren, Patrick; Allen, Rosalind
- Entropy, Vol. 16, Issue 1
Fluctuation theorem for stochastic dynamics
journal, April 1998
- Kurchan, Jorge
- Journal of Physics A: Mathematical and General, Vol. 31, Issue 16
Block Copolymers Under Shear Flow
journal, May 2005
- Rychkov, Igor
- Macromolecular Theory and Simulations, Vol. 14, Issue 4
Nonequilibrium umbrella sampling in spaces of many order parameters
journal, February 2009
- Dickson, Alex; Warmflash, Aryeh; Dinner, Aaron R.
- The Journal of Chemical Physics, Vol. 130, Issue 7
Topological mechanics of gyroscopic metamaterials
text, January 2015
- Nash, Lisa M.; Kleckner, Dustin; Read, Alismari
- arXiv
Nonequilibrium Markov Processes Conditioned on Large Deviations
journal, October 2014
- Chetrite, Raphaël; Touchette, Hugo
- Annales Henri Poincaré, Vol. 16, Issue 9
Direct evaluation of large-deviation functions
text, January 2005
- Giardina', Cristian; Kurchan, Jorge; Peliti, Luca
- arXiv
Nonequilibrium microcanonical and canonical ensembles and their equivalence
text, January 2013
- Chetrite, Raphael; Touchette, Hugo
- arXiv
Design principles for nonequilibrium self-assembly
journal, November 2016
- Nguyen, Michael; Vaikuntanathan, Suriyanarayanan
- Proceedings of the National Academy of Sciences, Vol. 113, Issue 50
Current fluctuations of interacting active Brownian particles
journal, December 2018
- GrandPre, Trevor; Limmer, David T.
- Physical Review E, Vol. 98, Issue 6
Dynamic transition in an atomic glass former: A molecular-dynamics evidence
journal, November 2011
- Pitard, E.; Lecomte, V.; van Wijland, F.
- EPL (Europhysics Letters), Vol. 96, Issue 5
Efficient transition path sampling: Application to Lennard-Jones cluster rearrangements
journal, June 1998
- Dellago, Christoph; Bolhuis, Peter G.; Chandler, David
- The Journal of Chemical Physics, Vol. 108, Issue 22
The Theory of Ultra-Coarse-Graining. 1. General Principles
journal, April 2013
- Dama, James F.; Sinitskiy, Anton V.; McCullagh, Martin
- Journal of Chemical Theory and Computation, Vol. 9, Issue 5
Turning statistical physics models into materials design engines
journal, December 2015
- Miskin, Marc Z.; Khaira, Gurdaman; de Pablo, Juan J.
- Proceedings of the National Academy of Sciences, Vol. 113, Issue 1
Forward flux sampling for rare event simulations
journal, October 2009
- Allen, Rosalind J.; Valeriani, Chantal; Rein ten Wolde, Pieter
- Journal of Physics: Condensed Matter, Vol. 21, Issue 46
Stochastic thermodynamics, fluctuation theorems and molecular machines
journal, November 2012
- Seifert, Udo
- Reports on Progress in Physics, Vol. 75, Issue 12
Effective interactions and large deviations in stochastic processes
journal, June 2015
- Jack, R. L.; Sollich, P.
- The European Physical Journal Special Topics, Vol. 224, Issue 12
Importance sampling large deviations in nonequilibrium steady states. I
journal, March 2018
- Ray, Ushnish; Chan, Garnet Kin-Lic; Limmer, David T.
- The Journal of Chemical Physics, Vol. 148, Issue 12
Brownian asymmetric simple exclusion process
text, January 2018
- Lips, Dominik; Ryabov, Artem; Maass, Philipp
- arXiv
Computing stationary distributions in equilibrium and nonequilibrium systems with forward flux sampling
journal, September 2007
- Valeriani, Chantal; Allen, Rosalind J.; Morelli, Marco J.
- The Journal of Chemical Physics, Vol. 127, Issue 11
Numerically exact path integral simulation of nonequilibrium quantum transport and dissipation
text, January 2010
- Segal, Dvira; Millis, Andrew J.; Reichman, David R.
- arXiv
Malliavin Weight Sampling for Computing Sensitivity Coefficients in Brownian Dynamics Simulations
journal, December 2012
- Warren, Patrick B.; Allen, Rosalind J.
- Physical Review Letters, Vol. 109, Issue 25
Fluctuation theorem and Onsager reciprocity relations
journal, October 2004
- Andrieux, D.; Gaspard, P.
- The Journal of Chemical Physics, Vol. 121, Issue 13
Adaptive Sampling of Large Deviations
journal, July 2018
- Ferré, Grégoire; Touchette, Hugo
- Journal of Statistical Physics, Vol. 172, Issue 6
Studying rare nonadiabatic dynamics with transition path sampling quantum jump trajectories
journal, December 2018
- Schile, Addison J.; Limmer, David T.
- The Journal of Chemical Physics, Vol. 149, Issue 21
Enhanced Diffusion of Molecular Motors in the Presence of Adenosine Triphosphate and External Force
journal, June 2016
- Shinagawa, Ryota; Sasaki, Kazuo
- Journal of the Physical Society of Japan, Vol. 85, Issue 6
Transport Coefficients from Large Deviation Functions
journal, October 2017
- Gao, Chloe; Limmer, David
- Entropy, Vol. 19, Issue 11
Using matrix product states to study the dynamical large deviations of kinetically constrained models
text, January 2019
- Bañuls, Mari Carmen; Garrahan, Juan P.
- arXiv
Simulating Rare Events in Dynamical Processes
journal, September 2011
- Giardina, Cristian; Kurchan, Jorge; Lecomte, Vivien
- Journal of Statistical Physics, Vol. 145, Issue 4
Three-body correlations and conditional forces in suspensions of active hard disks
journal, January 2018
- Härtel, Andreas; Richard, David; Speck, Thomas
- Physical Review E, Vol. 97, Issue 1
Motility-Induced Phase Separation
journal, March 2015
- Cates, Michael E.; Tailleur, Julien
- Annual Review of Condensed Matter Physics, Vol. 6, Issue 1
Sampling rare events across dynamical phase transitions
journal, August 2019
- Pérez-Espigares, Carlos; Hurtado, Pablo I.
- Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 29, Issue 8
Finite-Size Scaling of a First-Order Dynamical Phase Transition: Adaptive Population Dynamics and an Effective Model
text, January 2016
- Nemoto, Takahiro; Jack, Robert L.; Lecomte, Vivien
- arXiv
Neural networks-based variationally enhanced sampling
journal, August 2019
- Bonati, Luigi; Zhang, Yue-Yu; Parrinello, Michele
- Proceedings of the National Academy of Sciences, Vol. 116, Issue 36
Preserving Correlations Between Trajectories for Efficient Path Sampling
text, January 2015
- Gingrich, Todd R.; Geissler, Phillip L.
- arXiv
Computing stationary distributions in equilibrium and non-equilibrium systems with Forward Flux Sampling
text, January 2009
- Valeriani, Chantal; Allen, Rosalind J.; Morelli, Marco J.
- arXiv
Non-equilibrium steady states: fluctuations and large deviations of the density and of the current
journal, July 2007
- Derrida, Bernard
- Journal of Statistical Mechanics: Theory and Experiment, Vol. 2007, Issue 07
Dynamical Phase Transitions Reveal Amyloid-like States on Protein Folding Landscapes
journal, August 2014
- Weber, Jeffrey K.; Jack, Robert L.; Schwantes, Christian R.
- Biophysical Journal, Vol. 107, Issue 4
Emergence of an enslaved phononic bandgap in a non-equilibrium pseudo-crystal
journal, June 2017
- Bachelard, Nicolas; Ropp, Chad; Dubois, Marc
- Nature Materials, Vol. 16, Issue 8
The Theory of Ultra-Coarse-Graining. 2. Numerical Implementation
journal, November 2014
- Davtyan, Aram; Dama, James F.; Sinitskiy, Anton V.
- Journal of Chemical Theory and Computation, Vol. 10, Issue 12
Dominant reaction pathways in high-dimensional systems
journal, February 2009
- Autieri, E.; Faccioli, P.; Sega, M.
- The Journal of Chemical Physics, Vol. 130, Issue 6
Space-time thermodynamics of the glass transition
journal, July 2005
- Merolle, M.; Garrahan, J. P.; Chandler, D.
- Proceedings of the National Academy of Sciences, Vol. 102, Issue 31
Trajectory Stratification of Stochastic Dynamics
journal, January 2018
- Dinner, Aaron R.; Mattingly, Jonathan C.; Tempkin, Jeremy O. B.
- SIAM Review, Vol. 60, Issue 4
Dynamics on the Way to Forming Glass: Bubbles in Space-Time
journal, March 2010
- Chandler, David; Garrahan, Juan P.
- Annual Review of Physical Chemistry, Vol. 61, Issue 1
Shear-Aligned Block Copolymer Monolayers as Seeds To Control the Orientational Order in Cylinder-Forming Block Copolymer Thin Films
journal, September 2016
- Abate, Anabella A.; Vu, Giang Thi; Pezzutti, Aldo D.
- Macromolecules, Vol. 49, Issue 19
Robust nonequilibrium pathways to microcompartment assembly
text, January 2017
- Rotskoff, Grant M.; Geissler, Phillip L.
- arXiv
Malliavin weight sampling: a practical guide
text, January 2013
- Warren, Patrick B.; Allen, Rosalind J.
- arXiv
A large-deviation approach to space-time chaos
text, January 2011
- Kuptsov, Pavel V.; Politi, Antonio
- arXiv
Numerically exact path-integral simulation of nonequilibrium quantum transport and dissipation
journal, November 2010
- Segal, Dvira; Millis, Andrew J.; Reichman, David R.
- Physical Review B, Vol. 82, Issue 20
Finite-Time and -Size Scalings in the Evaluation of Large Deviation Functions: Numerical Approach in Continuous Time
text, January 2016
- Hidalgo, Esteban Guevara; Nemoto, Takahiro; Lecomte, Vivien
- arXiv
Variational formula for experimental determination of high-order correlations of current fluctuations in driven systems
journal, March 2011
- Nemoto, Takahiro; Sasa, Shin-ichi
- Physical Review E, Vol. 83, Issue 3
Large-Deviation Approach to Space-Time Chaos
journal, September 2011
- Kuptsov, Pavel V.; Politi, Antonio
- Physical Review Letters, Vol. 107, Issue 11
Importance sampling large deviations in nonequilibrium steady states. I
text, January 2017
- Ray, Ushnish; Chan, Garnet Kin-Lic; Limmer, David T.
- arXiv
Colloidal dynamics over a tilted periodic potential: Forward and reverse transition probabilities and entropy production in a nonequilibrium steady state
journal, July 2017
- Ma, Xiao-guang; Su, Yun; Lai, Pik-Yin
- Physical Review E, Vol. 96, Issue 1
The Jastrow antisymmetric geminal power in Hilbert space: Theory, benchmarking, and application to a novel transition state
journal, November 2013
- Neuscamman, Eric
- The Journal of Chemical Physics, Vol. 139, Issue 19
The large deviation approach to statistical mechanics
journal, July 2009
- Touchette, Hugo
- Physics Reports, Vol. 478, Issue 1-3
The Theory of Ultra-Coarse-Graining. 3. Coarse-Grained Sites with Rapid Local Equilibrium of Internal States
journal, February 2017
- Dama, James F.; Jin, Jaehyeok; Voth, Gregory A.
- Journal of Chemical Theory and Computation, Vol. 13, Issue 3
Thermodynamic formula for the cumulant generating function of time-averaged current
journal, December 2011
- Nemoto, Takahiro; Sasa, Shin-ichi
- Physical Review E, Vol. 84, Issue 6
Enhanced diffusion of molecular motors in the presence of adenosine triphosphate and external force
text, January 2015
- Shinagawa, Ryota; Sasaki, Kazuo
- arXiv
Large deviation function for a driven underdamped particle in a periodic potential
journal, February 2018
- Fischer, Lukas P.; Pietzonka, Patrick; Seifert, Udo
- Physical Review E, Vol. 97, Issue 2
Brownian Asymmetric Simple Exclusion Process
journal, October 2018
- Lips, Dominik; Ryabov, Artem; Maass, Philipp
- Physical Review Letters, Vol. 121, Issue 16
Large deviations of Lyapunov exponents
journal, June 2013
- Laffargue, Tanguy; Lam, Khanh-Dang Nguyen Thu; Kurchan, Jorge
- Journal of Physics A: Mathematical and Theoretical, Vol. 46, Issue 25
Turning Statistical Physics Models Into Materials Design Engines
text, January 2015
- Miskin, Marc Z.; Khaira, Gurdaman S.; de Pablo, Juan J.
- arXiv
Rayleigh-Ritz Calculation of Effective Potential Far From Equilibrium
text, January 1996
- Alexander, Francis J.; Eyink, Gregory L.
- arXiv
ASEP on a ring conditioned on enhanced flux
journal, October 2010
- Popkov, Vladislav; Schütz, Gunter M.; Simon, Damien
- Journal of Statistical Mechanics: Theory and Experiment, Vol. 2010, Issue 10
Molecular chaperones maximize the native state yield on biological times by driving substrates out of equilibrium
journal, December 2017
- Chakrabarti, Shaon; Hyeon, Changbong; Ye, Xiang
- Proceedings of the National Academy of Sciences, Vol. 114, Issue 51
Preserving correlations between trajectories for efficient path sampling
journal, June 2015
- Gingrich, Todd R.; Geissler, Phillip L.
- The Journal of Chemical Physics, Vol. 142, Issue 23
Separating forward and backward pathways in nonequilibrium umbrella sampling
journal, October 2009
- Dickson, Alex; Warmflash, Aryeh; Dinner, Aaron R.
- The Journal of Chemical Physics, Vol. 131, Issue 15
Works referencing / citing this record:
Differentiable Molecular Simulations for Control and Learning
preprint, January 2020
- Wang, Wujie; Axelrod, Simon; Gómez-Bombarelli, Rafael
- arXiv
A reinforcement learning approach to rare trajectory sampling
text, January 2020
- Rose, Dominic C.; Mair, Jamie F.; Garrahan, Juan P.
- arXiv