Adaptive enhanced sampling by force-biasing using neural networks
Abstract
A machine learning assisted method is presented for molecular simulation of systems with rugged free energy landscapes. The method is general and can be combined with other advanced sampling techniques. In the particular implementation proposed here, it is illustrated in the context of an adaptive biasing force approach where, rather than relying on discrete force estimates, one can resort to a self-regularizing artificial neural network to generate continuous, estimated generalized forces. By doing so, the proposed approach addresses several shortcomings common to adaptive biasing force and other algorithms. Specifically, the neural network enables smooth estimates of generalized forces in sparsely sampled regions, force estimates in previously unexplored regions, and continuous force estimates with which to bias the simulation, as opposed to biases generated at specific points of a discrete grid. The usefulness of the method is illustrated with three different examples, chosen to highlight the wide range of applicability of the underlying concepts. In all three cases, the new method is found to enhance considerably the underlying traditional adaptive biasing force approach. Furthermore, the method is also found to provide improvements over previous implementations of neural network assisted algorithms.
- Authors:
-
- Univ. of Chicago, Chicago, IL (United States)
- Univ. of Notre Dame, Notre Dame, IN (United States)
- Univ. of Chicago, Chicago, IL (United States); Argonne National Lab. (ANL), Argonne, IL (United States)
- Publication Date:
- Research Org.:
- Argonne National Laboratory (ANL), Argonne, IL (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Basic Energy Sciences (BES) (SC-22). Materials Sciences & Engineering Division; Midwest Integrated Center for Computational Materials (MICCoM); National Science Foundation (NSF); USDOE
- OSTI Identifier:
- 1461329
- Alternate Identifier(s):
- OSTI ID: 1431380
- Grant/Contract Number:
- AC02-06CH11357
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Chemical Physics
- Additional Journal Information:
- Journal Volume: 148; Journal Issue: 13; Journal ID: ISSN 0021-9606
- Publisher:
- American Institute of Physics (AIP)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Guo, Ashley Z., Sevgen, Emre, Sidky, Hythem, Whitmer, Jonathan K., Hubbell, Jeffrey A., and de Pablo, Juan J. Adaptive enhanced sampling by force-biasing using neural networks. United States: N. p., 2018.
Web. doi:10.1063/1.5020733.
Guo, Ashley Z., Sevgen, Emre, Sidky, Hythem, Whitmer, Jonathan K., Hubbell, Jeffrey A., & de Pablo, Juan J. Adaptive enhanced sampling by force-biasing using neural networks. United States. https://doi.org/10.1063/1.5020733
Guo, Ashley Z., Sevgen, Emre, Sidky, Hythem, Whitmer, Jonathan K., Hubbell, Jeffrey A., and de Pablo, Juan J. Tue .
"Adaptive enhanced sampling by force-biasing using neural networks". United States. https://doi.org/10.1063/1.5020733. https://www.osti.gov/servlets/purl/1461329.
@article{osti_1461329,
title = {Adaptive enhanced sampling by force-biasing using neural networks},
author = {Guo, Ashley Z. and Sevgen, Emre and Sidky, Hythem and Whitmer, Jonathan K. and Hubbell, Jeffrey A. and de Pablo, Juan J.},
abstractNote = {A machine learning assisted method is presented for molecular simulation of systems with rugged free energy landscapes. The method is general and can be combined with other advanced sampling techniques. In the particular implementation proposed here, it is illustrated in the context of an adaptive biasing force approach where, rather than relying on discrete force estimates, one can resort to a self-regularizing artificial neural network to generate continuous, estimated generalized forces. By doing so, the proposed approach addresses several shortcomings common to adaptive biasing force and other algorithms. Specifically, the neural network enables smooth estimates of generalized forces in sparsely sampled regions, force estimates in previously unexplored regions, and continuous force estimates with which to bias the simulation, as opposed to biases generated at specific points of a discrete grid. The usefulness of the method is illustrated with three different examples, chosen to highlight the wide range of applicability of the underlying concepts. In all three cases, the new method is found to enhance considerably the underlying traditional adaptive biasing force approach. Furthermore, the method is also found to provide improvements over previous implementations of neural network assisted algorithms.},
doi = {10.1063/1.5020733},
journal = {Journal of Chemical Physics},
number = 13,
volume = 148,
place = {United States},
year = {Tue Apr 03 00:00:00 EDT 2018},
month = {Tue Apr 03 00:00:00 EDT 2018}
}
Web of Science
Works referenced in this record:
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
journal, June 1963
- Marquardt, Donald W.
- Journal of the Society for Industrial and Applied Mathematics, Vol. 11, Issue 2
The Adaptive Biasing Force Method: Everything You Always Wanted To Know but Were Afraid To Ask
journal, August 2014
- Comer, Jeffrey; Gumbart, James C.; Hénin, Jérôme
- The Journal of Physical Chemistry B, Vol. 119, Issue 3
Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling
journal, February 1977
- Torrie, G. M.; Valleau, J. P.
- Journal of Computational Physics, Vol. 23, Issue 2
Canonical sampling through velocity rescaling
journal, January 2007
- Bussi, Giovanni; Donadio, Davide; Parrinello, Michele
- The Journal of Chemical Physics, Vol. 126, Issue 1
Stochastic Neural Network Approach for Learning High-Dimensional Free Energy Surfaces
journal, October 2017
- Schneider, Elia; Dai, Luke; Topper, Robert Q.
- Physical Review Letters, Vol. 119, Issue 15
A method for the solution of certain non-linear problems in least squares
journal, January 1944
- Levenberg, Kenneth
- Quarterly of Applied Mathematics, Vol. 2, Issue 2
Well-Tempered Metadynamics: A Smoothly Converging and Tunable Free-Energy Method
journal, January 2008
- Barducci, Alessandro; Bussi, Giovanni; Parrinello, Michele
- Physical Review Letters, Vol. 100, Issue 2
Basis Function Sampling: A New Paradigm for Material Property Computation
journal, November 2014
- Whitmer, Jonathan K.; Chiu, Chi-cheng; Joshi, Abhijeet A.
- Physical Review Letters, Vol. 113, Issue 19
Flux Tempered Metadynamics
journal, September 2011
- Singh, Sadanand; Chiu, Chi-cheng; de Pablo, Juan J.
- Journal of Statistical Physics, Vol. 145, Issue 4
Learning free energy landscapes using artificial neural networks
journal, March 2018
- Sidky, Hythem; Whitmer, Jonathan K.
- The Journal of Chemical Physics, Vol. 148, Issue 10
Extended Adaptive Biasing Force Algorithm. An On-the-Fly Implementation for Accurate Free-Energy Calculations
journal, July 2016
- Fu, Haohao; Shao, Xueguang; Chipot, Christophe
- Journal of Chemical Theory and Computation, Vol. 12, Issue 8
Approaching a parameter-free metadynamics
journal, September 2011
- Dickson, Bradley M.
- Physical Review E, Vol. 84, Issue 3
THE weighted histogram analysis method for free-energy calculations on biomolecules. I. The method
journal, October 1992
- Kumar, Shankar; Rosenberg, John M.; Bouzida, Djamal
- Journal of Computational Chemistry, Vol. 13, Issue 8
Fast Parallel Algorithms for Short-Range Molecular Dynamics
journal, March 1995
- Plimpton, Steve
- Journal of Computational Physics, Vol. 117, Issue 1
Sculpting bespoke mountains: Determining free energies with basis expansions
journal, July 2015
- Whitmer, Jonathan K.; Fluitt, Aaron M.; Antony, Lucas
- The Journal of Chemical Physics, Vol. 143, Issue 4
Polymorphic transitions in single crystals: A new molecular dynamics method
journal, December 1981
- Parrinello, M.; Rahman, A.
- Journal of Applied Physics, Vol. 52, Issue 12
Smoothed Biasing Forces Yield Unbiased Free Energies with the Extended-System Adaptive Biasing Force Method
journal, December 2016
- Lesage, Adrien; Lelièvre, Tony; Stoltz, Gabriel
- The Journal of Physical Chemistry B, Vol. 121, Issue 15
Variational Approach to Enhanced Sampling and Free Energy Calculations
journal, August 2014
- Valsson, Omar; Parrinello, Michele
- Physical Review Letters, Vol. 113, Issue 9
GROMACS: High performance molecular simulations through multi-level parallelism from laptops to supercomputers
journal, September 2015
- Abraham, Mark James; Murtola, Teemu; Schulz, Roland
- SoftwareX, Vol. 1-2
Comparison of multiple Amber force fields and development of improved protein backbone parameters
journal, November 2006
- Hornak, Viktor; Abel, Robert; Okur, Asim
- Proteins: Structure, Function, and Bioinformatics, Vol. 65, Issue 3
A Practical Bayesian Framework for Backpropagation Networks
journal, May 1992
- MacKay, David J. C.
- Neural Computation, Vol. 4, Issue 3
SSAGES: Software Suite for Advanced General Ensemble Simulations
journal, January 2018
- Sidky, Hythem; Colón, Yamil J.; Helfferich, Julian
- The Journal of Chemical Physics, Vol. 148, Issue 4
Escaping free-energy minima
journal, September 2002
- Laio, A.; Parrinello, M.
- Proceedings of the National Academy of Sciences, Vol. 99, Issue 20
Exploration, Sampling, And Reconstruction of Free Energy Surfaces with Gaussian Process Regression
journal, September 2016
- Mones, Letif; Bernstein, Noam; Csányi, Gábor
- Journal of Chemical Theory and Computation, Vol. 12, Issue 10
A boundary correction algorithm for metadynamics in multiple dimensions
journal, August 2013
- McGovern, Michael; de Pablo, Juan
- The Journal of Chemical Physics, Vol. 139, Issue 8
A Bias-Exchange Approach to Protein Folding
journal, May 2007
- Piana, Stefano; Laio, Alessandro
- The Journal of Physical Chemistry B, Vol. 111, Issue 17
Adaptive biasing force method for scalar and vector free energy calculations
journal, April 2008
- Darve, Eric; Rodríguez-Gómez, David; Pohorille, Andrew
- The Journal of Chemical Physics, Vol. 128, Issue 14
Calculating free energies using average force
journal, November 2001
- Darve, Eric; Pohorille, Andrew
- The Journal of Chemical Physics, Vol. 115, Issue 20
Neural Network and Nearest Neighbor Algorithms for Enhancing Sampling of Molecular Dynamics
journal, May 2017
- Galvelis, Raimondas; Sugita, Yuji
- Journal of Chemical Theory and Computation, Vol. 13, Issue 6
Approximation by superpositions of a sigmoidal function
journal, December 1992
- Cybenko, G.
- Mathematics of Control, Signals, and Systems, Vol. 5, Issue 4
Datasets of seed mucilage traits for Arabidopsis thaliana natural accessions with atypical outer mucilage
journal, March 2021
- Cambert, Mireille; Berger, Adeline; Sallé, Christine
- Scientific Data, Vol. 8, Issue 1
Rational identification and characterisation of peptide ligands for targeting polysialic acid
journal, May 2020
- Shastry, Divya G.; Irudayanathan, Flaviyan Jerome; Williams, Asher
- Scientific Reports, Vol. 10, Issue 1
Exploration, Sampling, And Reconstruction of Free Energy Surfaces with Gaussian Process Regression.
text, January 2016
- Mones, Letif; Bernstein, Noam; Csányi, Gábor
- Apollo - University of Cambridge Repository
SSAGES : Software Suite for Advanced General Ensemble Simulations
text, January 2018
- Sidky, Hythem; Colón, Yamil J.; Helfferich, Julian
- American Institute of Physics (AIP)
Well-Tempered Metadynamics: A Smoothly Converging and Tunable Free-Energy Method
text, January 2008
- Barducci, Alessandro; Bussi, Giovanni; Parrinello, Michele
- arXiv
Works referencing / citing this record:
Displacive phase-field crystal model
journal, January 2020
- Alster, Eli; Elder, K. R.; Voorhees, Peter W.
- Physical Review Materials, Vol. 4, Issue 1
Machine learning for parameter auto-tuning in molecular dynamics simulations: Efficient dynamics of ions near polarizable nanoparticles
journal, January 2020
- Kadupitiya, Jcs; Fox, Geoffrey C.; Jadhao, Vikram
- The International Journal of High Performance Computing Applications, Vol. 34, Issue 3
Machine Learning for Parameter Auto-tuning in Molecular Dynamics Simulations: Efficient Dynamics of Ions near Polarizable Nanoparticles
text, January 2019
- Kadupitiya, Jcs; Fox, Geoffrey C.; Jadhao, Vikram
- Unpublished
Machine Learning for Parameter Auto-tuning in Molecular Dynamics Simulations: Efficient Dynamics of Ions near Polarizable Nanoparticles
preprint, January 2019
- Kadupitiya, Jcs; Fox, Geoffrey C.; Jadhao, Vikram
- arXiv