skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Rise of Neural Networks for Materials and Chemical Dynamics

Journal Article · · Journal of Physical Chemistry Letters

Machine learning (ML) is quickly becoming a premier tool for modeling chemical processes and materials. ML-based force fields, trained on large data sets of high-quality electron structure calculations, are particularly attractive due their unique combination of computational efficiency and physical accuracy. This Perspective summarizes some recent advances in the development of neural network-based interatomic potentials. Designing high-quality training data sets is crucial to overall model accuracy. One strategy is active learning, in which new data are automatically collected for atomic configurations that produce large ML uncertainties. Another strategy is to use the highest levels of quantum theory possible. Transfer learning allows training to a data set of mixed fidelity. A model initially trained to a large data set of density functional theory calculations can be significantly improved by retraining to a relatively small data set of expensive coupled cluster theory calculations. These advances are exemplified by applications to molecules and materials.

Research Organization:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE Laboratory Directed Research and Development (LDRD) Program
Grant/Contract Number:
89233218CNA000001
OSTI ID:
1825448
Report Number(s):
LA-UR-21-23254
Journal Information:
Journal of Physical Chemistry Letters, Vol. 12, Issue 26; ISSN 1948-7185
Publisher:
American Chemical SocietyCopyright Statement
Country of Publication:
United States
Language:
English

References (110)

A fourth-generation high-dimensional neural network potential with accurate electrostatics including non-local charge transfer journal January 2021
Application of machine learning methods for predicting new superhard materials journal August 2020
Amp: A modular approach to machine learning in atomistic simulations journal October 2016
Identifying Structural Flow Defects in Disordered Solids Using Machine-Learning Methods journal March 2015
A full coupled‐cluster singles and doubles model: The inclusion of disconnected triples journal February 1982
DREIDING: a generic force field for molecular simulations journal December 1990
Pattern recognition of the 1H NMR spectra of sugar alditols using a neural network journal August 1989
Machine Learning Predictions of Molecular Properties: Accurate Many-Body Potentials and Nonlocality in Chemical Space journal June 2015
Less is more: Sampling chemical space with active learning journal June 2018
Prediction Errors of Molecular Machine Learning Models Lower than Hybrid DFT Error journal October 2017
Accurate and transferable multitask prediction of chemical properties with an atoms-in-molecules neural network journal August 2019
Discovering charge density functionals and structure-property relationships with PROPhet: A general framework for coupling machine learning and first-principles methods journal April 2017
Neural networks and kernel ridge regression for excited states dynamics of CH 2 NH$_2^+$: From single-state to multi-state representations and multi-property machine learning models journal May 2020
Machine-learned potentials for next-generation matter simulations journal May 2021
SchNet – A deep learning architecture for molecules and materials journal June 2018
Nonadiabatic Excited-State Dynamics with Machine Learning journal September 2018
DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamics journal July 2018
ChemSpider: An Online Chemical Information Resource journal November 2010
Moment Tensor Potentials: A Class of Systematically Improvable Interatomic Potentials journal January 2016
Machine Learning Force Fields journal March 2021
Efficient Syntheses of Diverse, Medicinally Relevant Targets Planned by Computer and Executed in the Laboratory journal March 2018
Prediction of Absolute Solvation Free Energies using Molecular Dynamics Free Energy Perturbation and the OPLS Force Field journal April 2010
Query by committee conference January 1992
Evidence of Skewness and Sub-Gaussian Character in Temperature-Dependent Distributions of One Million Electronic Excitation Energies in PbS Quantum Dots journal January 2020
PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments, and Partial Charges journal April 2019
First Principles Neural Network Potentials for Reactive Simulations of Large Molecular and Condensed Systems journal August 2017
Predicting reaction performance in C–N cross-coupling using machine learning journal February 2018
Non-covalent interactions across organic and biological subsets of chemical space: Physics-based potentials parametrized from machine learning journal June 2018
Deep Learning Spectroscopy: Neural Networks for Molecular Excitation Spectra journal January 2019
Machine Learning of Partial Charges Derived from High-Quality Quantum-Mechanical Calculations journal February 2018
Two-layer Gaussian-based MCTDH study of the S 1S 0 vibronic absorption spectrum of formaldehyde using multiplicative neural network potentials journal August 2019
Multiview Joint Learning-Based Method for Identifying Small-Molecule-Associated MiRNAs by Integrating Pharmacological, Genomics, and Network Knowledge journal July 2020
Extending the accuracy of the SNAP interatomic potential form journal June 2018
Self-Consistent Equations Including Exchange and Correlation Effects journal November 1965
Discovering a Transferable Charge Assignment Model Using Machine Learning journal July 2018
Structural Deformation Controls Charge Losses in MAPbI 3 : Unsupervised Machine Learning of Nonadiabatic Molecular Dynamics journal May 2020
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning journal January 2012
The TensorMol-0.1 model chemistry: a neural network augmented with long-range physics journal January 2018
Lattice Neural Network Minimization Application of Neural Network Optimization for Locating the Global-minimum Conformations of Proteins journal August 1993
MP2 energy evaluation by direct methods journal December 1988
Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach journal April 2015
Applications of neural networks to fitting interatomic potential functions journal January 1999
Joint entity and relation extraction based on a hybrid neural network journal September 2017
First-principles data set of 45,892 isolated and cation-coordinated conformers of 20 proteinogenic amino acids journal February 2016
Protein secondary structure prediction with a neural network. journal January 1989
ReaxFF:  A Reactive Force Field for Hydrocarbons journal October 2001
Challenges for machine learning force fields in reproducing potential energy surfaces of flexible molecules journal March 2021
A Comparison of Quantum and Molecular Mechanical Methods to Estimate Strain Energy in Druglike Fragments journal May 2017
Representing high-dimensional potential-energy surfaces for reactions at surfaces by neural networks journal September 2004
General-Purpose Machine Learning Potentials Capturing Nonlocal Charge Transfer journal January 2021
A Survey on Transfer Learning journal October 2010
Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons journal April 2010
An implementation of artificial neural-network potentials for atomistic materials simulations: Performance for TiO2 journal March 2016
Quantum-chemical insights from deep tensor neural networks journal January 2017
Deep Learning for Deep Chemistry: Optimizing the Prediction of Chemical Patterns journal November 2019
The MLIP package: Moment Tensor Potentials with MPI and Active Learning journal November 2020
Ensemble-Average Representation of Pt Clusters in Conditions of Catalysis Accessed through GPU Accelerated Deep Neural Network Fitting Global Optimization journal November 2016
Machine learning of accurate energy-conserving molecular force fields journal May 2017
Universal fragment descriptors for predicting properties of inorganic crystals journal June 2017
MSnet: A Neural Network which Classifies Mass Spectra journal January 1990
ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost journal January 2017
The Chemical Space Project journal February 2015
Towards exact molecular dynamics simulations with machine-learned force fields journal September 2018
Deep reinforcement learning for de novo drug design journal July 2018
Charge equilibration for molecular dynamics simulations journal April 1991
Neural network models of potential energy surfaces journal September 1995
Machine Learning for Electronically Excited States of Molecules journal November 2020
Molecular mechanics. The MM3 force field for hydrocarbons. 1 journal November 1989
Deep Generative Models for Molecular Science journal January 2018
Self-consistent-charge density-functional tight-binding method for simulations of complex materials properties journal September 1998
Spectral neighbor analysis method for automated generation of quantum-accurate interatomic potentials journal March 2015
TorchANI: A Free and Open Source PyTorch-Based Deep Learning Implementation of the ANI Neural Network Potentials journal June 2020
Molecular Dynamics with On-the-Fly Machine Learning of Quantum-Mechanical Forces journal March 2015
Machine learning in materials informatics: recent applications and prospects journal December 2017
Perspective: Machine learning potentials for atomistic simulations journal November 2016
Machine Learning for Absorption Cross Sections journal August 2020
Analysis of semi-empirical interatomic potentials appropriate for simulation of crystalline and liquid Al and Cu journal April 2008
Development and use of quantum mechanical molecular models. 76. AM1: a new general purpose quantum mechanical molecular model journal June 1985
Quantum Chemistry in the Age of Machine Learning journal March 2020
OPLS3: A Force Field Providing Broad Coverage of Drug-like Small Molecules and Proteins journal December 2015
Development of Multimodal Machine Learning Potentials: Toward a Physics-Aware Artificial Intelligence journal March 2021
Symmetry-Adapted Machine Learning for Tensorial Properties of Atomistic Systems journal January 2018
Description of the potential energy surface of the water dimer with an artificial neural network journal June 1997
Discovering the building blocks of atomic systems using machine learning: application to grain boundaries journal August 2017
Hierarchical modeling of molecular energies using a deep neural network journal June 2018
ElemNet: Deep Learning the Chemistry of Materials From Only Elemental Composition journal December 2018
Automated discovery of a robust interatomic potential for aluminum journal February 2021
Data-Driven Learning of Total and Local Energies in Elemental Boron journal April 2018
Learning molecular energies using localized graph kernels journal March 2017
Gaussian approximation potentials: A brief tutorial introduction journal April 2015
Transferable Dynamic Molecular Charge Assignment Using Deep Neural Networks journal July 2018
Approaching coupled cluster accuracy with a general-purpose neural network potential through transfer learning journal July 2019
Combining SchNet and SHARC: The SchNarc Machine Learning Approach for Excited-State Dynamics journal April 2020
Physically informed artificial neural networks for atomistic modeling of materials journal May 2019
Machine learning unifies the modeling of materials and molecules journal December 2017
Energy-free machine learning force field for aluminum journal August 2017
The ANI-1ccx and ANI-1x data sets, coupled-cluster and density functional theory properties for molecules journal May 2020
Spectroscopic Investigation of the Effect of Microstructure and Energetic Offset on the Nature of Interfacial Charge Transfer States in Polymer: Fullerene Blends journal February 2019
Structural analysis of Si(111)‐7×7 by UHV‐transmission electron diffraction and microscopy
  • Takayanagi, K.; Tanishiro, Y.; Takahashi, M.
  • Journal of Vacuum Science & Technology A: Vacuum, Surfaces, and Films, Vol. 3, Issue 3 https://doi.org/10.1116/1.573160
journal May 1985
Optimization of a Deep-Learning Method Based on the Classification of Images Generated by Parameterized Deep Snap a Novel Molecular-Image-Input Technique for Quantitative Structure–Activity Relationship (QSAR) Analysis journal March 2019
tmQM Dataset—Quantum Geometries and Properties of 86k Transition Metal Complexes journal November 2020
Constructing high-dimensional neural network potentials: A tutorial review journal March 2015
Advancing Physical Chemistry with Machine Learning journal November 2020
Coupling Molecular Dynamics and Deep Learning to Mine Protein Conformational Space journal June 2019
Machine learning for interatomic potential models journal February 2020
Machine-learning-assisted materials discovery using failed experiments journal May 2016
Quantum chemistry structures and properties of 134 kilo molecules journal August 2014
Combined first-principles calculation and neural-network correction approach for heat of formation journal December 2003
Graphics Processing Unit-Accelerated Semiempirical Born Oppenheimer Molecular Dynamics Using PyTorch journal July 2020
Extending the Applicability of the ANI Deep Learning Molecular Potential to Sulfur and Halogens journal June 2020