Title: Active and Transfer Learning of High-Dimensional Neural Network Potentials for Transition Metals

Journal Article · · ACS Applied Materials and Interfaces

Classical molecular dynamics (MD) simulations represent a very popular and powerful tool for materials modeling and design. The predictive power of MD hinges on the ability of the interatomic potential to capture the underlying physics and chemistry. There have been decades of seminal work on developing interatomic potentials, albeit with a focus predominantly on capturing the properties of bulk materials. Such physics-based models, while extensively deployed for predicting the dynamics and properties of nanoscale systems over the past two decades, tend to perform poorly in predicting nanoscale potential energy surfaces (PESs) when compared to high-fidelity first-principles calculations. These limitations stem from the lack of flexibility in such models, which rely on a predefined functional form. Machine learning (ML) models and approaches have emerged as a viable alternative to capture the diverse size-dependent cluster geometries, nanoscale dynamics, and the complex nanoscale PESs, without sacrificing the bulk properties. Here, in this study, we introduce an ML workflow that combines transfer and active learning strategies to develop high-dimensional neural networks (NNs) for capturing the cluster and bulk properties for several different transition metals with applications in catalysis, microelectronics, and energy storage, to name a few. Our NN first learns the bulk PES from the high-quality physics-based models in literature and subsequently augments this learning via retraining with a higher-fidelity first-principles training data set to concurrently capture both the nanoscale and bulk PES. Our workflow departs from status-quo in its ability to learn from a sparsely sampled data set that nonetheless covers a diverse range of cluster configurations from near-equilibrium to highly nonequilibrium as well as learning strategies that iteratively improve the fingerprinting depending on model fidelity. All the developed models are rigorously tested against an extensive first-principles data set of energies and forces of cluster configurations as well as several properties of bulk configurations for 10 different transition metals. Our approach is material agnostic and provides a methodology to transfer and build upon the learnings from decades of seminal work in molecular simulations on to a new generation of ML-trained potentials to accelerate materials discovery and design.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
US Air Force Office of Scientific Research (AFOSR); USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF)
Grant/Contract Number:
AC02-05CH11231; AC02-06CH11357
OSTI ID:
2520473
Journal Information:
ACS Applied Materials and Interfaces, Journal Name: ACS Applied Materials and Interfaces Journal Issue: 16 Vol. 16; ISSN 1944-8244
Publisher:
American Chemical Society (ACS)Copyright Statement
Country of Publication:
United States
Language:
English

References (78)

Recent Advances in Asymmetric Gold Catalysis journal June 2010
Gold Catalysis in (Supra)Molecular Cages to Control Reactivity and Selectivity journal October 2018
Sustainable Gold Catalysis in Water Using Cyclodextrin‐tagged NHC‐Gold Complexes journal August 2019
Active Learning A Neural Network Model For Gold Clusters & Bulk From Sparse First Principles Training Data journal September 2020
Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set journal July 1996
An implementation of artificial neural-network potentials for atomistic materials simulations: Performance for TiO2 journal March 2016
Multi-fidelity machine learning models for accurate bandgap predictions of solids journal March 2017
Active learning of linearly parametrized interatomic potentials journal December 2017
Accelerating high-throughput searches for new alloys with active learning of interatomic potentials journal January 2019
ADP potential for the Au-Rh system and its application in element segregation of nanoparticles journal January 2021
Considerations for choosing and using force fields and interatomic potentials in materials science and engineering journal December 2013
ANN-based estimator for distillation using Levenberg–Marquardt approach journal March 2007
Atomic interaction of the MEAM type for the study of intermetallics in the Al–U alloy journal December 2015
Pressure-induced phase transformation in β-eucryptite: An X-ray diffraction and density functional theory study journal September 2016
Active Learning the Potential Energy Landscape for Water Clusters from Sparse Training Data journal January 2020
Multi-reward Reinforcement Learning Based Bond-Order Potential to Study Strain-Assisted Phase Transitions in Phosphorene journal February 2022
Atomically Precise Gold Nanoclusters as New Model Catalysts journal March 2013
Nonscalable Oxidation Catalysis of Gold Clusters journal December 2013
Structural Optimization of Silver Clusters up to 80 Atoms with Gupta and Sutton-Chen Potentials journal May 2005
Critical Size for the Observation of Quantum Confinement in Optically Excited Gold Clusters journal January 2010
Understanding the Composition and Activity of Electrocatalytic Nanoalloys in Aqueous Solvents: A Combination of DFT and Accurate Neural Network Potentials journal April 2014
Catalysis by clusters with precise numbers of atoms journal July 2015
Enhancing materials property prediction by leveraging computational and experimental data using deep transfer learning journal November 2019
Learning in continuous action space for developing high dimensional potential energy models journal January 2022
Machine-learned interatomic potentials by active learning: amorphous and liquid hafnium dioxide journal July 2020
Accelerated prediction of atomically precise cluster structures using on-the-fly machine learning journal August 2022
A Continuous Action Space Tree search for INverse desiGn (CASTING) framework for materials discovery journal September 2023
A database of low-energy atomically precise nanoclusters journal May 2023
Global minimization of gold clusters by combining neural network potentials and the basin-hopping method journal January 2015
Ionic vs. van der Waals layered materials: identification and comparison of elastic anisotropy journal January 2018
Large piezoelectric response of van der Waals layered solids journal January 2018
Global minima for transition metal clusters described by Sutton–Chen potentials journal January 1998
Neural network potential-energy surfaces in chemistry: a tool for large-scale simulations journal January 2011
Active learning a coarse-grained neural network model for bulk water from sparse training data journal January 2020
Asynchronous multicanonical basin hopping method and its application to cobalt nanoclusters journal June 2005
New algorithm in the basin hopping Monte Carlo to find the global minimum structure of unary and binary metallic nanoclusters journal April 2008
Atom-centered symmetry functions for constructing high-dimensional neural network potentials journal February 2011
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation journal July 2013
Nested sampling in the canonical ensemble: Direct calculation of the partition function from NVT trajectories journal September 2013
Experimental and molecular dynamics simulation study of structure of liquid and amorphous Ni62Nb38 alloy journal November 2016
Neural network potentials for dynamics and thermodynamics of gold nanoparticles journal February 2017
Spherical harmonics based descriptor for neural network potentials: Structure and dynamics of Au 147 nanocluster journal May 2017
Tuning the piezoelectric and mechanical properties of the AlN system via alloying with YN and BN journal September 2017
Less is more: Sampling chemical space with active learning journal June 2018
A coarse-grained deep neural network model for liquid water journal November 2019
Simple N -body potentials for the noble metals and nickel journal December 1987
Comprehensive genetic algorithm for ab initio global optimisation of clusters journal March 2016
Long-range Finnis–Sinclair potentials journal March 1990
Machine-learning of piezoelectric coefficients for wurtzite crystals journal May 2023
Analysis of semi-empirical interatomic potentials appropriate for simulation of crystalline and liquid Al and Cu journal April 2008
The interactions of self-interstitials with twin boundaries journal April 2013
An embedded-atom potential for the Cu–Ag system journal May 2006
Improved embedded-atom model potentials of Pb at high pressure: application to investigations of plasticity and phase transition under extreme conditions journal November 2018
Inhomogeneous Electron Gas journal November 1964
Self-Consistent Equations Including Exchange and Correlation Effects journal November 1965
Enhanced Piezoelectric Response of AlN via CrN Alloying journal March 2018
On-the-fly machine learning force field generation: Application to melting points journal July 2019
Elastic moduli of rhodium: Correct prediction by a new theoretical method journal August 1981
Embedded-atom method: Derivation and application to impurities, surfaces, and other defects in metals journal June 1984
Embedded-atom-method functions for the fcc metals Cu, Ag, Au, Ni, Pd, Pt, and their alloys journal June 1986
Calculation of the thermal expansion of metals using the embedded-atom method journal December 1988
Thermodynamic properties of fcc transition metals as calculated with the embedded-atom method journal September 1989
Misfit-energy-increasing dislocations in vapor-deposited CoFe/NiFe multilayers journal April 2004
Magnetism and chemical ordering in binary transition metal clusters journal October 2008
Reactive forcefield for simulating gold surfaces and nanoparticles journal June 2010
Interatomic potential for the Al-Cu system journal February 2011
Unified Approach for Molecular Dynamics and Density-Functional Theory journal November 1985
Generalized Gradient Approximation Made Simple journal October 1996
Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces journal April 2007
Active learning of uniformly accurate interatomic potentials for materials simulation journal February 2019
Characterization of Elastic Modulus Across the (Al 1–x Sc x )N System Using DFT and Substrate-Effect-Corrected Nanoindentation journal November 2018
Global Convergence Properties of Conjugate Gradient Methods for Optimization journal February 1992
Bond order potential for gold journal September 2012
Ground state structures, electronic and optical properties of medium-sized Nan + (n = 9, 15, 21, 26, 31, 36, 41, 50 and 59) clusters from ab initio genetic algorithm journal February 2013
The solution of nonlinear inverse problems and the Levenberg-Marquardt method journal July 2007
Self-diffusion and impurity diffusion of fee metals using the five-frequency model and the Embedded Atom Method journal February 1989
Gold Nanoclusters as Electrocatalysts for Energy Conversion journal January 2020
BLAST: Bridging Length/time scales via Atomistic Simulation Toolkit preprint January 2020