Title: Deep reinforcement learning for predicting kinetic pathways to surface reconstruction in a ternary alloy

Journal Article · · Machine Learning: Science and Technology

Abstract The majority of computational catalyst design focuses on the screening of material components and alloy composition to optimize selectivity and activity for a given reaction. However, predicting the metastability of the alloy catalyst surface at realistic operating conditions requires an extensive sampling of possible surface reconstructions and their associated kinetic pathways. We present CatGym, a deep reinforcement learning (DRL) environment for predicting the thermal surface reconstruction pathways and their associated kinetic barriers in crystalline solids under reaction conditions. The DRL agent iteratively changes the positions of atoms in the near-surface region to generate kinetic pathways to accessible local minima involving changes in the surface compositions. We showcase our agent by predicting the surface reconstruction pathways of a ternary Ni 3 Pd 3 Au 2 (111) alloy catalyst. Our results show that the DRL agent can not only explore more diverse surface compositions than the conventional minima hopping method, but also generate the kinetic surface reconstruction pathways. We further demonstrate that the kinetic pathway to a global minimum energy surface composition and its associated transition state predicted by our agent is in good agreement with the minimum energy path predicted by nudged elastic band calculations.

Research Organization:
Carnegie Mellon University, Pittsburgh, PA (United States)
Sponsoring Organization:
USDOE Advanced Research Projects Agency - Energy (ARPA-E)
Grant/Contract Number:
AR0001221
OSTI ID:
1835376
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Journal Issue: 4 Vol. 2; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (71)

Machine Learning Interatomic Potentials as Emerging Tools for Materials Science journal September 2019
Surface Segregation of Ternary Alloys: Effect of the Interaction between Solute Elements journal February 2020
Constructing high-dimensional neural network potentials: A tutorial review journal March 2015
Surface composition of PdCuAu ternary alloys: a combined LEIS and XPS study: Surface composition of PdCuAu ternary alloys: a LEIS and XPS study journal May 2015
Prediction of Mechanical Properties of Wrought Aluminium Alloys Using Feature Engineering Assisted Machine Learning Approach journal April 2021
The potential of atomistic simulations and the knowledgebase of interatomic models journal July 2011
Surface composition of nickel-gold alloys journal September 1973
Determination of the surface composition of palladium-nickel alloy film catalysts using Auger electron spectroscopy journal December 1975
On the reactivity of 2D Pd surface alloys obtained by surface segregation or deposition technique journal July 1995
A semi-empirical effective medium theory for metals and alloys journal October 1996
STM comparative study of the Pd8Ni92(110) alloy surface and the Pd/Ni(110) surface alloy journal May 2000
The surface energy of metals journal August 1998
Alloy catalysts: the concepts journal December 2001
Surface reconstruction engineering of twinned Pd2CoAg nanocrystals by atomic vacancy inducement for hydrogen evolution and oxygen reduction reactions journal February 2019
Hydrogen generation from formic acid decomposition at room temperature using a NiAuPd alloy nanocatalyst journal March 2014
In situ XPS study of the adsorption and reactions of NO and O2 on gold nanoparticles deposited on TiO2 and SiO2 journal October 2011
Ternary CoAuPd and binary AuPd electrocatalysts for methanol oxidation and oxygen reduction reaction: Enhanced catalytic performance by surface reconstruction journal February 2019
A machine-learning approach to predicting and understanding the properties of amorphous metallic alloys journal February 2020
Yield strength prediction of high-entropy alloys using machine learning journal March 2021
Ambient pressure photoelectron spectroscopy: A new tool for surface science and nanotechnology journal April 2008
IMFP measurements near Au–Ni alloy surfaces by EPES: indirect evidence of submonolayer Au surface enrichment journal September 2004
Novel PdAgCu ternary alloy as promising materials for hydrogen separation membranes: Synthesis and characterization journal January 2011
Surface segregation in AuPd alloys: Ab initio analysis of the driving forces journal September 2015
Composition, structure and stability of surfaces formed by Ni deposition on Pd(111) journal April 2016
The structure of reconstructed chalcopyrite surfaces journal March 2018
Surface crystallography via electron microscopy journal January 2004
Atomic-Resolution Transmission Electron Microscopic Movies for Study of Organic Molecules, Assemblies, and Reactions: The First 10 Years of Development journal May 2017
SchNetPack: A Deep Learning Toolbox For Atomistic Systems journal November 2018
Accelerated Saddle Point Refinement through Full Exploitation of Partial Hessian Diagonalization journal October 2019
Surface Segregation Across Ternary Alloy Composition Space: Cu x Au y Pd 1– x – y journal April 2020
Hydrogen Solubility of Magnetron Co-Sputtered FCC and BCC PdCuAu Thin Films journal March 2016
Machine-Learning-Augmented Chemisorption Model for CO 2 Electroreduction Catalyst Screening journal August 2015
Convolutional Neural Network of Atomic Surface Structures To Predict Binding Energies for High-Throughput Screening of Catalysts journal July 2019
Recent Progresses on Structural Reconstruction of Nanosized Metal Catalysts via Controlled-Atmosphere Transmission Electron Microscopy: A Review journal November 2020
Operando Insights into Nanoparticle Transformations during Catalysis journal August 2019
Optimizing Chemical Reactions with Deep Reinforcement Learning journal November 2017
In-Situ Studies of Nanocatalysis journal April 2013
Electron Microscopy of Solid Catalysts—Transforming from a Challenge to a Toolbox journal March 2015
Atomic-Scale Observations of Catalyst Structures under Reaction Conditions and during Catalysis journal March 2016
The Composition and Structure of Pd−Au Surfaces journal October 2005
Outstanding Catalyst Performance of PdAuNi Nanoparticles for the Anodic Reaction in an Alkaline Direct Ethanol (with Anion-Exchange Membrane) Fuel Cell journal December 2012
Human-level control through deep reinforcement learning journal February 2015
Mastering the game of Go with deep neural networks and tree search journal January 2016
High-spatial-resolution mapping of catalytic reactions on single particles journal January 2017
Direct instrumental identification of catalytically active surface sites journal September 2017
Towards full-structure determination of bimetallic nanoparticles with an aberration-corrected electron microscope journal November 2010
Metastable exohedrally decorated Borospherene B40 journal August 2017
Efficient water desalination with graphene nanopores obtained using artificial intelligence journal July 2021
Active learning across intermetallics to guide discovery of electrocatalysts for CO2 reduction and H2 evolution journal September 2018
High-throughput screening of bimetallic catalysts enabled by machine learning journal January 2017
Unexpectedly high stability and surface reconstruction of PdAuAg nanoparticles for formate oxidation electrocatalysis journal January 2020
Improved tangent estimate in the nudged elastic band method for finding minimum energy paths and saddle points journal December 2000
A climbing image nudged elastic band method for finding saddle points and minimum energy paths journal December 2000
Minima hopping: An efficient search method for the global minimum of the potential energy surface of complex molecular systems journal June 2004
A new scanning tunneling microscope reactor used for high-pressure and high-temperature catalysis studies journal August 2008
Surface segregation in alloys: LEED, Auger, and gas adsorption study of segregation of Au to the (111) surface of Ni journal August 1976
Atomistic structure learning journal August 2019
Gaussian representation for image recognition and reinforcement learning of atomistic structure journal July 2020
Interatomic interactions in the effective-medium theory journal May 1987
Accelerating crystal structure prediction by machine-learning interatomic potentials with active learning journal February 2019
Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties journal April 2018
Data-Driven Learning of Total and Local Energies in Elemental Boron journal April 2018
Differentiable Optimization for the Prediction of Ground State Structures (DOGSS) journal October 2020
Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces journal April 2007
Segregation and interlayer relaxation at the NiPd(111) surface journal January 2011
Deep reinforcement learning for de novo drug design journal July 2018
The Role of Interstitial Sites in the Ti3d Defect State in the Band Gap of Titania journal June 2008
Reaction-Driven Restructuring of Rh-Pd and Pt-Pd Core-Shell Nanoparticles journal November 2008
Break-Up of Stepped Platinum Catalyst Surfaces by High CO Coverage journal February 2010
Spectroscopic Observation of Dual Catalytic Sites During Oxidation of CO on a Au/TiO2 Catalyst journal August 2011
Hybrid Actor-Critic Reinforcement Learning in Parameterized Action Space
  • Fan, Zhou; Su, Rui; Zhang, Weinan
  • Twenty-Eighth International Joint Conference on Artificial Intelligence {IJCAI-19}, Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence https://doi.org/10.24963/ijcai.2019/316
conference August 2019