DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Comprehensive sampling of coverage effects in catalysis by leveraging generalization in neural network models

Journal Article · · Digital Discovery
DOI: https://doi.org/10.1039/D4DD00328D · OSTI ID:2480604
ORCiD logo [1]; ORCiD logo [2];  [3]
  1. Univ. of California, Los Angeles, CA (United States); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States). Laboratory for Energy Applications for the Future (LEAF)
  2. Nanyang Technological Univ. (Singapore); Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States). Laboratory for Energy Applications for the Future (LEAF)
  3. Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States). Laboratory for Energy Applications for the Future (LEAF)

Sampling high-coverage configurations and predicting adsorbate–adsorbate interactions on surfaces are highly relevant to understand realistic interfaces in heterogeneous catalysis. However, the combinatorial explosion in the number of adsorbate configurations among diverse site environments presents a considerable challenge in accurately estimating these interactions. Here, we propose a strategy combining high-throughput simulation pipelines and a neural network-based model with the MACE architecture to increase sampling efficiency and speed. By training the models on unrelaxed structures and energies, which can be quickly obtained from single-point DFT calculations, we achieve excellent performance for both in-domain and out-of-domain predictions, including generalization to different facets, coverage regimes and low-energy configurations. From this systematic understanding of model robustness, we exhaustively sample the configuration phase space of catalytic systems without active learning. In particular, by predicting binding energies for over 14 million structures within the neural network model and the simulated annealing method, we predict coverage-dependent adsorption energies for CO adsorption on six Cu facets (111, 100, 211, 331, 410 and 711) and the co-adsorption of CO and CHOH on Rh(111). When validated by targeted post-sampling relaxations, our results for CO on Cu correctly reproduce experimental interaction energies reported in the literature, and provide atomistic insights on the site occupancy of steps and terraces for the six facets at all coverage regimes. Additionally, the arrangement of CO on the Rh(111) surface is demonstrated to substantially impact the activation barriers for the CHOH bond scission, illustrating the importance of comprehensive sampling on reaction kinetics. Our findings demonstrate that simplified data generation routines and evaluating generalization of neural networks can be deployed at scale to understand lateral interactions on surfaces, paving the way towards realistic modeling of heterogeneous catalytic processes.

Research Organization:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Sponsoring Organization:
USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA); USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office
Grant/Contract Number:
AC52-07NA27344
OSTI ID:
2480604
Report Number(s):
LLNL--JRNL-858286
Journal Information:
Digital Discovery, Journal Name: Digital Discovery Journal Issue: 1 Vol. 4; ISSN 2635-098X
Publisher:
Royal Society of Chemistry (RSC)Copyright Statement
Country of Publication:
United States
Language:
English

References (62)

DFT-Based Coverage-Dependent Model of Pt-Catalyzed NO Oxidation journal August 2010
Scalable approach to high coverages on oxides via iterative training of a machine‐learning algorithm journal August 2020
Theoretical Investigation of the Adsorbate and Potential‐Induced Stability of Cu Facets During Electrochemical CO2 and CO Reduction journal March 2024
Efficient Implementation of Cluster Expansion Models in Surface Kinetic Monte Carlo Simulations with Lateral Interactions: Subtraction Schemes, Supersites, and the Supercluster Contraction journal August 2019
Understanding Trends in Catalytic Activity: The Effect of Adsorbate–Adsorbate Interactions for CO Oxidation Over Transition Metals journal February 2010
A new microfacet notation for high-Miller-index surfaces of cubic materials with terrace, step and kink structures journal February 1980
Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set journal July 1996
Evaluating the benefits of kinetic Monte Carlo and microkinetic modeling for catalyst design studies in the presence of lateral interactions journal March 2022
Machine learning of lateral adsorbate interactions in surface reaction kinetics journal June 2022
Python Materials Genomics (pymatgen): A robust, open-source python library for materials analysis journal February 2013
mkite: A distributed computing platform for high-throughput materials simulations journal October 2023
From the Sabatier principle to a predictive theory of transition-metal heterogeneous catalysis journal August 2015
Consequences of adsorbate-adsorbate interactions for apparent kinetics of surface catalytic reactions journal January 2022
CO adsorption on regularly stepped Cu(410) surface journal October 2014
Comparison of cluster expansion fitting algorithms for interactions at surfaces journal October 2015
CO-CO coupling on Cu facets: Coverage, strain and field effects journal December 2016
Progress and Perspectives of Electrochemical CO 2 Reduction on Copper in Aqueous Electrolyte journal April 2019
SchNetPack: A Deep Learning Toolbox For Atomistic Systems journal November 2018
Graph Theory Approach to High-Throughput Surface Adsorption Structure Generation journal February 2019
Lateral Interactions of Dynamic Adlayer Structures from Artificial Neural Networks journal March 2022
Theoretical Investigations of Transition Metal Surface Energies under Lattice Strain and CO Environment journal May 2018
Understanding the Effect of *CO Coverage on C–C Coupling toward CO2 Electroreduction journal April 2022
Open Catalyst 2020 (OC20) Dataset and Community Challenges journal May 2021
Using pH Dependence to Understand Mechanisms in Electrochemical CO Reduction journal March 2022
Selectivity Trends and Role of Adsorbate–Adsorbate Interactions in CO Hydrogenation on Rhodium Catalysts journal June 2022
A Challenge to the G ∼ 0 Interpretation of Hydrogen Evolution journal November 2019
Performance of Cluster Expansions of Coverage-Dependent Adsorption of Atomic Oxygen on Pt(111) journal December 2011
Intrinsic Selectivity and Structure Sensitivity of Rhodium Catalysts for C 2+ Oxygenate Production journal March 2016
Towards the computational design of solid catalysts journal April 2009
Differentiable sampling of molecular geometries with uncertainty-based adversarial attacks journal August 2021
Adsorbate chemical environment-based machine learning framework for heterogeneous catalysis journal October 2022
A high-throughput framework for determining adsorption energies on solid surfaces journal March 2017
Graph theory approach to determine configurations of multidentate and high coverage adsorbates for heterogeneous catalysis journal June 2020
Human- and machine-centred designs of molecules and materials for sustainability and decarbonization journal August 2022
Molecular tuning of CO2-to-ethylene conversion journal November 2019
Constraining CO coverage on copper promotes high-efficiency ethylene electroproduction journal November 2019
Catalyst synthesis under CO2 electroreduction favours faceting and promotes renewable fuels electrosynthesis journal December 2019
Challenges for density functional theory: calculation of CO adsorption on electrocatalytically relevant metals journal January 2021
CO organization at ambient pressure on stepped Pt surfaces: first principles modeling accelerated by neural networks journal January 2021
Inorganic synthesis-structure maps in zeolites with machine learning and crystallographic distances journal January 2023
A climbing image nudged elastic band method for finding saddle points and minimum energy paths journal December 2000
Equation of State Calculations by Fast Computing Machines journal June 1953
A dimer method for finding saddle points on high dimensional potential surfaces using only first derivatives journal October 1999
Parallel kinetic Monte Carlo simulation framework incorporating accurate models of adsorbate lateral interactions journal December 2013
Beyond mean-field approximations for accurate and computationally efficient models of on-lattice chemical kinetics journal July 2017
SchNetPack 2.0: A neural network toolbox for atomistic machine learning journal April 2023
Updates to the DScribe library: New descriptors and derivatives journal June 2023
Evaluation of the MACE force field architecture: From medicinal chemistry to materials science journal July 2023
Properties of real metallic surfaces: Effects of density functional semilocality and van der Waals nonlocality journal October 2017
Monte Carlo sampling methods using Markov chains and their applications journal April 1970
Adsorption on transition metal surfaces: Transferability and accuracy of DFT using the ADS41 dataset journal July 2019
Special points for Brillouin-zone integrations journal June 1976
Projector augmented-wave method journal December 1994
Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set journal October 1996
From ultrasoft pseudopotentials to the projector augmented-wave method journal January 1999
Improved adsorption energetics within density-functional theory using revised Perdew-Burke-Ernzerhof functionals journal March 1999
CO adsorption on a Cu(211) surface: First-principle calculation and STM study journal January 2005
On representing chemical environments journal May 2013
Generalized Gradient Approximation Made Simple journal October 1996
Optimization by Simulated Annealing journal May 1983
Combining theory and experiment in electrocatalysis: Insights into materials design journal January 2017
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction preprint January 2018