DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Sequential-Optimization-Based Framework for Robust Modeling and Design of Heterogeneous Catalytic Systems

Abstract

Here, we present a general optimization-based framework for (i) ab initio and experimental data driven mechanistic modeling and (ii) optimal catalyst design of heterogeneous catalytic systems. Both cases are formulated as a nonlinear optimization problem that is subject to a mean-field microkinetic model and thermodynamic consistency requirements as constraints, for which we seek sparse solutions through a ridge (L2 regularization) penalty. The solution procedure involves an iterative sequence of forward simulation of the differential algebraic equations pertaining to the microkinetic model using a numerical tool capable of handling stiff systems, sensitivity calculations using linear algebra, and gradient-based nonlinear optimization. A multistart approach is used to explore the solution space, and a hierarchical clustering procedure is implemented for statistically classifying potentially competing solutions. An example of methanol synthesis through hydrogenation of CO and CO2 on a Cu-based catalyst is used to illustrate the framework. The framework is fast, is robust, and can be used to comprehensively explore the model solution and design space of any heterogeneous catalytic system.

Authors:
 [1]; ORCiD logo [1]; ORCiD logo [1]
  1. Department of Chemical & Biological Engineering, University of Wisconsin-Madison, Madison, Wisconsin 53706, United States
Publication Date:
Research Org.:
Univ. of Wisconsin, Madison, WI (United States); University of Wisconsin-Madison, WI (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
Contributing Org.:
Pacific Northwest National Laboratory (PNNL); Argonne National Laboratory (ANL); National Energy Research Scientific Computing Center (NERSC)
OSTI Identifier:
1408149
Alternate Identifier(s):
OSTI ID: 1421604; OSTI ID: 1507711; OSTI ID: 1994820
Grant/Contract Number:  
FG02-05ER15731
Resource Type:
Published Article
Journal Name:
Journal of Physical Chemistry. C
Additional Journal Information:
Journal Name: Journal of Physical Chemistry. C Journal Volume: 121 Journal Issue: 46; Journal ID: ISSN 1932-7447
Publisher:
American Chemical Society
Country of Publication:
United States
Language:
English
Subject:
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY

Citation Formats

Rangarajan, Srinivas, Maravelias, Christos T., and Mavrikakis, Manos. Sequential-Optimization-Based Framework for Robust Modeling and Design of Heterogeneous Catalytic Systems. United States: N. p., 2017. Web. doi:10.1021/acs.jpcc.7b08089.
Rangarajan, Srinivas, Maravelias, Christos T., & Mavrikakis, Manos. Sequential-Optimization-Based Framework for Robust Modeling and Design of Heterogeneous Catalytic Systems. United States. https://doi.org/10.1021/acs.jpcc.7b08089
Rangarajan, Srinivas, Maravelias, Christos T., and Mavrikakis, Manos. Thu . "Sequential-Optimization-Based Framework for Robust Modeling and Design of Heterogeneous Catalytic Systems". United States. https://doi.org/10.1021/acs.jpcc.7b08089.
@article{osti_1408149,
title = {Sequential-Optimization-Based Framework for Robust Modeling and Design of Heterogeneous Catalytic Systems},
author = {Rangarajan, Srinivas and Maravelias, Christos T. and Mavrikakis, Manos},
abstractNote = {Here, we present a general optimization-based framework for (i) ab initio and experimental data driven mechanistic modeling and (ii) optimal catalyst design of heterogeneous catalytic systems. Both cases are formulated as a nonlinear optimization problem that is subject to a mean-field microkinetic model and thermodynamic consistency requirements as constraints, for which we seek sparse solutions through a ridge (L2 regularization) penalty. The solution procedure involves an iterative sequence of forward simulation of the differential algebraic equations pertaining to the microkinetic model using a numerical tool capable of handling stiff systems, sensitivity calculations using linear algebra, and gradient-based nonlinear optimization. A multistart approach is used to explore the solution space, and a hierarchical clustering procedure is implemented for statistically classifying potentially competing solutions. An example of methanol synthesis through hydrogenation of CO and CO2 on a Cu-based catalyst is used to illustrate the framework. The framework is fast, is robust, and can be used to comprehensively explore the model solution and design space of any heterogeneous catalytic system.},
doi = {10.1021/acs.jpcc.7b08089},
journal = {Journal of Physical Chemistry. C},
number = 46,
volume = 121,
place = {United States},
year = {Thu Nov 09 00:00:00 EST 2017},
month = {Thu Nov 09 00:00:00 EST 2017}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1021/acs.jpcc.7b08089

Citation Metrics:
Cited by: 39 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Single-Event MicroKinetics: Catalyst design for complex reaction networks
journal, December 2013


On the Kinetic Interpretation of DFT-Derived Energy Profiles: Cu-Catalyzed Methanol Synthesis
journal, November 2014

  • Janse van Rensburg, Werner; Petersen, Melissa A.; Datt, Michael S.
  • Catalysis Letters, Vol. 145, Issue 2
  • DOI: 10.1007/s10562-014-1407-1

Universal Brønsted-Evans-Polanyi Relations for C–C, C–O, C–N, N–O, N–N, and O–O Dissociation Reactions
journal, November 2010


Molecular-level descriptions of surface chemistry in kinetic models using density functional theory
journal, November 2004

  • Gokhale, Amit A.; Kandoi, Shampa; Greeley, Jeffrey P.
  • Chemical Engineering Science, Vol. 59, Issue 22-23
  • DOI: 10.1016/j.ces.2004.09.038

Scatter Search and Local NLP Solvers: A Multistart Framework for Global Optimization
journal, August 2007

  • Ugray, Zsolt; Lasdon, Leon; Plummer, John
  • INFORMS Journal on Computing, Vol. 19, Issue 3
  • DOI: 10.1287/ijoc.1060.0175

Large-scale nonlinear programming using IPOPT: An integrating framework for enterprise-wide dynamic optimization
journal, March 2009


Parameter Space Compression Underlies Emergent Theories and Predictive Models
journal, October 2013


A hybrid approach for efficient and robust parameter estimation in biochemical pathways
journal, February 2006


Parameter estimation for differential equations: a generalized smoothing approach: Parameter Estimation for Differential Equations
journal, October 2007

  • Ramsay, J. O.; Hooker, G.; Campbell, D.
  • Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 69, Issue 5
  • DOI: 10.1111/j.1467-9868.2007.00610.x

Modeling Ethanol Decomposition on Transition Metals: A Combined Application of Scaling and Brønsted−Evans−Polanyi Relations
journal, April 2009

  • Ferrin, P.; Simonetti, D.; Kandoi, S.
  • Journal of the American Chemical Society, Vol. 131, Issue 16
  • DOI: 10.1021/ja8099322

Regularization and variable selection via the elastic net
journal, April 2005


Nonlinear Programming
book, January 2010


Alloy catalysts designed from first principles
journal, October 2004

  • Greeley, Jeff; Mavrikakis, Manos
  • Nature Materials, Vol. 3, Issue 11
  • DOI: 10.1038/nmat1223

Kinetic modelling of heterogeneous catalytic systems
journal, November 2014


Effects of d -band shape on the surface reactivity of transition-metal alloys
journal, March 2014


Regression shrinkage and selection via the lasso: a retrospective: Regression Shrinkage and Selection via the Lasso
journal, April 2011


CatMAP: A Software Package for Descriptor-Based Microkinetic Mapping of Catalytic Trends
journal, February 2015


Ridge Regression: Biased Estimation for Nonorthogonal Problems
journal, February 1970


Large Sample Properties of Simulations Using Latin Hypercube Sampling
journal, May 1987


Kinetics of heterogeneous catalytic reactions: Analysis of reaction schemes
book, March 2001


Advanced solution methods for microkinetic models of catalytic reactions: A methanol synthesis case study
journal, December 2013

  • Rubert-Nason, Patricia; Mavrikakis, Manos; Maravelias, Christos T.
  • AIChE Journal, Vol. 60, Issue 4
  • DOI: 10.1002/aic.14322

First-Principles Microkinetic Modeling of Methane Oxidation over Pd(100) and Pd(111)
journal, September 2016


The Brønsted–Evans–Polanyi relation and the volcano curve in heterogeneous catalysis
journal, May 2004


Uncertainty Quantification Framework Applied to the Water–Gas Shift Reaction over Pt-Based Catalysts
journal, May 2016

  • Walker, Eric; Ammal, Salai Cheettu; Terejanu, Gabriel A.
  • The Journal of Physical Chemistry C, Vol. 120, Issue 19
  • DOI: 10.1021/acs.jpcc.6b01348

Theoretical Study of Methanol Synthesis from CO 2 Hydrogenation on Metal-Doped Cu(111) Surfaces
journal, December 2011

  • Yang, Yixiong; White, Michael G.; Liu, Ping
  • The Journal of Physical Chemistry C, Vol. 116, Issue 1
  • DOI: 10.1021/jp208448c

Mechanism of methanol synthesis from CO2/CO/H2 mixtures over copper/zinc oxide/alumina catalysts: use of14C-labelled reactants
journal, April 1987


SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers
journal, September 2005

  • Hindmarsh, Alan C.; Brown, Peter N.; Grant, Keith E.
  • ACM Transactions on Mathematical Software, Vol. 31, Issue 3
  • DOI: 10.1145/1089014.1089020

Optimization-based strategies for the operation of low-density polyethylene tubular reactors: nonlinear model predictive control
journal, October 2009


Insight into methanol synthesis from CO2 hydrogenation on Cu(111): Complex reaction network and the effects of H2O
journal, July 2011


Adjoint Sensitivity Analysis for Differential-Algebraic Equations: The Adjoint DAE System and Its Numerical Solution
journal, January 2003

  • Cao, Yang; Li, Shengtai; Petzold, Linda
  • SIAM Journal on Scientific Computing, Vol. 24, Issue 3
  • DOI: 10.1137/S1064827501380630

Software and algorithms for sensitivity analysis of large-scale differential algebraic systems
journal, December 2000


A Kinetic Model of Methanol Synthesis
journal, October 1995

  • Askgaard, T. S.; Norskov, J. K.; Ovesen, C. V.
  • Journal of Catalysis, Vol. 156, Issue 2
  • DOI: 10.1006/jcat.1995.1250

Rational Catalyst Design of Methanol Synthesis Catalysts
journal, November 2004

  • Kurtz, M.; Bauer, N.; Wilmer, H.
  • Chemical Engineering & Technology, Vol. 27, Issue 11
  • DOI: 10.1002/ceat.200407032

Sensitivity analysis of initial-boundary-value problems with mixed pdes and algebraic equations
journal, September 1995


Efficient sensitivity analysis of large-scale differential-algebraic systems
journal, October 1997


A Steady-State Kinetic Model for Methanol Synthesis and the Water Gas Shift Reaction on a Commercial Cu/ZnO/Al2O3Catalyst
journal, June 1996


A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code
journal, May 1979

  • McKay, M. D.; Beckman, R. J.; Conover, W. J.
  • Technometrics, Vol. 21, Issue 2
  • DOI: 10.2307/1268522

A review of multiscale modeling of metal-catalyzed reactions: Mechanism development for complexity and emergent behavior
journal, October 2011

  • Salciccioli, M.; Stamatakis, M.; Caratzoulas, S.
  • Chemical Engineering Science, Vol. 66, Issue 19
  • DOI: 10.1016/j.ces.2011.05.050

Global Optimization with Nonlinear Ordinary Differential Equations
journal, February 2006


CO and CO2 Hydrogenation to Methanol Calculated Using the BEEF-vdW Functional
journal, December 2012


Towards the computational design of solid catalysts
journal, April 2009

  • Nørskov, J.; Bligaard, T.; Rossmeisl, J.
  • Nature Chemistry, Vol. 1, Issue 1, p. 37-46
  • DOI: 10.1038/nchem.121

Using Krylov Methods in the Solution of Large-Scale Differential-Algebraic Systems
journal, November 1994

  • Brown, Peter N.; Hindmarsh, Alan C.; Petzold, Linda R.
  • SIAM Journal on Scientific Computing, Vol. 15, Issue 6
  • DOI: 10.1137/0915088

Parameter estimation from multiresponse data
journal, May 1992

  • Stewart, Warren E.; Caracotsios, Mike; Sørensen, Jan P.
  • AIChE Journal, Vol. 38, Issue 5
  • DOI: 10.1002/aic.690380502

Simultaneous solution and optimization strategies for parameter estimation of differential-algebraic equation systems
journal, February 1991

  • Tjoa, Iauw Bhieng; Biegler, Lorenz T.
  • Industrial & Engineering Chemistry Research, Vol. 30, Issue 2
  • DOI: 10.1021/ie00050a015

Mechanism of Methanol Synthesis on Cu through CO 2 and CO Hydrogenation
journal, February 2011

  • Grabow, L. C.; Mavrikakis, M.
  • ACS Catalysis, Vol. 1, Issue 4
  • DOI: 10.1021/cs200055d

Degree of Rate Control: How Much the Energies of Intermediates and Transition States Control Rates
journal, June 2009

  • Stegelmann, Carsten; Andreasen, Anders; Campbell, Charles T.
  • Journal of the American Chemical Society, Vol. 131, Issue 23
  • DOI: 10.1021/ja9000097

Uncertainty quantification for quantum chemical models of complex reaction networks
journal, January 2016

  • Proppe, Jonny; Husch, Tamara; Simm, Gregor N.
  • Faraday Discussions, Vol. 195
  • DOI: 10.1039/C6FD00144K

Global Optimization for the Parameter Estimation of Differential-Algebraic Systems
journal, May 2000

  • Esposito, William R.; Floudas, Christodoulos A.
  • Industrial & Engineering Chemistry Research, Vol. 39, Issue 5
  • DOI: 10.1021/ie990486w

A molecular view of heterogeneous catalysis
journal, May 2008

  • Christensen, Claus Hviid; Nørskov, Jens K.
  • The Journal of Chemical Physics, Vol. 128, Issue 18
  • DOI: 10.1063/1.2839299

An overview of simultaneous strategies for dynamic optimization
journal, November 2007

  • Biegler, Lorenz T.
  • Chemical Engineering and Processing: Process Intensification, Vol. 46, Issue 11
  • DOI: 10.1016/j.cep.2006.06.021

DAEPACK:  An Open Modeling Environment for Legacy Models
journal, June 2000

  • Tolsma, John; Barton, Paul I.
  • Industrial & Engineering Chemistry Research, Vol. 39, Issue 6
  • DOI: 10.1021/ie990734o

Discovery of a Ni-Ga catalyst for carbon dioxide reduction to methanol
journal, March 2014

  • Studt, Felix; Sharafutdinov, Irek; Abild-Pedersen, Frank
  • Nature Chemistry, Vol. 6, Issue 4
  • DOI: 10.1038/nchem.1873

Asymptotic Theory of Certain "Goodness of Fit" Criteria Based on Stochastic Processes
journal, June 1952

  • Anderson, T. W.; Darling, D. A.
  • The Annals of Mathematical Statistics, Vol. 23, Issue 2
  • DOI: 10.1214/aoms/1177729437

The Mechanism of CO and CO 2 Hydrogenation to Methanol over Cu-Based Catalysts
journal, March 2015


Future Directions and Industrial Perspectives Micro- and macro-kinetics: Their relationship in heterogeneous catalysis
journal, September 1994


Nonlinear parameter estimation: A case study comparison
journal, January 1986


A hybrid genetic algorithm for efficient parameter estimation of large kinetic models
journal, November 2004


Parameter Estimation in Biochemical Pathways: A Comparison of Global Optimization Methods
journal, November 2003


Global energy & emissions reduction potential of chemical process improvements
journal, December 2015


Kinetics of low-pressure methanol synthesis
journal, January 1988


Large-Scale Parameter Estimation in Low-Density Polyethylene Tubular Reactors
journal, November 2006

  • Zavala, Victor M.; Biegler, Lorenz T.
  • Industrial & Engineering Chemistry Research, Vol. 45, Issue 23
  • DOI: 10.1021/ie060338n

Universally Sloppy Parameter Sensitivities in Systems Biology Models
journal, January 2007

  • Gutenkunst, Ryan N.; Waterfall, Joshua J.; Casey, Fergal P.
  • PLoS Computational Biology, Vol. 3, Issue 10
  • DOI: 10.1371/journal.pcbi.0030189

Methanol synthesis: a short review of technology improvements
journal, January 2001


Ab Initio Thermodynamics and First-Principles Microkinetics for Surface Catalysis
journal, January 2016


Formic acid decomposition on Au catalysts: DFT, microkinetic modeling, and reaction kinetics experiments
journal, February 2014

  • Singh, Suyash; Li, Sha; Carrasquillo-Flores, Ronald
  • AIChE Journal, Vol. 60, Issue 4
  • DOI: 10.1002/aic.14401

Assessing the reliability of calculated catalytic ammonia synthesis rates
journal, July 2014


Reactivity Theory of Transition-Metal Surfaces: A Brønsted−Evans−Polanyi Linear Activation Energy−Free-Energy Analysis
journal, December 2009

  • van Santen, Rutger A.; Neurock, Matthew; Shetty, Sharan G.
  • Chemical Reviews, Vol. 110, Issue 4
  • DOI: 10.1021/cr9001808

Scaling relations between adsorption energies for computational screening and design of catalysts
journal, January 2014

  • Montemore, Matthew M.; Medlin, J. Will
  • Catal. Sci. Technol., Vol. 4, Issue 11
  • DOI: 10.1039/C4CY00335G

Methanol synthesis on Cu(100) from a binary gas mixture of CO2 and H2
journal, January 1994

  • Rasmussen, P. B.; Holmblad, P. M.; Askgaard, T.
  • Catalysis Letters, Vol. 26, Issue 3-4
  • DOI: 10.1007/BF00810611

Towards full one-pass conversion of carbon dioxide to methanol and methanol-derived products
journal, January 2014


A Test of Goodness of Fit
journal, December 1954


Covariance Matrices for Parameter Estimates of Constrained Parameter Estimation Problems
journal, January 2007

  • Bock, Hans Georg; Kostina, Ekaterina; Kostyukova, Olga
  • SIAM Journal on Matrix Analysis and Applications, Vol. 29, Issue 2
  • DOI: 10.1137/040617893

Towards rational catalyst design: a general optimization framework
journal, February 2016

  • Wang, Ziyun; Hu, P.
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 374, Issue 2061
  • DOI: 10.1098/rsta.2015.0078

Finding the Rate-Determining Step in a Mechanism
journal, December 2001


A review of recent advances in global optimization
journal, August 2008


Hydrogenation of CO2 to methanol and CO on Cu/ZnO/Al2O3: Is there a common intermediate or not?
journal, August 2015


A Combined Kinetic−Quantum Mechanical Model for Assessment of Catalytic Cycles:  Application to Cross-Coupling and Heck Reactions
journal, March 2006

  • Kozuch, Sebastian; Shaik, Sason
  • Journal of the American Chemical Society, Vol. 128, Issue 10
  • DOI: 10.1021/ja0559146

How to Conceptualize Catalytic Cycles? The Energetic Span Model
journal, February 2011

  • Kozuch, Sebastian; Shaik, Sason
  • Accounts of Chemical Research, Vol. 44, Issue 2
  • DOI: 10.1021/ar1000956

Microkinetic modeling of propane aromatization over HZSM-5
journal, October 2005


Scaling Properties of Adsorption Energies for Hydrogen-Containing Molecules on Transition-Metal Surfaces
journal, July 2007


Adsorbate Entropies with Complete Potential Energy Sampling in Microkinetic Modeling
journal, March 2017

  • Jørgensen, Mikkel; Grönbeck, Henrik
  • The Journal of Physical Chemistry C, Vol. 121, Issue 13
  • DOI: 10.1021/acs.jpcc.6b11487

Sensitivity analysis of initial value problems with mixed odes and algebraic equations
journal, January 1985


The Active Site of Methanol Synthesis over Cu/ZnO/Al2O3 Industrial Catalysts
journal, April 2012


A general and robust approach for defining and solving microkinetic catalytic systems
journal, September 2014

  • Gusmão, Gabriel S.; Christopher, Phillip
  • AIChE Journal, Vol. 61, Issue 1
  • DOI: 10.1002/aic.14627

Departures from the Adsorption Energy Scaling Relations for Metal Carbide Catalysts
journal, June 2014

  • Michalsky, Ronald; Zhang, Yin-Jia; Medford, Andrew J.
  • The Journal of Physical Chemistry C, Vol. 118, Issue 24
  • DOI: 10.1021/jp503756g

Numerical Methods for Parameter Estimation in Nonlinear Differential Algebraic Equations
journal, August 2007

  • Bock, Hans Georg; Kostina, Ekaterina; Schlöder, Johannes P.
  • GAMM-Mitteilungen, Vol. 30, Issue 2
  • DOI: 10.1002/gamm.200790024

Modeling of the Kinetics for Methanol Synthesis using Cu/ZnO/Al 2 O 3 /ZrO 2 Catalyst: Influence of Carbon Dioxide during Hydrogenation
journal, December 2009

  • Lim, Hye-Won; Park, Myung-June; Kang, Suk-Hwan
  • Industrial & Engineering Chemistry Research, Vol. 48, Issue 23
  • DOI: 10.1021/ie901081f

Bayesian inference of chemical kinetic models from proposed reactions
journal, February 2015


Global Dynamic Optimization for Parameter Estimation in Chemical Kinetics
journal, January 2006

  • Singer, Adam B.; Taylor, James W.; Barton, Paul I.
  • The Journal of Physical Chemistry A, Vol. 110, Issue 3
  • DOI: 10.1021/jp0548873

Catalyst design: knowledge extraction from high-throughput experimentation
journal, May 2003


On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming
journal, April 2005