Perspectives on the integration between first-principles and data-driven modeling

Bradley, William; Kim, Jinhyeun; Kilwein, Zachary; Blakely, Logan; Eydenberg, Michael; Jalvin, Jordan; Laird, Carl; Boukouvala, Fani

doi:10.1016/j.compchemeng.2022.107898

Title: Perspectives on the integration between first-principles and data-driven modeling

Journal Article · Wed Jun 22 04:00:00 UTC 2022 · Computers and Chemical Engineering

DOI: https://doi.org/10.1016/j.compchemeng.2022.107898 · OSTI ID:1889102

^[1]; Kim, Jinhyeun ^[1]; Kilwein, Zachary ^[1]; Blakely, Logan ^[2]; Eydenberg, Michael ^[2]; Jalvin, Jordan ^[2]; Laird, Carl ^[2]; Boukouvala, Fani ^[1]

Georgia Institute of Technology, Atlanta, GA (United States)
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Efficiently embedding and/or integrating mechanistic information with data-driven models is essential if it is desired to simultaneously take advantage of both engineering principles and data-science. Further the opportunity for hybridization occurs in many scenarios, such as the development of a faster model of an accurate high-fidelity computer model; the correction of a mechanistic model that does not fully-capture the physical phenomena of the system; or the integration of a data-driven component approximating an unknown correlation within a mechanistic model. At the same time, different techniques have been proposed and applied in different literatures to achieve this hybridization, such as hybrid modeling, physics-informed Machine Learning (ML) and model calibration. In this paper we review the methods, challenges, applications and algorithms of these three research areas and discuss them in the context of the different hybridization scenarios. Moreover, we provide a comprehensive comparison of the hybridization techniques with respect to their differences and similarities, as well as advantages and limitations and future perspectives. Finally, we apply and illustrate hybrid modeling, physics-informed ML and model calibration via a chemical reactor case study.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA); National Network for Manufacturing Innovation (NNMI); National Science Foundation (NSF); Georgia Tech

OSTI ID:: 1889102

Report Number(s):: SAND2022-12844J; 710091

Journal Information:: Computers and Chemical Engineering, Journal Name: Computers and Chemical Engineering Vol. 166; ISSN 0098-1354

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (139)

An efficient model development strategy for bioprocesses based on neural networks in macroscopic balances van Can, H. J. L.; te Braake, H. A. B.; Hellinga, C. Biotechnology and Bioengineering, Vol. 54, Issue 6 https://doi.org/10.1002/(SICI)1097-0290(19970620)54:6<549::AID-BIT6>3.0.CO;2-J	journal	June 1997
An efficient model development strategy for bioprocesses based on neural networks in macroscopic balances: Part II van Can, H. J. L.; te Braake, H. A. B.; Bijman, A. Biotechnology and Bioengineering, Vol. 62, Issue 6 https://doi.org/10.1002/(SICI)1097-0290(19990320)62:6<666::AID-BIT6>3.0.CO;2-S	journal	March 1999
Process similarity and developing new process models through migration Lu, Junde; Yao, Ke; Gao, Furong AIChE Journal, Vol. 55, Issue 9 https://doi.org/10.1002/aic.11822	journal	September 2009
Learning surrogate models for simulation-based optimization Cozad, Alison; Sahinidis, Nikolaos V.; Miller, David C. AIChE Journal, Vol. 60, Issue 6 https://doi.org/10.1002/aic.14418	journal	March 2014
Uncertainty quantification via bayesian inference using sequential monte carlo methods for CO ₂ adsorption process Kalyanaraman, Jayashree; Kawajiri, Yoshiaki; Lively, Ryan P. AIChE Journal, Vol. 62, Issue 9 https://doi.org/10.1002/aic.15381	journal	July 2016
The promise of artificial intelligence in chemical engineering: Is it here, finally? Venkatasubramanian, Venkat AIChE Journal, Vol. 65, Issue 2 https://doi.org/10.1002/aic.16489	journal	December 2018
A framework of hybrid model development with identification of plant‐model mismatch Chen, Yingjie; Ierapetritou, Marianthi AIChE Journal, Vol. 66, Issue 10 https://doi.org/10.1002/aic.16996	journal	August 2020
A hybrid neural network-first principles approach to process modeling Psichogios, Dimitris C.; Ungar, Lyle H. AIChE Journal, Vol. 38, Issue 10 https://doi.org/10.1002/aic.690381003	journal	October 1992
Modeling chemical processes using prior knowledge and neural networks Thompson, Michael L.; Kramer, Mark A. AIChE Journal, Vol. 40, Issue 8 https://doi.org/10.1002/aic.690400806	journal	August 1994
Strategy for dynamic process modeling based on neural networks in macroscopic balances Van Can, Henricus J. L.; Hellinga, Chris; Luyben, Karel Ch. A. M. AIChE Journal, Vol. 42, Issue 12 https://doi.org/10.1002/aic.690421211	journal	December 1996
Understanding and applying the extrapolation properties of serial gray-box models Van Can, Henricus J. L.; Te Braake, Hubert A. B.; Dubbelman, Sander AIChE Journal, Vol. 44, Issue 5 https://doi.org/10.1002/aic.690440507	journal	May 1998
Towards a digital twin: a hybrid data‐driven and mechanistic digital shadow to forecast the evolution of lignocellulosic fermentation Lopez, Pau Cabaneros; Udugama, Isuru A.; Thomsen, Sune T. Biofuels, Bioproducts and Biorefining, Vol. 14, Issue 5 https://doi.org/10.1002/bbb.2108	journal	May 2020
Hybrid modeling for quality by design and PAT-benefits and challenges of applications in biopharmaceutical industry von Stosch, Moritz; Davy, Steven; Francois, Kjell Biotechnology Journal, Vol. 9, Issue 6 https://doi.org/10.1002/biot.201300385	journal	May 2014
Hybrid neural network modeling of a full-scale industrial wastewater treatment process Lee, Dae Sung; Jeon, Che Ok; Park, Jong Moon Biotechnology and Bioengineering, Vol. 78, Issue 6 https://doi.org/10.1002/bit.10247	journal	April 2002
Overview of Surrogate Modeling in Chemical Process Engineering McBride, Kevin; Sundmacher, Kai Chemie Ingenieur Technik, Vol. 91, Issue 3 https://doi.org/10.1002/cite.201800091	journal	January 2019
Hybrid Semi‐parametric Modeling in Separation Processes: A Review McBride, Kevin; Sanchez Medina, Edgar Ivan; Sundmacher, Kai Chemie Ingenieur Technik, Vol. 92, Issue 7 https://doi.org/10.1002/cite.202000025	journal	May 2020
The Potential of Hybrid Mechanistic/Data‐Driven Approaches for Reduced Dynamic Modeling: Application to Distillation Columns Schäfer, Pascal; Caspari, Adrian; Schweidtmann, Artur M. Chemie Ingenieur Technik, Vol. 92, Issue 12 https://doi.org/10.1002/cite.202000048	journal	October 2020
Neural-network-based approximations for solving partial differential equations Dissanayake, M. W. M. G.; Phan-Thien, N. Communications in Numerical Methods in Engineering, Vol. 10, Issue 3 https://doi.org/10.1002/cnm.1640100303	journal	March 1994
On the Statistical Calibration of Physical Models: STATISTICAL CALIBRATION OF PHYSICAL MODELS Sargsyan, K.; Najm, H. N.; Ghanem, R. International Journal of Chemical Kinetics, Vol. 47, Issue 4 https://doi.org/10.1002/kin.20906	journal	February 2015
Physics-Informed Learning Machines for Partial Differential Equations: Gaussian Processes Versus Neural Networks Pang, Guofei; Karniadakis, George Em Emerging Frontiers in Nonlinear Science https://doi.org/10.1007/978-3-030-44992-6_14	book	January 2020
Linear Operators and Stochastic Partial Differential Equations in Gaussian Process Regression Särkkä, Simo Lecture Notes in Computer Science https://doi.org/10.1007/978-3-642-21738-8_20	book	January 2011
Variable selection using Gaussian process regression-based metrics for high-dimensional model approximation with limited data Lee, Kyungeun; Cho, Hyunkyoo; Lee, Ikjin Structural and Multidisciplinary Optimization, Vol. 59, Issue 5 https://doi.org/10.1007/s00158-018-2137-6	journal	November 2018
Review of statistical model calibration and validation—from the perspective of uncertainty structures Lee, Guesuk; Kim, Wongon; Oh, Hyunseok Structural and Multidisciplinary Optimization, Vol. 60, Issue 4 https://doi.org/10.1007/s00158-019-02270-2	journal	May 2019
A bootstrap-aggregated hybrid semi-parametric modeling framework for bioprocess development Pinto, José; de Azevedo, Cristiana Rodrigues; Oliveira, Rui Bioprocess and Biosystems Engineering, Vol. 42, Issue 11 https://doi.org/10.1007/s00449-019-02181-y	journal	August 2019
A constrained optimization method based on BP neural network Zhang, Li; Wang, Fulin; Sun, Ting Neural Computing and Applications, Vol. 29, Issue 2 https://doi.org/10.1007/s00521-016-2455-9	journal	July 2016
Convolutional neural network: a review of models, methodologies and applications to object detection Dhillon, Anamika; Verma, Gyanendra K. Progress in Artificial Intelligence, Vol. 9, Issue 2 https://doi.org/10.1007/s13748-019-00203-0	journal	December 2019
A novel reverse flow strategy for ethylbenzene dehydrogenation in a packed-bed reactor Snyder, Jon D.; Subramaniam, Bala Chemical Engineering Science, Vol. 49, Issue 24 https://doi.org/10.1016/0009-2509(94)00287-8	journal	December 1994
Bioprocess optimization and control: Application of hybrid modelling Schubert, Jörg; Simutis, Rimvydas; Dors, Michael Journal of Biotechnology, Vol. 35, Issue 1 https://doi.org/10.1016/0168-1656(94)90189-9	journal	June 1994
Neural network and hybrid model: a discussion about different modeling techniques to predict pulping degree with industrial data Aguiar, Helena Cristina; Filho, Rubens Maciel Chemical Engineering Science, Vol. 56, Issue 2 https://doi.org/10.1016/S0009-2509(00)00261-X	journal	January 2001
Knowledge-based hybrid modelling of a batch crystallisation when accounting for nucleation, growth and agglomeration phenomena Georgieva, P.; Meireles, M. J.; Feyo de Azevedo, S. Chemical Engineering Science, Vol. 58, Issue 16 https://doi.org/10.1016/S0009-2509(03)00260-4	journal	August 2003
Using hybrid neural networks in scaling up an FCC model from a pilot plant to an industrial unit Bollas, G. M.; Papadokonstadakis, S.; Michalopoulos, J. Chemical Engineering and Processing: Process Intensification, Vol. 42, Issue 8-9 https://doi.org/10.1016/S0255-2701(02)00206-4	journal	August 2003
Semi-mechanistic modeling of chemical processes with neural networks Braake, H. A. B. te; van Can, H. J. L.; Verbruggen, H. B. Engineering Applications of Artificial Intelligence, Vol. 11, Issue 4 https://doi.org/10.1016/S0952-1976(98)00011-6	journal	August 1998
Integrating Neural Networks with First Principles Models for Dynamic Modeling Su, Hong-Te; Bhat, N.; Minderman, P. A. IFAC Proceedings Volumes, Vol. 25, Issue 5 https://doi.org/10.1016/S1474-6670(17)51013-7	journal	April 1992
Calibration and uncertainty analysis for computer models – A meta-model based approach for integrated building energy simulation Manfren, Massimiliano; Aste, Niccolò; Moshksar, Reza Applied Energy, Vol. 103 https://doi.org/10.1016/j.apenergy.2012.10.031	journal	March 2013
Applications of hybrid models in chemical, petroleum, and energy systems: A systematic review Zendehboudi, Sohrab; Rezaei, Nima; Lohi, Ali Applied Energy, Vol. 228 https://doi.org/10.1016/j.apenergy.2018.06.051	journal	October 2018
A Gaussian process emulator approach for rapid contaminant characterization with an integrated multizone-CFD model Tagade, Piyush M.; Jeong, Byeong-Min; Choi, Han-Lim Building and Environment, Vol. 70 https://doi.org/10.1016/j.buildenv.2013.08.023	journal	December 2013
The validity domain of hybrid models and its application in process optimization Kahrs, O.; Marquardt, W. Chemical Engineering and Processing: Process Intensification, Vol. 46, Issue 11 https://doi.org/10.1016/j.cep.2007.02.031	journal	November 2007
Hybrid modeling of penicillin fermentation process based on least square support vector machine Wang, Xianfang; Chen, Jindong; Liu, Chunbo Chemical Engineering Research and Design, Vol. 88, Issue 4 https://doi.org/10.1016/j.cherd.2009.08.010	journal	April 2010
Physics-informed neural networks for hybrid modeling of lab-scale batch fermentation for β-carotene production using Saccharomyces cerevisiae Bangi, Mohammed Saad Faizan; Kao, Katy; Kwon, Joseph Sang-Il Chemical Engineering Research and Design, Vol. 179 https://doi.org/10.1016/j.cherd.2022.01.041	journal	March 2022
A better understanding of model updating strategies in validating engineering models Xiong, Ying; Chen, Wei; Tsui, Kwok-Leung Computer Methods in Applied Mechanics and Engineering, Vol. 198, Issue 15-16 https://doi.org/10.1016/j.cma.2008.11.023	journal	March 2009
Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks Kissas, Georgios; Yang, Yibo; Hwuang, Eileen Computer Methods in Applied Mechanics and Engineering, Vol. 358 https://doi.org/10.1016/j.cma.2019.112623	journal	January 2020
Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems Jagtap, Ameya D.; Kharazmi, Ehsan; Karniadakis, George Em Computer Methods in Applied Mechanics and Engineering, Vol. 365 https://doi.org/10.1016/j.cma.2020.113028	journal	June 2020
SciANN: A Keras/TensorFlow wrapper for scientific computations and physics-informed deep learning using artificial neural networks Haghighat, Ehsan; Juanes, Ruben Computer Methods in Applied Mechanics and Engineering, Vol. 373 https://doi.org/10.1016/j.cma.2020.113552	journal	January 2021
Combining first principles modelling and artificial neural networks: a general framework Oliveira, R. Computers & Chemical Engineering, Vol. 28, Issue 5 https://doi.org/10.1016/j.compchemeng.2004.02.014	journal	May 2004
Incremental identification of hybrid process models Kahrs, O.; Marquardt, W. Computers & Chemical Engineering, Vol. 32, Issue 4-5 https://doi.org/10.1016/j.compchemeng.2007.02.014	journal	April 2008
Identification of semi-parametric hybrid process models Yang, Aidong; Martin, Elaine; Morris, Julian Computers & Chemical Engineering, Vol. 35, Issue 1 https://doi.org/10.1016/j.compchemeng.2010.05.002	journal	January 2011
Hybrid semi-parametric modeling in process systems engineering: Past, present and future von Stosch, Moritz; Oliveira, Rui; Peres, Joana Computers & Chemical Engineering, Vol. 60 https://doi.org/10.1016/j.compchemeng.2013.08.008	journal	January 2014
Bayesian estimation of parametric uncertainties, quantification and reduction using optimal design of experiments for CO2 adsorption on amine sorbents Kalyanaraman, Jayashree; Fan, Yanfang; Labreche, Ying Computers & Chemical Engineering, Vol. 81 https://doi.org/10.1016/j.compchemeng.2015.04.028	journal	October 2015
The ALAMO approach to machine learning Wilson, Zachary T.; Sahinidis, Nikolaos V. Computers & Chemical Engineering, Vol. 106 https://doi.org/10.1016/j.compchemeng.2017.02.010	journal	November 2017
Simultaneous parameter identification and discrimination of the nonparametric structure of hybrid semi-parametric models Willis, Mark J.; von Stosch, Moritz Computers & Chemical Engineering, Vol. 104 https://doi.org/10.1016/j.compchemeng.2017.05.005	journal	September 2017
Advances in surrogate based modeling, feasibility analysis, and optimization: A review Bhosekar, Atharv; Ierapetritou, Marianthi Computers & Chemical Engineering, Vol. 108 https://doi.org/10.1016/j.compchemeng.2017.09.017	journal	January 2018
Machine learning: Overview of the recent progresses and implications for the process systems engineering field Lee, Jay H.; Shin, Joohyun; Realff, Matthew J. Computers & Chemical Engineering, Vol. 114 https://doi.org/10.1016/j.compchemeng.2017.10.008	journal	June 2018
Advances and opportunities in machine learning for process data analytics Qin, S. Joe; Chiang, Leo H. Computers & Chemical Engineering, Vol. 126 https://doi.org/10.1016/j.compchemeng.2019.04.003	journal	July 2019
Deep hybrid modeling of chemical process: Application to hydraulic fracturing Bangi, Mohammed Saad Faizan; Kwon, Joseph Sang-Il Computers & Chemical Engineering, Vol. 134 https://doi.org/10.1016/j.compchemeng.2019.106696	journal	March 2020
Hybrid Modeling in the Era of Smart Manufacturing Yang, Shu; Navarathna, Pranesh; Ghosh, Sambit Computers & Chemical Engineering, Vol. 140 https://doi.org/10.1016/j.compchemeng.2020.106874	journal	September 2020
Recent trends on hybrid modeling for Industry 4.0 Sansana, Joel; Joswiak, Mark N.; Castillo, Ivan Computers & Chemical Engineering, Vol. 151 https://doi.org/10.1016/j.compchemeng.2021.107365	journal	August 2021
Sobolev trained neural network surrogate models for optimization Tsay, Calvin Computers & Chemical Engineering, Vol. 153 https://doi.org/10.1016/j.compchemeng.2021.107419	journal	October 2021
Combining first principles with black-box techniques for reaction systems Chen, Libei; Hontoir, Yves; Huang, Dexian Control Engineering Practice, Vol. 12, Issue 7 https://doi.org/10.1016/j.conengprac.2003.09.006	journal	July 2004
Stepwise deterministic and stochastic calibration of an energy simulation model for an existing building Kim, Young-Jin; Park, Cheol-Soo Energy and Buildings, Vol. 133 https://doi.org/10.1016/j.enbuild.2016.10.009	journal	December 2016
An efficient method for the numerical integration of measured variable dependent ordinary differential equations de Azevedo, C. Rodrigues; Peres, J.; von Stosch, M. Engineering Applications of Artificial Intelligence, Vol. 38 https://doi.org/10.1016/j.engappai.2014.10.014	journal	February 2015
State–space modeling for control based on physics-informed neural networks Arnold, Florian; King, Rudibert Engineering Applications of Artificial Intelligence, Vol. 101 https://doi.org/10.1016/j.engappai.2021.104195	journal	May 2021
Model Migration through Bayesian Adjustments Luo, Linkai,; Gao, Furong, IFAC-PapersOnLine, Vol. 48, Issue 8 https://doi.org/10.1016/j.ifacol.2015.08.166	journal	January 2015
Parallel hybrid modeling methods for a full-scale cokes wastewater treatment plant Lee, Dae Sung; Vanrolleghem, Peter A.; Park, Jong Moon Journal of Biotechnology, Vol. 115, Issue 3 https://doi.org/10.1016/j.jbiotec.2004.09.001	journal	February 2005
Modelling and optimization of a recombinant BHK-21 cultivation process using hybrid grey-box systems Teixeira, A.; Cunha, A. E.; Clemente, J. J. Journal of Biotechnology, Vol. 118, Issue 3 https://doi.org/10.1016/j.jbiotec.2005.04.024	journal	August 2005
Selection of model discrepancy priors in Bayesian calibration Ling, You; Mullins, Joshua; Mahadevan, Sankaran Journal of Computational Physics, Vol. 276 https://doi.org/10.1016/j.jcp.2014.08.005	journal	November 2014
Inferring solutions of differential equations using noisy multi-fidelity data Raissi, Maziar; Perdikaris, Paris; Karniadakis, George Em Journal of Computational Physics, Vol. 335 https://doi.org/10.1016/j.jcp.2017.01.060	journal	April 2017
Machine learning of linear differential equations using Gaussian processes Raissi, Maziar; Perdikaris, Paris; Karniadakis, George Em Journal of Computational Physics, Vol. 348 https://doi.org/10.1016/j.jcp.2017.07.050	journal	November 2017
DGM: A deep learning algorithm for solving partial differential equations Sirignano, Justin; Spiliopoulos, Konstantinos Journal of Computational Physics, Vol. 375 https://doi.org/10.1016/j.jcp.2018.08.029	journal	December 2018
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations Raissi, M.; Perdikaris, P.; Karniadakis, G. E. Journal of Computational Physics, Vol. 378 https://doi.org/10.1016/j.jcp.2018.10.045	journal	February 2019
Physics-informed CoKriging: A Gaussian-process-regression-based multifidelity method for data-model convergence Yang, Xiu; Barajas-Solano, David; Tartakovsky, Guzel Journal of Computational Physics, Vol. 395 https://doi.org/10.1016/j.jcp.2019.06.041	journal	October 2019
A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems Meng, Xuhui; Karniadakis, George Em Journal of Computational Physics, Vol. 401 https://doi.org/10.1016/j.jcp.2019.109020	journal	January 2020
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks Jagtap, Ameya D.; Kawaguchi, Kenji; Karniadakis, George Em Journal of Computational Physics, Vol. 404 https://doi.org/10.1016/j.jcp.2019.109136	journal	March 2020
Hybrid FEM-NN models: Combining artificial neural networks with the finite element method Mitusch, Sebastian K.; Funke, Simon W.; Kuchta, Miroslav Journal of Computational Physics, Vol. 446 https://doi.org/10.1016/j.jcp.2021.110651	journal	December 2021
When and why PINNs fail to train: A neural tangent kernel perspective Wang, Sifan; Yu, Xinling; Perdikaris, Paris Journal of Computational Physics, Vol. 449 https://doi.org/10.1016/j.jcp.2021.110768	journal	January 2022
Hybrid modeling based on mechanistic and data-driven approaches for cane sugar crystallization Meng, Yanmei; Yu, Shuangshuang; Zhang, Jinlai Journal of Food Engineering, Vol. 257 https://doi.org/10.1016/j.jfoodeng.2019.03.026	journal	September 2019
A tutorial on Gaussian process regression: Modelling, exploring, and exploiting functions Schulz, Eric; Speekenbrink, Maarten; Krause, Andreas Journal of Mathematical Psychology, Vol. 85 https://doi.org/10.1016/j.jmp.2018.03.001	journal	August 2018
Bayesian calibration for electrochemical thermal model of lithium-ion cells Tagade, Piyush; Hariharan, Krishnan S.; Basu, Suman Journal of Power Sources, Vol. 320 https://doi.org/10.1016/j.jpowsour.2016.04.106	journal	July 2016
A general hybrid semi-parametric process control framework von Stosch, Moritz; Oliveira, Rui; Peres, Joana Journal of Process Control, Vol. 22, Issue 7 https://doi.org/10.1016/j.jprocont.2012.05.004	journal	August 2012
Economic nonlinear model predictive control using hybrid mechanistic data-driven models for optimal operation in real-time electricity markets: In-silico application to air separation processes Schäfer, Pascal; Caspari, Adrian; Mhamdi, Adel Journal of Process Control, Vol. 84 https://doi.org/10.1016/j.jprocont.2019.10.008	journal	December 2019
A comprehensive hybrid first principles/machine learning modeling framework for complex industrial processes Sun, Bei; Yang, Chunhua; Wang, Yalin Journal of Process Control, Vol. 86 https://doi.org/10.1016/j.jprocont.2019.11.012	journal	February 2020
Process structure-based recurrent neural network modeling for model predictive control of nonlinear processes Wu, Zhe; Rincon, David; Christofides, Panagiotis D. Journal of Process Control, Vol. 89 https://doi.org/10.1016/j.jprocont.2020.03.013	journal	May 2020
A review of combined approaches for prediction of short-term wind speed and power Tascikaraoglu, A.; Uzunoglu, M. Renewable and Sustainable Energy Reviews, Vol. 34 https://doi.org/10.1016/j.rser.2014.03.033	journal	June 2014
A review on time series forecasting techniques for building energy consumption Deb, Chirag; Zhang, Fan; Yang, Junjing Renewable and Sustainable Energy Reviews, Vol. 74 https://doi.org/10.1016/j.rser.2017.02.085	journal	July 2017
Hybrid differential equations: Integrating mechanistic and data-driven techniques for modelling of water systems Quaghebeur, Ward; Torfs, Elena; De Baets, Bernard Water Research, Vol. 213 https://doi.org/10.1016/j.watres.2022.118166	journal	April 2022
Construction of a Valid Domain for a Hybrid Model and Its Application to Dynamic Optimization with Controlled Exploration Bae, Jaehan; Lee, Hye ji; Jeong, Dong Hwi Industrial & Engineering Chemistry Research, Vol. 59, Issue 37 https://doi.org/10.1021/acs.iecr.0c02720	journal	August 2020
Two-Stage Approach to Parameter Estimation of Differential Equations Using Neural ODEs Bradley, William; Boukouvala, Fani Industrial & Engineering Chemistry Research, Vol. 60, Issue 45 https://doi.org/10.1021/acs.iecr.1c00552	journal	November 2021
What are artificial neural networks? Krogh, Anders Nature Biotechnology, Vol. 26, Issue 2 https://doi.org/10.1038/nbt1386	journal	February 2008
Machine learning for molecular and materials science Butler, Keith T.; Davies, Daniel W.; Cartwright, Hugh Nature, Vol. 559, Issue 7715 https://doi.org/10.1038/s41586-018-0337-2	journal	July 2018
Physics-informed machine learning Karniadakis, George Em; Kevrekidis, Ioannis G.; Lu, Lu Nature Reviews Physics, Vol. 3, Issue 6 https://doi.org/10.1038/s42254-021-00314-5	journal	May 2021
Multi-scale modeling of an amine sorbent fluidized bed adsorber with dynamic discrepancy reduced modeling Li, Kuijun; Mahapatra, Priyadarshi; Bhat, K. Sham Reaction Chemistry & Engineering, Vol. 2, Issue 4 https://doi.org/10.1039/C7RE00040E	journal	January 2017
Combining neural and conventional paradigms for modelling,prediction and control Agarwal, Mukul International Journal of Systems Science, Vol. 28, Issue 1 https://doi.org/10.1080/00207729708929364	journal	January 1997
Statistical Adjustments to Engineering Models Joseph, V. Roshan; Melkote, Shreyes N. Journal of Quality Technology, Vol. 41, Issue 4 https://doi.org/10.1080/00224065.2009.11917791	journal	October 2009
Engineering-Driven Statistical Adjustment and Calibration Joseph, V. Roshan; Yan, Huan Technometrics, Vol. 57, Issue 2 https://doi.org/10.1080/00401706.2014.902773	journal	April 2015
DISCRETE- vs. CONTINUOUS-TIME NONLINEAR SIGNAL PROCESSING OF Cu ELECTRODISSOLUTION DATA Rico-MartÍNez, R.; Krischer, K.; Kevrekidis, I. G. Chemical Engineering Communications, Vol. 118, Issue 1 https://doi.org/10.1080/00986449208936084	journal	November 1992
Bayesian Calibration of Inexact Computer Models Plumlee, Matthew Journal of the American Statistical Association, Vol. 112, Issue 519 https://doi.org/10.1080/01621459.2016.1211016	journal	July 2016
Upscaling Uncertainty with Dynamic Discrepancy for a Multi-Scale Carbon Capture System Bhat, K. Sham; Mebane, David S.; Mahapatra, Priyadarshi Journal of the American Statistical Association, Vol. 112, Issue 520 https://doi.org/10.1080/01621459.2017.1295863	journal	January 2017
Local Gaussian Process Approximation for Large Computer Experiments Gramacy, Robert B.; Apley, Daniel W. Journal of Computational and Graphical Statistics, Vol. 24, Issue 2 https://doi.org/10.1080/10618600.2014.914442	journal	April 2015
The Markov chain Monte Carlo revolution Diaconis, Persi Bulletin of the American Mathematical Society, Vol. 46, Issue 2 https://doi.org/10.1090/S0273-0979-08-01238-X	journal	November 2008
Local identification of scalar hybrid models with tree structure Fiedler, B.; Schuppert, A. IMA Journal of Applied Mathematics, Vol. 73, Issue 3 https://doi.org/10.1093/imamat/hxn011	journal	January 2008
Linking Gaussian process regression with data-driven manifold embeddings for nonlinear data fusion Lee, Seungjoon; Dietrich, Felix; Karniadakis, George E. Interface Focus, Vol. 9, Issue 3 https://doi.org/10.1098/rsfs.2018.0083	journal	April 2019
Artificial neural networks for solving ordinary and partial differential equations Lagaris, I. E.; Likas, A.; Fotiadis, D. I. IEEE Transactions on Neural Networks, Vol. 9, Issue 5 https://doi.org/10.1109/72.712178	journal	January 1998
Machine Learning With Big Data: Challenges and Approaches L'Heureux, Alexandra; Grolinger, Katarina; Elyamany, Hany F. IEEE Access, Vol. 5 https://doi.org/10.1109/ACCESS.2017.2696365	journal	January 2017
Incorporating Unmodeled Dynamics Into First-Principles Models Through Machine Learning Quaghebeur, Ward; Nopens, Ingmar; De Baets, Bernard IEEE Access, Vol. 9 https://doi.org/10.1109/ACCESS.2021.3055353	journal	January 2021
Hybrid dynamical systems Goebel, Rafal; Sanfelice, Ricardo G.; Teel, Andrew R. IEEE Control Systems, Vol. 29, Issue 2 https://doi.org/10.1109/MCS.2008.931718	journal	April 2009
Convolutional Neural Networks for Inverse Problems in Imaging: A Review McCann, Michael T.; Jin, Kyong Hwan; Unser, Michael IEEE Signal Processing Magazine, Vol. 34, Issue 6 https://doi.org/10.1109/MSP.2017.2739299	journal	November 2017
Physics-Informed Neural Networks for Power Systems Misyris, George S.; Venzke, Andreas; Chatzivasileiadis, Spyros 2020 IEEE Power & Energy Society General Meeting (PESGM) https://doi.org/10.1109/PESGM41954.2020.9282004	conference	August 2020
A Survey on Transfer Learning Pan, Sinno Jialin; Yang, Qiang IEEE Transactions on Knowledge and Data Engineering, Vol. 22, Issue 10 https://doi.org/10.1109/TKDE.2009.191	journal	October 2010
Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data Karpatne, Anuj; Atluri, Gowtham; Faghmous, James H. IEEE Transactions on Knowledge and Data Engineering, Vol. 29, Issue 10 https://doi.org/10.1109/TKDE.2017.2720168	journal	October 2017
A Novel Recurrent Neural Network for Solving Nonlinear Optimization Problems With Inequality Constraints IEEE Transactions on Neural Networks, Vol. 19, Issue 8 https://doi.org/10.1109/TNN.2008.2000273	journal	August 2008
Bayesian calibration of computer models Kennedy, Marc C.; O'Hagan, Anthony Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3 https://doi.org/10.1111/1467-9868.00294	journal	August 2001
Penalized Gaussian Process Regression and Classification for High-Dimensional Nonlinear Data Yi, G.; Shi, J. Q.; Choi, T. Biometrics, Vol. 67, Issue 4 https://doi.org/10.1111/j.1541-0420.2011.01576.x	journal	March 2011
Quantification of Model Uncertainty: Calibration, Model Discrepancy, and Identifiability Arendt, Paul D.; Apley, Daniel W.; Chen, Wei Journal of Mechanical Design, Vol. 134, Issue 10 https://doi.org/10.1115/1.4007390	journal	September 2012
On Sequential Sampling for Global Metamodeling in Engineering Design Jin, Ruichen; Chen, Wei; Sudjianto, Agus ASME 2002 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Volume 2: 28th Design Automation Conference https://doi.org/10.1115/DETC2002/DAC-34092	conference	January 2002
Multifidelity Information Fusion Algorithms for High-Dimensional Systems and Massive Data sets Perdikaris, Paris; Venturi, Daniele; Karniadakis, George Em SIAM Journal on Scientific Computing, Vol. 38, Issue 4 https://doi.org/10.1137/15M1055164	journal	January 2016
Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization Peherstorfer, Benjamin; Willcox, Karen; Gunzburger, Max SIAM Review, Vol. 60, Issue 3 https://doi.org/10.1137/16M1082469	journal	January 2018
fPINNs: Fractional Physics-Informed Neural Networks Pang, Guofei; Lu, Lu; Karniadakis, George Em SIAM Journal on Scientific Computing, Vol. 41, Issue 4 https://doi.org/10.1137/18M1229845	journal	January 2019
Combining Field Data and Computer Simulations for Calibration and Prediction Higdon, Dave; Kennedy, Marc; Cavendish, James C. SIAM Journal on Scientific Computing, Vol. 26, Issue 2 https://doi.org/10.1137/S1064827503426693	journal	January 2004
The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions Hochreiter, Sepp International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, Vol. 06, Issue 02 https://doi.org/10.1142/S0218488598000094	journal	April 1998
MapReduce: simplified data processing on large clusters Dean, Jeffrey; Ghemawat, Sanjay; Mehta, Brijesh Communications of the ACM, Vol. 51, Issue 1 https://doi.org/10.1145/1327452.1327492	journal	January 2008
Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profiles Jia, Xiaowei; Willard, Jared; Karpatne, Anuj ACM/IMS Transactions on Data Science, Vol. 2, Issue 3 https://doi.org/10.1145/3447814	journal	May 2021
Classification trees for problems with monotonicity constraints Potharst, R.; Feelders, A. J. ACM SIGKDD Explorations Newsletter, Vol. 4, Issue 1 https://doi.org/10.1145/568574.568577	journal	June 2002
Variable Selection for Gaussian Process Models in Computer Experiments Linkletter, Crystal; Bingham, Derek; Hengartner, Nicholas Technometrics, Vol. 48, Issue 4 https://doi.org/10.1198/004017006000000228	journal	November 2006
A Framework for Validation of Computer Models Bayarri, Maria J.; Berger, James O.; Paulo, Rui Technometrics, Vol. 49, Issue 2 https://doi.org/10.1198/004017007000000092	journal	May 2007
Effective model calibration via sensible variable identification and adjustment with application to composite fuselage simulation Wang, Yan; Yue, Xiaowei; Tuo, Rui The Annals of Applied Statistics, Vol. 14, Issue 4 https://doi.org/10.1214/20-AOAS1353	journal	December 2020
Development of a hybrid model for a partially known intracellular signaling pathway through correction term estimation and neural network modeling Lee, Dongheon; Jayaraman, Arul; Kwon, Joseph S. PLOS Computational Biology, Vol. 16, Issue 12 https://doi.org/10.1371/journal.pcbi.1008472	journal	December 2020
Physics-informed neural networks for solving nonlinear diffusivity and Biot’s equations Kadeethum, Teeratorn; Jørgensen, Thomas M.; Nick, Hamidreza M. PLOS ONE, Vol. 15, Issue 5 https://doi.org/10.1371/journal.pone.0232683	journal	May 2020
Empirical Evaluation of Bayesian Optimization in Parametric Tuning of Chaotic Systems Abbas, Mudassar; Ilin, Alexander; Solonen, Antti International Journal for Uncertainty Quantification, Vol. 6, Issue 6 https://doi.org/10.1615/Int.J.UncertaintyQuantification.2016016645	journal	January 2016
Introducing BACCO , an R Bundle for Bayesian Analysis of Computer Code Output Hankin, Robin K. S. Journal of Statistical Software, Vol. 14, Issue 16 https://doi.org/10.18637/jss.v014.i16	journal	January 2005
SAVE : An R Package for the Statistical Analysis of Computer Models Palomo, Jesús; Paulo, Rui; a-Donato, Gonzalo Garcí Journal of Statistical Software, Vol. 64, Issue 13 https://doi.org/10.18637/jss.v064.i13	journal	January 2015
Physics Informed Deep Learning for Flow and Transport in Porous Media Fraces, Cedric G.; Tchelepi, Hamdi Day 1 Tue, October 26, 2021 https://doi.org/10.2118/203934-MS	conference	October 2021
Universal Differential Equations for Scientific Machine Learning Rackauckas, Christopher; Ma, Yingbo; Martensen, Julius https://doi.org/10.21203/rs.3.rs-55125/v1	preprint	August 2020
Combined Mechanistic and Empirical Modelling Duarte, Belmiro; Saraiva, P. M.; Pantelides, C. C. International Journal of Chemical Reactor Engineering, Vol. 2, Issue 1 https://doi.org/10.2202/1542-6580.1128	journal	January 2004
Universal Kriging and Cokriging as a Regression Procedure Stein, A.; Corsten, L. C. A. Biometrics, Vol. 47, Issue 2 https://doi.org/10.2307/2532147	journal	June 1991
Physics-informed Machine Learning Method for Forecasting and Uncertainty Quantification of Partially Observed and Unobserved States in Power Grids Tartakovsky, Alexandre; Tipireddy, Ramakrishna Proceedings of the Annual Hawaii International Conference on System Sciences https://doi.org/10.24251/HICSS.2019.416	conference	January 2019
A survey on pre-processing techniques: Relevant issues in the context of environmental data mining Gibert, Karina; Sànchez–Marrè, Miquel; Izquierdo, Joaquín AI Communications, Vol. 29, Issue 6 https://doi.org/10.3233/AIC-160710	journal	December 2016
Methodologies and Advancements in the Calibration of Building Energy Models Fabrizio, Enrico; Monetti, Valentina Energies, Vol. 8, Issue 4 https://doi.org/10.3390/en8042548	journal	March 2015
Hybrid Process Models in Electrochemical Syntheses under Deep Uncertainty Francis-Xavier, Fenila; Kubannek, Fabian; Schenkendorf, René Processes, Vol. 9, Issue 4 https://doi.org/10.3390/pr9040704	journal	April 2021
Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations Karniadakis, Ameya D. Jagtap & George Em Communications in Computational Physics, Vol. 28, Issue 5 https://doi.org/10.4208/cicp.OA-2020-0164	journal	June 2020
Probabilistic programming in Python using PyMC3 Salvatier, John; Wiecki, Thomas V.; Fonnesbeck, Christopher PeerJ Computer Science, Vol. 2 https://doi.org/10.7717/peerj-cs.55	journal	January 2016

Similar Records

Predicting departure from nucleate boiling with advanced data- and physics-driven approaches

Technical Report · Fri Oct 12 04:00:00 UTC 2018 · OSTI ID:1651417

Zhao, Xingang

Calibrating hypersonic turbulence flow models with the HIFiRE-1 experiment using data-driven machine-learned models.

Journal Article · Fri Sep 16 04:00:00 UTC 2022 · Computer Methods in Applied Mechanics and Engineering · OSTI ID:1888549

Chowdhary, Kenny; Hoang, Chi; Lee, Kookjin; +3 more

A Comparative Study of Physics‐Informed and Data‐Driven Neural Networks for Compound Flood Simulation at River‐Ocean Interfaces: A Case Study of Hurricane Irene

Journal Article · Thu Oct 02 04:00:00 UTC 2025 · Journal of Geophysical Research: Machine Learning and Computation · OSTI ID:2997685

Feng, Dongyu; Tan, Zeli; Lin, Zihan; +3 more

Related Subjects

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY
dynamical systems
hybrid modeling
model calibration
physics-informed machine learning
process systems design/operations

Title: Perspectives on the integration between first-principles and data-driven modeling

Citation Formats

References (139)

Similar Records

Related Subjects