DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A tutorial review of machine learning-based model predictive control methods

Journal Article · · Reviews in Chemical Engineering
ORCiD logo [1];  [2];  [1];  [1];  [3];  [3];  [3]
  1. Department of Chemical and Biomolecular Engineering , 37580 National University of Singapore , Singapore , Singapore
  2. Department of Chemical and Biomolecular Engineering, Department of Electrical and Computer Engineering , University of California , Los Angeles , CA , USA
  3. Department of Chemical and Biomolecular Engineering , University of California , Los Angeles , CA , USA

Abstract This tutorial review provides a comprehensive overview of machine learning (ML)-based model predictive control (MPC) methods, covering both theoretical and practical aspects. It provides a theoretical analysis of closed-loop stability based on the generalization error of ML models and addresses practical challenges such as data scarcity, data quality, the curse of dimensionality, model uncertainty, computational efficiency, and safety from both modeling and control perspectives. The application of these methods is demonstrated using a nonlinear chemical process example, with open-source code available on GitHub. The paper concludes with a discussion on future research directions in ML-based MPC.

Sponsoring Organization:
USDOE
OSTI ID:
2480589
Journal Information:
Reviews in Chemical Engineering, Journal Name: Reviews in Chemical Engineering Journal Issue: 4 Vol. 41; ISSN 0167-8299
Publisher:
Walter de Gruyter GmbHCopyright Statement
Country of Publication:
Germany
Language:
English

References (200)

Multi‐Parametric Optimization and Control book January 2021
Model predictive control of agro‐hydrological systems based on a two‐layer neural network modeling framework journal March 2023
Enhanced stability regions for model predictive control of nonlinear process systems journal April 2008
Machine learning‐based predictive control of nonlinear processes. Part I: Theory journal August 2019
Machine‐learning‐based predictive control of nonlinear processes. Part II: Computational implementation journal July 2019
Machine learning‐based distributed model predictive control of nonlinear processes journal September 2020
Machine learning modeling and predictive control of nonlinear processes using noisy data journal January 2021
Machine‐learning‐based construction of barrier functions and models for safe model predictive control journal October 2021
Safe model‐based reinforcement learning for nonlinear optimal control with state and input constraints journal January 2022
Online learning‐based predictive control of crystallization processes under batch‐to‐batch parametric drift journal July 2022
Online machine learning modeling and predictive control of nonlinear systems with scheduled mode transitions journal September 2022
Modeling and predictive control of nonlinear processes using transfer learning method journal March 2023
Encrypted model predictive control design for security to cyberattacks journal April 2023
Toward automatic generation of control structures for process flow diagrams with large language models journal October 2023
Control Lyapunov‐barrier function‐based safe reinforcement learning for nonlinear optimal control journal November 2023
Physics‐informed learning of chemical reactor systems using decoupling–coupling training framework journal March 2024
Integrating dynamic economic optimization and encrypted control for cyber‐resilient operation of nonlinear processes journal June 2024
Physics‐informed reinforcement learning for optimal control of nonlinear systems journal July 2024
Nonlinear principal component analysis using autoassociative neural networks journal February 1991
Dynamic process modeling with recurrent neural networks journal October 1993
Machine Learning an Intelligent Approach in Process Industries: A Perspective and Overview journal December 2022
Machine Learning in Chemical Engineering: A Perspective journal October 2021
Emerging methodologies in stability and optimization problems of learning‐based nonlinear model predictive control: A survey journal July 2022
Learning model predictive control with long short‐term memory networks journal April 2021
On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming journal April 2005
A branch-and-bound multi-parametric programming approach for non-convex multilevel optimization with polyhedral constraints journal July 2015
The exact solution of multiparametric quadratically constrained quadratic programming problems journal July 2020
A theory of learning from different domains journal October 2009
Regularisation of neural networks by enforcing Lipschitz continuity journal December 2020
Multi-scale analysis of exotic dynamics in surface catalyzed reactions—I journal January 1984
Artificial neural network models of knowledge representation in chemical engineering journal September 1988
Nonlinear principal component analysis—Based on principal curves and neural networks journal January 1996
A Quasi-Infinite Horizon Nonlinear Model Predictive Control Scheme with Guaranteed Stability∗∗This paper was not presented at any IFAC meeting. This paper was accepted for publication in revised form by Associate Editor W. Bequette under the direction of Editor Prof. S. Skogestad. journal October 1998
Constrained model predictive control: Stability and optimality journal June 2000
Neural network based approach for optimization of industrial chemical processes journal October 2000
Vapnik-Chervonenkis dimension of recurrent neural networks journal August 1998
A learning result for continuous-time recurrent neural networks journal June 1998
Adaptive, cautious, predictive control with gaussian process priors journal September 2003
Multi-zone building control with thermal comfort constraints under disjunctive uncertainty using data-driven robust model predictive control journal February 2023
Data-driven robust model predictive control for greenhouse temperature control and energy utilisation assessment journal August 2023
Real-time machine-learning-based optimization using Input Convex Long Short-Term Memory network journal January 2025
A brief survey on encrypted control: From the first to the second generation and beyond journal January 2023
Stabilization with guaranteed safety using Control Lyapunov–Barrier Function journal April 2016
Control Lyapunov-Barrier function-based model predictive control of nonlinear systems journal November 2019
Robust learning-based MPC for nonlinear constrained systems journal July 2020
Online learning based risk-averse stochastic MPC of constrained linear uncertain systems journal March 2021
Robust tube-based model predictive control with Koopman operators journal March 2022
Model based control of a yeast fermentation bioreactor using optimally designed artificial neural networks journal March 2007
Toxic gas release modeling for real-time analysis using variational autoencoder with convolutional neural networks journal May 2018
Simultaneous design & control of a reactive distillation system – A parametric optimization & control approach journal February 2021
Data-centric Engineering: integrating simulation, machine learning and statistics. Challenges and opportunities journal February 2022
Semi-supervised LSTM ladder autoencoder for chemical process fault diagnosis and localization journal April 2022
Maximizing information from chemical engineering data sets: Applications to machine learning journal April 2022
Time series prediction of hydrate dynamics on flow assurance using PCA and Recurrent neural networks with iterative transfer learning journal December 2022
Developing semi-supervised latent dynamic variational autoencoders to enhance prediction performance of product quality journal January 2023
Accelerating heat exchanger design by combining physics-informed deep learning and transfer learning journal December 2023
Optimization-based multi-source transfer learning for modeling of nonlinear processes journal August 2024
Machine learning-based adaptive model identification of systems: Application to a chemical process journal December 2019
Integrating dynamic neural network models with principal component analysis for adaptive model predictive control journal September 2020
An encoder–decoder LSTM-based EMPC framework applied to a building HVAC system journal August 2020
Decentralized machine-learning-based predictive control of nonlinear processes journal October 2020
Data-based reduced-order modeling of nonlinear two-time-scale processes journal February 2021
Machine learning-based predictive control using noisy data: evaluating performance and robustness via a large-scale process simulator journal April 2021
Physics-informed neural networks for hybrid modeling of lab-scale batch fermentation for β-carotene production using Saccharomyces cerevisiae journal March 2022
Neural network-based model predictive control for thin-film chemical deposition of quantum dots using data from a multiscale simulation journal July 2022
Machine learning-based ethylene concentration estimation, real-time optimization and feedback control of an experimental electrochemical reactor journal September 2022
Physics-informed machine learning modeling for predictive control using noisy data journal October 2022
Physics-informed machine learning for MPC: Application to a batch crystallization process journal April 2023
Real-time adaptive sparse-identification-based predictive control of nonlinear processes journal August 2023
Machine learning-based predictive control using on-line model linearization: Application to an experimental electrochemical reactor journal September 2023
Model predictive control of nonlinear processes using transfer learning-based recurrent neural networks journal May 2024
Model predictive control of switched nonlinear systems using online machine learning journal September 2024
Distributed model predictive control: A tutorial review and future research directions journal April 2013
Machine learning: Overview of the recent progresses and implications for the process systems engineering field journal June 2018
Wide spectrum feature selection (WiSe) for regression model building journal February 2019
A novel process monitoring approach based on variational recurrent autoencoder journal October 2019
ProGAN: Protein solubility generative adversarial nets for data augmentation in DNN framework journal December 2019
ReLU networks as surrogate models in mixed-integer linear programs journal December 2019
Control Lyapunov-Barrier function-based predictive control of nonlinear processes using machine learning modeling journal March 2020
A new unsupervised data mining method based on the stacked autoencoder for chemical process fault diagnosis journal April 2020
Integrating deep learning models and multiparametric programming journal May 2020
Stochastic data-driven model predictive control using gaussian processes journal August 2020
A review On reinforcement learning: Introduction and applications in industrial process control journal August 2020
Optimization-based control using input convex neural networks journal January 2021
Adaptive system identification of industrial ethylene splitter: A comparison of subspace identification and artificial neural networks journal April 2021
Sparse-identification-based model predictive control of nonlinear two-time-scale processes journal October 2021
Semi-supervised generative adversarial network with guaranteed safeness for industrial quality prediction journal October 2021
Handling noisy data in sparse model identification using subsampling and co-teaching journal January 2022
Statistical machine-learning-based predictive control using barrier functions for process operational safety journal July 2022
A tutorial review of neural network modeling approaches for model predictive control journal September 2022
Feature selection-based machine learning modeling for distributed model predictive control of nonlinear processes journal January 2023
Cybersecurity in process control, operations, and supply chain journal March 2023
Data-based modeling and control of nonlinear process systems using sparse identification: An overview of recent results journal June 2023
Control invariant set enhanced safe reinforcement learning: Improved sampling efficiency, guaranteed stability and robustness journal November 2023
Robust machine learning modeling for predictive control using Lipschitz-Constrained Neural Networks journal January 2024
Integrating machine learning detection and encrypted control for enhanced cybersecurity of nonlinear processes journal January 2024
Machine learning in process systems engineering: Challenges and opportunities journal February 2024
Explicit machine learning-based model predictive control of nonlinear processes via multi-parametric programming journal July 2024
A data enhancement method based on generative adversarial network for small sample-size with soft sensor application journal July 2024
Generative AI and process systems engineering: The next frontier journal August 2024
Privacy-preserving federated machine learning modeling and predictive control of heterogeneous nonlinear systems journal August 2024
An optimal experimental design framework for fast kinetic model identification based on artificial neural networks journal August 2024
A survey on feature selection methods journal January 2014
Secure and private control using semi-homomorphic encryption journal October 2017
Encrypted distributed model predictive control of nonlinear processes journal April 2024
A comprehensive survey and analysis of generative models in machine learning journal November 2020
Improving computational efficiency of machine learning modeling of nonlinear processes using sensitivity analysis and active learning journal June 2022
GP-based MPC with updating tube for safety control of unknown system journal September 2022
Hyperparameter optimization strategies for machine learning-based stochastic energy efficient scheduling in cyber-physical production systems journal September 2022
Dynamic risk-based process design and operational optimization via multi-parametric programming journal June 2023
Robust reduced-order machine learning modeling of high-dimensional nonlinear processes using noisy data journal June 2024
Data Analytics and Machine Learning for Smart Process Manufacturing: Recent Advances and Perspectives in the Big Data Era journal December 2019
Machine Learning in Chemical Engineering: Strengths, Weaknesses, Opportunities, and Threats journal September 2021
Process monitoring using variational autoencoder for high-dimensional nonlinear processes journal August 2019
State–space modeling for control based on physics-informed neural networks journal May 2021
Integrating Machine Learning and Model Predictive Control for automotive applications: A review and future directions journal April 2023
Generative adversarial network-based semi-supervised learning for real-time risk warning of process industries journal July 2020
Encrypting Controller using Fully Homomorphic Encryption for Security of Cyber-Physical Systems**The work of J. Kim, C. Lee, and H. Shim was supported by ICT R & D program of MSIP/IITP Grant number 14-824-09-013, Resilient Cyber-Physical Systems Research. The work of J. H. Cheon, A. Kim, M. Kim, and Y. Song was supported by IT R & D program of MSIP/KEIT [No. 0450-21060006] and Samsung Electronics Co., Ltd. (No. 0421-20150074). journal January 2016
Learning-based Nonlinear Model Predictive Control * *The authors would like to ackowledge to the Spanish MINECO Grant PRX15-00300 and projects DPI2013-48243-C2-2-R and DPI2016-76493-C3-1-R as well as to the Engineering and Physical Research Council, grant no. EP/J012300/1 for funding this work. journal July 2017
High-Efficiency Generative Adversarial Network Model for Chemical Process Fault Diagnosis journal January 2022
Utilizing Neural Networks for Image-based Model Predictive Controller of a batch Rotational Molding process journal January 2024
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
A stable MPC with zone control journal January 2009
Architectures for distributed and hierarchical Model Predictive Control – A review journal May 2009
MPC for tracking zone regions journal April 2010
Process structure-based recurrent neural network modeling for model predictive control of nonlinear processes journal May 2020
Laplacian regularized robust principal component analysis for process monitoring journal August 2020
On Recurrent Neural Networks for learning-based control: Recent results and ideas for future developments journal June 2022
Optimal temperature trajectory for tubular reactor using physics informed neural networks journal August 2023
Physics-informed recurrent neural network modeling for predictive control of nonlinear processes journal August 2023
A survey on federated learning journal March 2021
A multi-source information transfer learning method with subdomain adaptation for cross-domain fault diagnosis journal May 2022
Machine learning and its impact on control systems: A review journal January 2021
Online learning: A comprehensive survey journal October 2021
Physics-informed neural nets for control of dynamical systems journal April 2024
Stabilization of nonlinear systems with state and control constraints using Lyapunov-based predictive control journal August 2006
Cooperative distributed model predictive control journal August 2010
Safe economic model predictive control of nonlinear systems journal August 2018
Flow over an espresso cup: inferring 3-D velocity and pressure fields from tomographic background oriented Schlieren via physics-informed neural networks journal March 2021
Polymers for Extreme Conditions Designed Using Syntax-Directed Variational Autoencoders journal December 2020
Integrated Modeling of Transfer Learning and Intelligent Heuristic Optimization for a Steam Cracking Process journal August 2020
Random Forest and Autoencoder Data-Driven Models for Prediction of Dispersed-Phase Holdup and Drop Size in Rotating Disc Contactors journal December 2020
Improved Virtual Sample Generation Method Using Enhanced Conditional Generative Adversarial Networks with Cycle Structures for Soft Sensors with Limited Data journal December 2021
Machine Learning-Based Operational Modeling of an Electrochemical Reactor: Handling Data Variability and Improving Empirical Models journal January 2022
PemNet: A Transfer Learning-Based Modeling Approach of High-Temperature Polymer Electrolyte Membrane Electrochemical Systems journal February 2022
General Feature Extraction for Process Monitoring Using Transfer Learning Approaches journal April 2022
Physics-Based Neural Networks for Simulation and Synthesis of Cyclic Adsorption Processes journal March 2022
Machine Learning Modeling and Predictive Control of the Batch Crystallization Process journal April 2022
Modeling and Control of Nonlinear Processes Using Sparse Identification: Using Dropout to Handle Noisy Data journal November 2022
Physics-Informed Online Machine Learning and Predictive Control of Nonlinear Processes with Parameter Uncertainty journal January 2023
Modeling and Control of a Chemical Process Network Using Physics-Informed Transfer Learning journal July 2023
Fast Explicit Machine Learning-Based Model Predictive Control of Nonlinear Processes Using Input Convex Neural Networks journal September 2024
POP – Parametric Optimization Toolbox journal August 2016
110th Anniversary: An Overview on Learning-Based Model Predictive Control for Batch Processes journal August 2019
Real-Time Adaptive Machine-Learning-Based Predictive Control of Nonlinear Processes journal July 2019
Adaptive Modeling of Fixed-Bed Reactors with Multicycle and Multimode Characteristics Based on Transfer Learning and Just-In-Time Learning journal March 2020
Generative Adversarial Networks for Crystal Structure Prediction journal July 2020
Long-term predictions of chemical processes using recurrent neural networks: a parallel training approach journal May 1992
Stochastic co-teaching for training neural networks with unknown levels of label noise journal October 2023
Physics-informed machine learning journal May 2021
Industrial data science – a review of machine learning applications for chemical and process industries journal January 2022
Designing catalysts with deep generative models and computational data. A case study for Suzuki cross coupling reactions journal January 2023
Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs journal June 2021
Estimates on the generalization error of physics-informed neural networks for approximating PDEs journal January 2022
Neural Network Verification in Control conference December 2021
Boosting for transfer learning with multiple sources conference June 2010
Characterizing and Avoiding Negative Transfer conference June 2019
Achieving robustness in classification using optimal transport with hinge regularization conference June 2021
A Comprehensive Survey on Transfer Learning journal January 2021
Data-Driven Model Predictive Control With Stability and Robustness Guarantees journal April 2021
Guaranteed Closed-Loop Learning in Model Predictive Control journal February 2023
Semiclosed Greenhouse Climate Control Under Uncertainty via Machine Learning and Data-Driven Robust Model Predictive Control journal May 2022
Physics-Informed Neural Network Modeling and Predictive Control of District Heating Systems journal July 2024
Supervised Variational Autoencoders for Soft Sensor Modeling With Missing Data journal April 2020
A public key cryptosystem and a signature scheme based on discrete logarithms journal July 1985
A Survey on Transfer Learning journal October 2010
Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models journal January 2021
Weakly-Supervised Free Space Estimation through Stochastic Co-Teaching conference January 2022
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations journal January 2020
Feature Selection journal December 2017
Optuna: A Next-generation Hyperparameter Optimization Framework
  • Akiba, Takuya; Sano, Shotaro; Yanase, Toshihiko
  • KDD '19: The 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining https://doi.org/10.1145/3292500.3330701
conference July 2019
An Overview of Systems-Theoretic Guarantees in Data-Driven Model Predictive Control journal October 2024
Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning journal May 2022
Learning-Based Model Predictive Control: Toward Safe Learning in Control journal May 2020
Measuring the VC-Dimension of a Learning Machine journal September 1994
Long Short-Term Memory journal November 1997
Online Learning and Online Convex Optimization journal January 2011
Asymmetric Co-Teaching for Unsupervised Cross-Domain Person Re-Identification journal April 2020
Approximating Explicit Model Predictive Control Using Constrained Neural Networks conference June 2018
Data-Driven Control: Overview and Perspectives conference June 2022
Fusion of Machine Learning and MPC under Uncertainty: What Advances Are on the Horizon? conference June 2022
Synthesis of Data-Driven Nonlinear State Observers using Lipschitz-Bounded Neural Networks conference July 2024
A Two-Tier Encrypted Control Architecture for Enhanced Cybersecurity of Nonlinear Processes conference July 2024
Machine Learning Modeling of Nonlinear Processes with Lyapunov Stability Guarantees conference July 2024
Recurrent Neural Network based MPC for Process Industries conference June 2019
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
  • Cho, Kyunghyun; van Merrienboer, Bart; Gulcehre, Caglar
  • Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) https://doi.org/10.3115/v1/D14-1179
conference January 2014
Constructive Safety Using Control Barrier Functions journal January 2007
Recurrent Neural Network-Based Model Predictive Control for Continuous Pharmaceutical Manufacturing journal November 2018
Statistical Machine Learning in Model Predictive Control of Nonlinear Processes journal August 2021
Economic Model Predictive Control of Nonlinear Systems Using Online Learning of Neural Networks journal January 2023

Similar Records

A review on machine learning-guided design of energy materials
Journal Article · 2024 · Progress in Energy · OSTI ID:2439497

A Critical Review of Machine Learning of Energy Materials
Journal Article · 2020 · Advanced Energy Materials · OSTI ID:1595872

Uncertainty quantification in machine learning for engineering design and health prognostics: A tutorial
Journal Article · 2023 · Mechanical Systems and Signal Processing · OSTI ID:2320359

Related Subjects