Handling noisy data in sparse model identification using subsampling and co-teaching

Abdullah, Fahim; Wu, Zhe; Christofides, Panagiotis D.

doi:10.1016/j.compchemeng.2021.107628

Title: Handling noisy data in sparse model identification using subsampling and co-teaching

Journal Article · 31 December 2021 · Computers and Chemical Engineering

DOI: https://doi.org/10.1016/j.compchemeng.2021.107628 · OSTI ID:1868589

Abdullah, Fahim; Wu, Zhe; Christofides, Panagiotis D.

Not Available

View Accepted Manuscript (Publisher)

Cite

Export

Save

Sponsoring Organization:: USDOE

OSTI ID:: 1868589

Journal Information:: Computers and Chemical Engineering, Journal Name: Computers and Chemical Engineering Journal Issue: C Vol. 157; ISSN 0098-1354

Publisher:: ElsevierCopyright Statement

Country of Publication:: United Kingdom

Language:: English

References (74)

Data-driven model predictive quality control of batch processes Aumi, Siam; Corbett, Brandon; Clarke-Pringle, Tracy AIChE Journal, Vol. 59, Issue 8 https://doi.org/10.1002/aic.14063	journal	March 2013
Machine learning modeling and predictive control of nonlinear processes using noisy data Wu, Zhe; Rincon, David; Luo, Junwei AIChE Journal, Vol. 67, Issue 4 https://doi.org/10.1002/aic.17164	journal	January 2021
On the Stability and Accuracy of Least Squares Approximations Cohen, Albert; Davenport, Mark A.; Leviatan, Dany Foundations of Computational Mathematics, Vol. 13, Issue 5 https://doi.org/10.1007/s10208-013-9142-3	journal	March 2013
N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems Van Overschee, Peter; De Moor, Bart Automatica, Vol. 30, Issue 1 https://doi.org/10.1016/0005-1098(94)90230-5	journal	January 1994
Nonlinear total variation based noise removal algorithms Rudin, Leonid I.; Osher, Stanley; Fatemi, Emad Physica D: Nonlinear Phenomena, Vol. 60, Issue 1-4 https://doi.org/10.1016/0167-2789(92)90242-F	journal	November 1992
Identification of distributed parameter systems: A neural net based approach González-García, R.; Rico-Martínez, R.; Kevrekidis, I. G. Computers & Chemical Engineering, Vol. 22 https://doi.org/10.1016/S0098-1354(98)00191-4	journal	March 1998
Reduced-Rank ARX and Subspace System Identification for Process Control Juricek, Ben C.; Larimore, Wallace E.; Seborg, Dale E. IFAC Proceedings Volumes, Vol. 31, Issue 11 https://doi.org/10.1016/S1474-6670(17)44936-6	journal	June 1998
Data-based reduced-order modeling of nonlinear two-time-scale processes Abdullah, Fahim; Wu, Zhe; Christofides, Panagiotis D. Chemical Engineering Research and Design, Vol. 166 https://doi.org/10.1016/j.cherd.2020.11.009	journal	February 2021
Machine learning-based predictive control using noisy data: evaluating performance and robustness via a large-scale process simulator Wu, Zhe; Luo, Junwei; Rincon, David Chemical Engineering Research and Design, Vol. 168 https://doi.org/10.1016/j.cherd.2021.02.011	journal	April 2021
Coherence motivated sampling and convergence analysis of least squares polynomial Chaos regression Hampton, Jerrad; Doostan, Alireza Computer Methods in Applied Mechanics and Engineering, Vol. 290 https://doi.org/10.1016/j.cma.2015.02.006	journal	June 2015
Least squares polynomial chaos expansion: A review of sampling strategies Hadigol, Mohammad; Doostan, Alireza Computer Methods in Applied Mechanics and Engineering, Vol. 332 https://doi.org/10.1016/j.cma.2017.12.019	journal	April 2018
Sparse identification of nonlinear dynamical systems via reweighted ℓ 1 -regularized least squares Cortiella, Alexandre; Park, Kwang-Chun; Doostan, Alireza Computer Methods in Applied Mechanics and Engineering, Vol. 376 https://doi.org/10.1016/j.cma.2020.113620	journal	April 2021
Nonlinear model predictive control for distributed parameter systems using data driven artificial neural network models Aggelogiannaki, Eleni; Sarimveis, Haralambos Computers & Chemical Engineering, Vol. 32, Issue 6 https://doi.org/10.1016/j.compchemeng.2007.05.002	journal	June 2008
Data-driven predictive control for blast furnace ironmaking process Zeng, Jiu-sun; Gao, Chuan-hou; Su, Hong-ye Computers & Chemical Engineering, Vol. 34, Issue 11 https://doi.org/10.1016/j.compchemeng.2010.01.005	journal	November 2010
Optimization and control of a thin film growth process: A hybrid first principles/artificial neural network based multiscale modelling approach Chaffart, Donovan; Ricardez-Sandoval, Luis A. Computers & Chemical Engineering, Vol. 119 https://doi.org/10.1016/j.compchemeng.2018.08.029	journal	November 2018
Utilizing big data for batch process modeling and control Garg, Abhinav; Mhaskar, Prashant Computers & Chemical Engineering, Vol. 119 https://doi.org/10.1016/j.compchemeng.2018.09.013	journal	November 2018
Sparse-identification-based model predictive control of nonlinear two-time-scale processes Abdullah, Fahim; Wu, Zhe; Christofides, Panagiotis D. Computers & Chemical Engineering, Vol. 153 https://doi.org/10.1016/j.compchemeng.2021.107411	journal	October 2021
Nonlinear Bayesian state estimation: A review of recent developments Patwardhan, Sachin C.; Narasimhan, Shankar; Jagadeesan, Prakash Control Engineering Practice, Vol. 20, Issue 10 https://doi.org/10.1016/j.conengprac.2012.04.003	journal	October 2012
The restricted isometry property and its implications for compressed sensing Candès, Emmanuel J. Comptes Rendus Mathematique, Vol. 346, Issue 9-10, p. 589-592 https://doi.org/10.1016/j.crma.2008.03.014	journal	May 2008
Artificial Intelligence techniques applied as estimator in chemical process systems – A literature survey Mohd Ali, Jarinah; Hussain, M. A.; Tade, Moses O. Expert Systems with Applications, Vol. 42, Issue 14 https://doi.org/10.1016/j.eswa.2015.03.023	journal	August 2015
Sparse Legendre expansions via ℓ1-minimization Rauhut, Holger; Ward, Rachel Journal of Approximation Theory, Vol. 164, Issue 5 https://doi.org/10.1016/j.jat.2012.01.008	journal	May 2012
A non-adapted sparse approximation of PDEs with stochastic inputs Doostan, Alireza; Owhadi, Houman Journal of Computational Physics, Vol. 230, Issue 8 https://doi.org/10.1016/j.jcp.2011.01.002	journal	April 2011
Compressive sampling of polynomial chaos expansions: Convergence analysis and sampling strategies Hampton, Jerrad; Doostan, Alireza Journal of Computational Physics, Vol. 280 https://doi.org/10.1016/j.jcp.2014.09.019	journal	January 2015
On polynomial chaos expansion via gradient-enhanced ℓ1-minimization Peng, Ji; Hampton, Jerrad; Doostan, Alireza Journal of Computational Physics, Vol. 310 https://doi.org/10.1016/j.jcp.2015.12.049	journal	April 2016
Deep learning algorithm for data-driven simulation of noisy dynamical system Yeo, Kyongmin; Melnyk, Igor Journal of Computational Physics, Vol. 376 https://doi.org/10.1016/j.jcp.2018.10.024	journal	January 2019
Deep learning of dynamics and signal-noise decomposition with time-stepping constraints Rudy, Samuel H.; Nathan Kutz, J.; Brunton, Steven L. Journal of Computational Physics, Vol. 396 https://doi.org/10.1016/j.jcp.2019.06.056	journal	November 2019
SubTSBR to tackle high noise and outliers for data-driven discovery of differential equations Zhang, Sheng; Lin, Guang Journal of Computational Physics, Vol. 428 https://doi.org/10.1016/j.jcp.2020.109962	journal	March 2021
Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation Al Seyab, R. K.; Cao, Y. Journal of Process Control, Vol. 18, Issue 6 https://doi.org/10.1016/j.jprocont.2007.10.012	journal	July 2008
Tuning SISO offset-free Model Predictive Control based on ARX models Huusom, Jakob Kjøbsted; Poulsen, Niels Kjølstad; Jørgensen, Sten Bay Journal of Process Control, Vol. 22, Issue 10 https://doi.org/10.1016/j.jprocont.2012.08.007	journal	December 2012
Data-driven model reduction-based nonlinear MPC for large-scale distributed parameter systems Xie, Weiguo; Bonis, Ioannis; Theodoropoulos, Constantinos Journal of Process Control, Vol. 35 https://doi.org/10.1016/j.jprocont.2015.07.009	journal	November 2015
Nonlinear dynamical system identification using the sparse regression and separable least squares methods Lin, Miaomiao; Cheng, Changming; Peng, Zhike Journal of Sound and Vibration, Vol. 505 https://doi.org/10.1016/j.jsv.2021.116141	journal	August 2021
Long-term time series prediction with the NARX network: An empirical evaluation Menezes, José Maria P.; Barreto, Guilherme A. Neurocomputing, Vol. 71, Issue 16-18 https://doi.org/10.1016/j.neucom.2008.01.030	journal	October 2008
Synthesis of recurrent neural networks for dynamical system simulation Trischler, Adam P.; D’Eleuterio, Gabriele M. T. Neural Networks, Vol. 80 https://doi.org/10.1016/j.neunet.2016.04.001	journal	August 2016
Constrained sparse Galerkin regression Loiseau, Jean-Christophe; Brunton, Steven L. Journal of Fluid Mechanics, Vol. 838 https://doi.org/10.1017/jfm.2017.823	journal	January 2018
Real-Time Adaptive Machine-Learning-Based Predictive Control of Nonlinear Processes Wu, Zhe; Rincon, David; Christofides, Panagiotis D. Industrial & Engineering Chemistry Research, Vol. 59, Issue 6 https://doi.org/10.1021/acs.iecr.9b03055	journal	July 2019
A New Subspace Identification Approach Based on Principal Component Analysis and Noise Estimation Wu, Ping; Pan, HaiPeng; Ren, Jia Industrial & Engineering Chemistry Research, Vol. 54, Issue 18 https://doi.org/10.1021/ie504824a	journal	May 2015
Sparse identification of a predator-prey system from simulation data of a convection model Dam, Magnus; Brøns, Morten; Juul Rasmussen, Jens Physics of Plasmas, Vol. 24, Issue 2 https://doi.org/10.1063/1.4977057	journal	February 2017
Sparse learning of stochastic dynamical equations Boninsegna, Lorenzo; Nüske, Feliks; Clementi, Cecilia The Journal of Chemical Physics, Vol. 148, Issue 24 https://doi.org/10.1063/1.5018409	journal	June 2018
Sparse identification of nonlinear dynamics for rapid model recovery Quade, Markus; Abel, Markus; Nathan Kutz, J. Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 28, Issue 6 https://doi.org/10.1063/1.5027470	journal	June 2018
How entropic regression beats the outliers problem in nonlinear system identification AlMomani, Abd AlRahman R.; Sun, Jie; Bollt, Erik Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 30, Issue 1 https://doi.org/10.1063/1.5133386	journal	January 2020
Sparse dynamics for partial differential equations Schaeffer, H.; Caflisch, R.; Hauck, C. D. Proceedings of the National Academy of Sciences, Vol. 110, Issue 17 https://doi.org/10.1073/pnas.1302752110	journal	March 2013
Compressed modes for variational problems in mathematics and physics Ozolins, V.; Lai, R.; Caflisch, R. Proceedings of the National Academy of Sciences, Vol. 110, Issue 46 https://doi.org/10.1073/pnas.1318679110	journal	October 2013
Discovering governing equations from data by sparse identification of nonlinear dynamical systems Brunton, Steven L.; Proctor, Joshua L.; Kutz, J. Nathan Proceedings of the National Academy of Sciences, Vol. 113, Issue 15 https://doi.org/10.1073/pnas.1517384113	journal	March 2016
Learning partial differential equations via data discovery and sparse optimization Schaeffer, Hayden Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 473, Issue 2197 https://doi.org/10.1098/rspa.2016.0446	journal	January 2017
Model selection for dynamical systems via sparse regression and information criteria Mangan, N. M.; Kutz, J. N.; Brunton, S. L. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 473, Issue 2204 https://doi.org/10.1098/rspa.2017.0009	journal	August 2017
Robust data-driven discovery of governing physical laws with error bars Zhang, Sheng; Lin, Guang Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 474, Issue 2217 https://doi.org/10.1098/rspa.2018.0305	journal	September 2018
Sparse identification of nonlinear dynamics for model predictive control in the low-data limit Kaiser, E.; Kutz, J. N.; Brunton, S. L. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 474, Issue 2219 https://doi.org/10.1098/rspa.2018.0335	journal	November 2018
Model selection for hybrid dynamical systems via sparse regression Mangan, N. M.; Askham, T.; Brunton, S. L. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 475, Issue 2223 https://doi.org/10.1098/rspa.2018.0534	journal	March 2019
SINDy-PI: a robust algorithm for parallel implicit sparse identification of nonlinear dynamics Kaheman, Kadierdan; Kutz, J. Nathan; Brunton, Steven L. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 476, Issue 2242 https://doi.org/10.1098/rspa.2020.0279	journal	October 2020
Sparse model selection via integral terms Schaeffer, Hayden; McCalla, Scott G. Physical Review E, Vol. 96, Issue 2 https://doi.org/10.1103/PhysRevE.96.023302	journal	August 2017
Predicting Catastrophes in Nonlinear Dynamical Systems by Compressive Sensing Wang, Wen-Xu; Yang, Rui; Lai, Ying-Cheng Physical Review Letters, Vol. 106, Issue 15 https://doi.org/10.1103/PhysRevLett.106.154101	journal	April 2011
Computational capabilities of recurrent NARX neural networks Siegelmann, H. T.; Horne, B. G.; Giles, C. L. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 27, Issue 2 https://doi.org/10.1109/3477.558801	journal	April 1997
High-order neural network structures for identification of dynamical systems Kosmatopoulos, E. B.; Polycarpou, M. M.; Christodoulou, M. A. IEEE Transactions on Neural Networks, Vol. 6, Issue 2 https://doi.org/10.1109/72.363477	journal	March 1995
A Unified Framework for Sparse Relaxed Regularized Regression: SR3 Zheng, Peng; Askham, Travis; Brunton, Steven L. IEEE Access, Vol. 7 https://doi.org/10.1109/ACCESS.2018.2886528	journal	January 2019
Inferring Biological Networks by Sparse Identification of Nonlinear Dynamics Mangan, Niall M.; Brunton, Steven L.; Proctor, Joshua L. IEEE Transactions on Molecular, Biological and Multi-Scale Communications, Vol. 2, Issue 1 https://doi.org/10.1109/TMBMC.2016.2633265	journal	June 2016
Symbolic Regression for Data-Driven Dynamic Model Refinement in Power Systems Saria, Andrija T.; Saric, Aleksandar A.; Transtrum, Mark K. IEEE Transactions on Power Systems, Vol. 36, Issue 3 https://doi.org/10.1109/TPWRS.2020.3033261	journal	May 2021
Data-driven discovery of partial differential equations Rudy, Samuel H.; Brunton, Steven L.; Proctor, Joshua L. Science Advances, Vol. 3, Issue 4 https://doi.org/10.1126/sciadv.1602614	journal	April 2017
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images Bruckstein, Alfred M.; Donoho, David L.; Elad, Michael SIAM Review, Vol. 51, Issue 1, p. 34-81 https://doi.org/10.1137/060657704	journal	February 2009
Compressive Sensing and Low-Rank Libraries for Classification of Bifurcation Regimes in Nonlinear Dynamical Systems Brunton, Steven L.; Tu, Jonathan H.; Bright, Ido SIAM Journal on Applied Dynamical Systems, Vol. 13, Issue 4 https://doi.org/10.1137/130949282	journal	January 2014
On the Compressive Spectral Method Mackey, Alan; Schaeffer, Hayden; Osher, Stanley Multiscale Modeling & Simulation, Vol. 12, Issue 4 https://doi.org/10.1137/140965909	journal	January 2014
Exact Recovery of Chaotic Systems from Highly Corrupted Data Tran, Giang; Ward, Rachel Multiscale Modeling & Simulation, Vol. 15, Issue 3 https://doi.org/10.1137/16M1086637	journal	January 2017
Extracting Sparse High-Dimensional Dynamics from Limited Data Schaeffer, Hayden; Tran, Giang; Ward, Rachel SIAM Journal on Applied Mathematics, Vol. 78, Issue 6 https://doi.org/10.1137/18M116798X	journal	January 2018
Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings Champion, Kathleen P.; Brunton, Steven L.; Kutz, J. Nathan SIAM Journal on Applied Dynamical Systems, Vol. 18, Issue 1 https://doi.org/10.1137/18M1188227	journal	January 2019
On the Convergence of the SINDy Algorithm Zhang, Linan; Schaeffer, Hayden Multiscale Modeling & Simulation, Vol. 17, Issue 3 https://doi.org/10.1137/18M1189828	journal	January 2019
Extracting Structured Dynamical Systems Using Sparse Optimization With Very Few Samples Schaeffer, Hayden; Tran, Giang; Ward, Rachel Multiscale Modeling & Simulation, Vol. 18, Issue 4 https://doi.org/10.1137/18M1194730	journal	January 2020
Exploiting sparsity and equation-free architectures in complex systems Proctor, J. L.; Brunton, S. L.; Brunton, B. W. The European Physical Journal Special Topics, Vol. 223, Issue 13 https://doi.org/10.1140/epjst/e2014-02285-8	journal	December 2014
The Jackknife Estimate of Variance Efron, B.; Stein, C. The Annals of Statistics, Vol. 9, Issue 3 https://doi.org/10.1214/aos/1176345462	journal	May 1981
Low-Dimensional Approach for Reconstruction of Airfoil Data via Compressive Sensing Bai, Zhe; Wimalajeewa, Thakshila; Berger, Zachary AIAA Journal, Vol. 53, Issue 4 https://doi.org/10.2514/1.J053287	journal	April 2015
Identification of ARX and ARARX Models in the Presence of Input and Output Noises Diversi, Roberto; Guidorzi, Roberto; Soverini, Umberto European Journal of Control, Vol. 16, Issue 3 https://doi.org/10.3166/ejc.16.242-255	journal	January 2010
Discovery of Physics From Data: Universal Laws and Discrepancies de Silva, Brian M.; Higdon, David M.; Brunton, Steven L. Frontiers in Artificial Intelligence, Vol. 3 https://doi.org/10.3389/frai.2020.00025	journal	April 2020
Reconstruction of Governing Equations from Vibration Measurements for Geometrically Nonlinear Systems Didonna, Marco; Stender, Merten; Papangelo, Antonio Lubricants, Vol. 7, Issue 8 https://doi.org/10.3390/lubricants7080064	journal	August 2019
Recurrent Neural Network-Based Model Predictive Control for Continuous Pharmaceutical Manufacturing Wong, Wee; Chee, Ewan; Li, Jiali Mathematics, Vol. 6, Issue 11 https://doi.org/10.3390/math6110242	journal	November 2018
Real-Time Optimization and Control of Nonlinear Processes Using Machine Learning Zhang, Zhihao; Wu, Zhe; Rincon, David Mathematics, Vol. 7, Issue 10 https://doi.org/10.3390/math7100890	journal	September 2019
Numerical Differentiation of Noisy, Nonsmooth Data Chartrand, Rick ISRN Applied Mathematics, Vol. 2011 https://doi.org/10.5402/2011/164564	journal	January 2011

Similar Records

Modeling noisy quantum circuits using experimental characterization

Journal Article · 2021 · Physical Review A · OSTI ID:1773922

Dahlhauser, Megan L.; Humble, Travis S.

Sparse-identification-based model predictive control of nonlinear two-time-scale processes

Journal Article · 2021 · Computers and Chemical Engineering · OSTI ID:1868757

Abdullah, Fahim; Wu, Zhe; Christofides, Panagiotis D.

A Computational Information Criterion for Particle-Tracking with Sparse or Noisy Data

Journal Article · 2021 · Advances in Water Resources · OSTI ID:1778026

Tran, Nhat V.; Benson, David A.; Schmidt, Michael J.; +1 more

Title: Handling noisy data in sparse model identification using subsampling and co-teaching

Citation Formats

References (74)

Similar Records

Related Subjects