DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Process prediction and detection of faults using probabilistic bidirectional recurrent neural networks on real plant data

Abstract

Abstract Attaining Industry 4.0 for manufacturing operations requires advanced monitoring systems and real‐time data analytics of plant data, among other topics. We propose a probabilistic bidirectional recurrent network (PBRN) for industrial process monitoring for the early detection of faults. The model is based on a gated recurrent unit (GRU) neural network that allows the model to retain long‐term dependencies between sensor data along a time horizon, hence learning the dynamic behavior of the process. To reduce the false‐positive detection rate of the model, we compel the model to learn from a highly noisy sensor reading while outputting noise‐free sensor outputs. The performance of the proposed model is compared with other data‐driven statistical process monitoring schemes using real plant data from an industrial air separations unit (ASU) containing noisy sensor readings. We show that the model can learn from noisy data without reducing its performance. Using two different fault cases, we demonstrate the model's ability to carry out early fault detection with average false‐positive rates of 2.9% and 4.9% for both fault cases. The missed detection rates are 0.1% and 0.2%, respectively.

Authors:
ORCiD logo [1];  [1];  [2];  [2];  [2];  [1]
  1. Rensselaer Polytechnic Inst., Troy, NY (United States)
  2. Linde, Inc., Tonawanda, NY (United States). Smart Operations, Center of Excellence (COE)
Publication Date:
Research Org.:
Univ. of California, Los Angeles, CA (United States)
Sponsoring Org.:
USDOE Office of Energy Efficiency and Renewable Energy (EERE); CESMII
OSTI Identifier:
1868938
Alternate Identifier(s):
OSTI ID: 1893184
Grant/Contract Number:  
EE0007613; 4550-G-WA324
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Advanced Manufacturing and Processing
Additional Journal Information:
Journal Volume: 4; Journal Issue: 4; Journal ID: ISSN 2637-403X
Publisher:
American Institute of Chemical Engineers (AIChE), Wiley
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; 32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION; Industry 4.0; Probabilistic bidirectional recurrent network; Gated recurrent unit; Air separation unit

Citation Formats

Yerimah, Lucky E., Ghosh, Sambit, Wang, Yajun, Cao, Yanan, Flores‐Cerrillo, Jesus, and Bequette, B. Wayne. Process prediction and detection of faults using probabilistic bidirectional recurrent neural networks on real plant data. United States: N. p., 2022. Web. doi:10.1002/amp2.10124.
Yerimah, Lucky E., Ghosh, Sambit, Wang, Yajun, Cao, Yanan, Flores‐Cerrillo, Jesus, & Bequette, B. Wayne. Process prediction and detection of faults using probabilistic bidirectional recurrent neural networks on real plant data. United States. https://doi.org/10.1002/amp2.10124
Yerimah, Lucky E., Ghosh, Sambit, Wang, Yajun, Cao, Yanan, Flores‐Cerrillo, Jesus, and Bequette, B. Wayne. Mon . "Process prediction and detection of faults using probabilistic bidirectional recurrent neural networks on real plant data". United States. https://doi.org/10.1002/amp2.10124. https://www.osti.gov/servlets/purl/1868938.
@article{osti_1868938,
title = {Process prediction and detection of faults using probabilistic bidirectional recurrent neural networks on real plant data},
author = {Yerimah, Lucky E. and Ghosh, Sambit and Wang, Yajun and Cao, Yanan and Flores‐Cerrillo, Jesus and Bequette, B. Wayne},
abstractNote = {Abstract Attaining Industry 4.0 for manufacturing operations requires advanced monitoring systems and real‐time data analytics of plant data, among other topics. We propose a probabilistic bidirectional recurrent network (PBRN) for industrial process monitoring for the early detection of faults. The model is based on a gated recurrent unit (GRU) neural network that allows the model to retain long‐term dependencies between sensor data along a time horizon, hence learning the dynamic behavior of the process. To reduce the false‐positive detection rate of the model, we compel the model to learn from a highly noisy sensor reading while outputting noise‐free sensor outputs. The performance of the proposed model is compared with other data‐driven statistical process monitoring schemes using real plant data from an industrial air separations unit (ASU) containing noisy sensor readings. We show that the model can learn from noisy data without reducing its performance. Using two different fault cases, we demonstrate the model's ability to carry out early fault detection with average false‐positive rates of 2.9% and 4.9% for both fault cases. The missed detection rates are 0.1% and 0.2%, respectively.},
doi = {10.1002/amp2.10124},
journal = {Journal of Advanced Manufacturing and Processing},
number = 4,
volume = 4,
place = {United States},
year = {2022},
month = {5}
}

Works referenced in this record:

Bidirectional recurrent neural networks
journal, January 1997

  • Schuster, M.; Paliwal, K. K.
  • IEEE Transactions on Signal Processing, Vol. 45, Issue 11
  • DOI: 10.1109/78.650093

Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders
journal, June 2018


Product property and production rate control of styrene polymerization
journal, April 2002


Hybrid Modeling in the Era of Smart Manufacturing
journal, September 2020


A novel dynamic PCA algorithm for dynamic data modeling and process monitoring
journal, July 2018


Dynamic modeling and collocation-based model reduction of cryogenic air separation units
journal, January 2016

  • Cao, Yanan; Swartz, Christopher L. E.; Flores-Cerrillo, Jesus
  • AIChE Journal, Vol. 62, Issue 5
  • DOI: 10.1002/aic.15164

Dynamic-Inner Partial Least Squares for Dynamic Data Modeling
journal, January 2015


Nonlinear process monitoring using kernel principal component analysis
journal, January 2004

  • Lee, Jong-Min; Yoo, ChangKyoo; Choi, Sang Wook
  • Chemical Engineering Science, Vol. 59, Issue 1
  • DOI: 10.1016/j.ces.2003.09.012

A combined canonical variate analysis and Fisher discriminant analysis (CVA–FDA) approach for fault diagnosis
journal, June 2015


Statistical process monitoring of a multiphase flow facility
journal, September 2015


Quantum computing assisted deep learning for fault detection and diagnosis in industrial process systems
journal, December 2020


Interpretation and compensation of backlash error data in machine centers for intelligent predictive maintenance using ANNs
journal, May 2015


Smart Manufacturing
journal, July 2015


Fault detection of process correlation structure using canonical variate analysis-based correlation features
journal, October 2017


Categorization of Anomalies in Smart Manufacturing Systems to Support the Selection of Detection Mechanisms
journal, October 2017

  • Lopez, Felipe; Saez, Miguel; Shao, Yuru
  • IEEE Robotics and Automation Letters, Vol. 2, Issue 4
  • DOI: 10.1109/LRA.2017.2714135

Smart manufacturing and energy systems
journal, June 2018


A novel process monitoring approach based on variational recurrent autoencoder
journal, October 2019


Information concentrated variational auto-encoder for quality-related nonlinear process monitoring
journal, October 2020


Long Short-Term Memory
journal, November 1997


Process monitoring using causal graphical models, with application to clogging detection in steel continuous casting
journal, September 2021


Geometric properties of partial least squares for process monitoring
journal, January 2010


Statistical process monitoring: basics and beyond
journal, January 2003

  • Joe Qin, S.
  • Journal of Chemometrics, Vol. 17, Issue 8-9
  • DOI: 10.1002/cem.800

Backpropagation through time: what it does and how to do it
journal, January 1990

  • Werbos, P. J.
  • Proceedings of the IEEE, Vol. 78, Issue 10
  • DOI: 10.1109/5.58337

Deep convolutional neural network model based chemical process fault diagnosis
journal, July 2018