Title: Adaptive Online Multivariate Signal Extraction With Locally Weighted Robust Polynomial Regression

Journal Article · · Data Science in Science

High-frequency, multivariate data collected in real-time and used to control or make decisions regarding a process’ operation often contain some noise and outliers. Thus, a method to extract the signal is needed in order to reduce the number and magnitude of control-based adjustments that are implemented. Such a method must be (i) online, depending only on past and current observations; (ii) fast, producing a smooth value more quickly than the measurement frequency; (iii) robust, ignoring brief bursts of erroneously measured values; (iv) multivariate, ignoring observations that are jointly unusual; (v) adaptive, adjusting to periods of rapid fluctuation in the signal versus periods of stability; and (vi) purely data-driven, not incorporating any information about the process from which the data are collected. Most existing methods are only able to address a subset of these six features. Furthermore, we also require the method to be nonlinear, providing a local nonlinear estimate of the signal. In this work, we propose a novel, real-time signal extraction method based on a local, robust polynomial fit. We demonstrate the performance of our method compared to a state-of-the-art competitor through simulation. For illustration, the methodology is applied to data collected from a reverse osmosis water treatment process.

Research Organization:
National Alliance for Water Innovation (NAWI), Berkeley, CA (United States); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
National Science Foundation (NSF); USDOE Office of Energy Efficiency and Renewable Energy (EERE); USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Advanced Materials & Manufacturing Office (AMMTO); USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Advanced Materials & Manufacturing Technologies Office (AMMTO)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1973155
Journal Information:
Data Science in Science, Journal Name: Data Science in Science Journal Issue: 1 Vol. 2; ISSN 2694-1899
Publisher:
Taylor & Francis OnlineCopyright Statement
Country of Publication:
United States
Language:
English

References (31)

Robust Statistics book January 2009
Real-time signal processing by adaptive repeated median filters journal January 2009
Point Location book January 2008
Robust M–M unscented Kalman filtering for GPS/IMU navigation journal January 2019
Comparison of linear and nonlinear dimension reduction techniques for automated process monitoring of a decentralized wastewater treatment facility journal April 2016
M-estimator-based robust Kalman filter for systems with process modeling errors and rank deficient measurement models journal March 2015
Online signal extraction by robust regression in moving windows with data-adaptive width selection journal April 2013
Multivariate and multiscale monitoring of wastewater treatment operation journal October 2001
A general-purpose method for Pareto optimal placement of flow rate and concentration sensors in networked systems – With application to wastewater treatment plants journal August 2020
Robust online signal extraction from multivariate time series journal April 2010
Multivariate statistical monitoring of continuous wastewater treatment plants journal October 2008
Transforming data into knowledge for improved wastewater treatment operation: A critical review of techniques journal August 2018
Case studies in real-time fault isolation in a decentralized wastewater treatment facility journal December 2020
Structural redundancy of data from wastewater treatment systems. Determination of individual balance equations journal June 2014
Experimental design for evaluating WWTP data by linear mass balances journal October 2018
Data-driven performance analyses of wastewater treatment plants: A review journal June 2019
Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics journal January 1994
A robust version of Schwarz information criterion based on LTS conference January 2014
Robust Locally Weighted Regression and Smoothing Scatterplots journal December 1979
Multivariate Real-Time Signal Extraction by a Robust Adaptive Regression Filter journal January 2009
Robust Cubature Kalman Filter for Dynamic State Estimation of Synchronous Machines Under Unknown Measurement Noise Statistics journal January 2019
Robust Kalman Filter Based on a Generalized Maximum-Likelihood-Type Estimator journal May 2010
New Results in Linear Filtering and Prediction Theory journal March 1961
A New Approach to Linear Filtering and Prediction Problems journal March 1960
New extension of the Kalman filter to nonlinear systems conference July 1997
Weighted Repeated Median Smoothing and Filtering journal December 2007
Robust filters for intensive care monitoring: beyond the running median / Robuste Filter für intensivmedizinisches Monitoring: mehr als ein gleitender Median journal July 2006
Adding realism to simulated sensors and actuators journal February 2008
Dynamic mass balancing for wastewater treatment data quality control using CUSUM charts journal June 2012
Instrumentation, control and automation in wastewater – from London 1973 to Narbonne 2013 journal January 2014
Data Reconciliation for Wastewater Treatment Plant Simulation Studies-Planning for High-Quality Data and Typical Sources of Errors journal May 2010