skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Multivariate Time Series Anomaly Detection with Few Positive Samples

Conference · · 2022 International Joint Conference on Neural Networks (IJCNN)

Given the scarcity of anomalies in real-world applications, the majority of literature has been focusing on modeling normality. The learned representations enable anomaly detection as the normality model is trained to capture certain key underlying data regularities under normal circumstances. In practical settings, particularly industrial time series anomaly detection, we often encounter situations where a large amount of normal operation data is available along with a small number of anomaly events collected over time. This practical situation calls for methodologies to leverage these small number of anomaly events to create a better anomaly detector. In this paper, we introduce two methodologies to address the needs of this practical situation and compared them with recently developed state of the art techniques. Our proposed methods anchor on representative learning of normal operation with autoregressive (AR) model along with loss components to encourage representations that separate normal versus few positive examples. We applied the proposed methods to two industrial anomaly detection datasets and demonstrated effective performance in comparison with approaches from literature. Our study also points out additional challenges with adopting such methods in practical applications.

Research Organization:
GE Research
Sponsoring Organization:
USDOE
DOE Contract Number:
FE0031763
OSTI ID:
1905124
Report Number(s):
DOE-GER-FE0031763-5
Journal Information:
2022 International Joint Conference on Neural Networks (IJCNN), Conference: 2022 International Joint Conference on Neural Networks (IJCNN), Padua, Italy, 18-23 July 2022
Country of Publication:
United States
Language:
English

References (16)

Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network conference July 2019
Deep anomaly detection for industrial systems: a case study journal November 2020
Long Short-Term Memory journal November 1997
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
  • Cho, Kyunghyun; van Merrienboer, Bart; Gulcehre, Caglar
  • Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) https://doi.org/10.3115/v1/D14-1179
conference January 2014
A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder journal July 2018
Semi-supervised anomaly detection algorithms: A comparative summary and future research directions journal April 2021
Fault detection and identification using Bayesian recurrent neural networks journal October 2020
Anomaly detection: A survey journal July 2009
Subspace method aided data-driven design of fault detection and isolation systems journal October 2009
Disturbance detection and isolation by dynamic principal component analysis journal November 1995
Time-series novelty detection using one-class support vector machines conference January 2003
Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
  • Hundman, Kyle; Constantinou, Valentino; Laporte, Christopher
  • Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining https://doi.org/10.1145/3219819.3219845
conference July 2018
Anomaly Detection with Partially Observed Anomalies conference January 2018
ConNet: Deep Semi-Supervised Anomaly Detection Based on Sparse Positive Samples journal January 2021
A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process journal October 2012
A plant-wide industrial process control problem journal March 1993

Similar Records

MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series
Conference · Mon Jul 18 00:00:00 EDT 2022 · 2022 International Joint Conference on Neural Networks (IJCNN) · OSTI ID:1905124

Deep anomaly detection for industrial systems: a case study
Conference · Fri Nov 13 00:00:00 EST 2020 · OSTI ID:1905124

Self-Supervised Anomaly Detection via Neural Autoregressive Flows with Active Learning
Conference · Wed Dec 01 00:00:00 EST 2021 · OSTI ID:1905124

Related Subjects