DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: e RPCA : Robust Principal Component Analysis for Exponential Family Distributions

Journal Article · · Statistical Analysis and Data Mining
DOI: https://doi.org/10.1002/sam.11670 · OSTI ID:2329329
 [1]; ORCiD logo [1];  [2];  [3]
  1. Department of Statistical Science Duke University Durham North Carolina USA
  2. School of Data Science The Chinese University of Hong Kong Shenzhen China
  3. H. Milton Stewart School of Industrial and Systems Engineering (ISyE) Georgia Institute of Technology Atlanta Georgia USA

Abstract Robust principal component analysis (RPCA) is a widely used method for recovering low‐rank structure from data matrices corrupted by significant and sparse outliers. These corruptions may arise from occlusions, malicious tampering, or other causes for anomalies, and the joint identification of such corruptions with low‐rank background is critical for process monitoring and diagnosis. However, existing RPCA methods and their extensions largely do not account for the underlying probabilistic distribution for the data matrices, which in many applications are known and can be highly non‐Gaussian. We thus propose a new method called RPCA for exponential family distributions (), which can perform the desired decomposition into low‐rank and sparse matrices when such a distribution falls within the exponential family. We present a novel alternating direction method of multiplier optimization algorithm for efficient decomposition, under either its natural or canonical parametrization. The effectiveness of is then demonstrated in two applications: the first for steel sheet defect detection and the second for crime activity monitoring in the Atlanta metropolitan area.

Sponsoring Organization:
USDOE
OSTI ID:
2329329
Journal Information:
Statistical Analysis and Data Mining, Journal Name: Statistical Analysis and Data Mining Journal Issue: 2 Vol. 17; ISSN 1932-1864
Publisher:
Wiley Blackwell (John Wiley & Sons)Copyright Statement
Country of Publication:
United States
Language:
English

References (28)

Augmented Lagrangian alternating direction method for matrix separation based on low-rank factorization journal July 2012
Robust foreground detection using block-based RPCA journal December 2015
Convex Optimization book January 2004
The Elements of Statistical Learning book January 2009
Low-rank and sparse matrix decomposition via the truncated nuclear norm and a sparse regularizer journal May 2018
Single-photon imaging in complementary metal oxide semiconductor processes journal March 2014
An Augmented ADMM Algorithm With Application to the Generalized Lasso Problem journal January 2017
Handbook of Parallel Computing and Statistics book December 2005
Primordial non-Gaussianity and non-Gaussian covariance journal January 2023
Bayesian Robust Principal Component Analysis journal December 2011
Poisson Matrix Recovery and Completion journal March 2016
Bayesian Uncertainty Quantification for Low-Rank Matrix Completion journal June 2023
What Does a One-Bit Quanta Image Sensor Offer? journal January 2022
LIII. On lines and planes of closest fit to systems of points in space journal November 1901
Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance journal May 2014
Numerical Optimization book January 1999
The LHC Olympics 2020 a community challenge for anomaly detection in high energy physics journal December 2021
Household occupancy and burglary: A case study using COVID-19 restrictions journal September 2022
A Graphical Multi-Fidelity Gaussian Process Model, with Application to Emulation of Heavy-Ion Collisions journal December 2023
Stable Principal Component Pursuit conference June 2010
A Singular Value Thresholding Algorithm for Matrix Completion journal January 2010
Understanding the efficiency of GPU algorithms for matrix-matrix multiplication conference January 2004
Multisystem Bayesian constraints on the transport coefficients of QCD matter journal May 2021
$e$PCA: High dimensional exponential family PCA journal December 2018
Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications journal March 2017
The Impact of Neighborhood Context on Spatiotemporal Patterns of Burglary journal August 2016
Robust principal component analysis? journal May 2011
On the limited memory BFGS method for large scale optimization journal August 1989

Similar Records

Museum security and the Thomas Crown Affair.
Journal Article · 2010 · Journal of Physical Security · OSTI ID:1043148

Spy the Lie: Detecting Malicious Insiders
Technical Report · 2018 · OSTI ID:1452870

21 cm Signal Recovery via Robust Principal Component Analysis
Journal Article · 2019 · The Astronomical Journal (Online) · OSTI ID:22897255

Related Subjects