Robust Group Subspace Recovery: A New Approach for Multi-Modality Data Fusion

Ghanem, Sally; Panahi, Ashkan; Krim, Hamid; Kerekes, Ryan A.

doi:10.1109/jsen.2020.2999461

Robust Group Subspace Recovery: A New Approach for Multi-Modality Data Fusion

Journal Article · Thu Oct 15 00:00:00 EDT 2020 · IEEE Sensors Journal

DOI:https://doi.org/10.1109/jsen.2020.2999461· OSTI ID:1666012

^[1]; Panahi, Ashkan ^[2]; ^[1]; ^[3]

North Carolina State Univ., Raleigh, NC (United States)
North Carolina State Univ., Raleigh, NC (United States); Chalmers Univ. of Technology, Gothenburg (Sweden)
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

Robust Subspace Recovery (RoSuRe) algorithm was recently introduced as a principled and numerically efficient algorithm that unfolds underlying Unions of Subspaces (UoS) structure, present in the data. The union of Subspaces (UoS) is capable of identifying more complex trends in data sets than simple linear models. In this work, we build on and extend RoSuRe to prospect the structure of different data modalities individually. We propose a novel multi-modal data fusion approach based on group sparsity which we refer to as Robust Group Subspace Recovery (RoGSuRe). Relying on a bi-sparsity pursuit paradigm and non-smooth optimization techniques, the introduced framework learns a new joint representation of the time series from different data modalities, respecting an underlying UoS model. We subsequently integrate the obtained structures to form a unified subspace structure. The proposed approach exploits the structural dependencies between the different modalities data to cluster the associated target objects. The resulting fusion of the unlabeled sensors’ data from experiments on audio and magnetic data has shown that our method is competitive with other state of the art subspace clustering methods. The resulting UoS structure is employed to classify newly observed data points, highlighting the abstraction capacity of the proposed method.

View Accepted Manuscript (DOE)

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC05-00OR22725; NA0002576

OSTI ID:: 1666012

Journal Information:: IEEE Sensors Journal, Journal Name: IEEE Sensors Journal Journal Issue: 20 Vol. 20; ISSN 1530-437X

Publisher:: IEEECopyright Statement

Country of Publication:: United States

Language:: English

References (38)

Distributed classification of acoustic targets in wireless audio-sensor networks Malhotra, Baljeet; Nikolaidis, Ioanis; Harms, Janelle Computer Networks, Vol. 52, Issue 13 https://doi.org/10.1016/j.comnet.2008.05.008	journal	September 2008
Bi-sparsity pursuit: A paradigm for robust subspace recovery Bian, Xiao; Panahi, Ashkan; Krim, Hamid Signal Processing, Vol. 152 https://doi.org/10.1016/j.sigpro.2018.05.024	journal	November 2018
Two decades of array signal processing research: the parametric approach Krim, H.; Viberg, M. IEEE Signal Processing Magazine, Vol. 13, Issue 4 https://doi.org/10.1109/79.526899	journal	July 1996
Sparse Subspace Clustering: Algorithm, Theory, and Applications Elhamifar, Ehsan; Vidal, Rene arXiv https://doi.org/10.48550/arxiv.1203.1005	preprint	January 2012
Speaker Verification Using Adapted Gaussian Mixture Models Reynolds, Douglas A.; Quatieri, Thomas F.; Dunn, Robert B. Digital Signal Processing, Vol. 10, Issue 1-3 https://doi.org/10.1006/dspr.1999.0361	journal	January 2000
Isoradial Bodies Brandenberg, Ren�; Dattasharma, Abhi; Gritzmann, Peter Discrete & Computational Geometry, Vol. 32, Issue 4 https://doi.org/10.1007/s00454-004-1132-4	journal	August 2004
Multisensor data fusion: A review of the state-of-the-art Khaleghi, Bahador; Khamis, Alaa; Karray, Fakhreddine O. Information Fusion, Vol. 14, Issue 1 https://doi.org/10.1016/j.inffus.2011.08.001	journal	January 2013
Multimodal sparse and low-rank subspace clustering Abavisani, Mahdi; Patel, Vishal M. Information Fusion, Vol. 39 https://doi.org/10.1016/j.inffus.2017.05.002	journal	January 2018
Wireless magnetic sensors for traffic surveillance Haoui, Amine; Kavaler, Robert; Varaiya, Pravin Transportation Research Part C: Emerging Technologies, Vol. 16, Issue 3 https://doi.org/10.1016/j.trc.2007.10.004	journal	June 2008
Enhanced Detectability of Community Structure in Multilayer Networks through Layer Aggregation Taylor, Dane; Shai, Saray; Stanley, Natalie Physical Review Letters, Vol. 116, Issue 22 https://doi.org/10.1103/PhysRevLett.116.228301	journal	June 2016
Methods of combining multiple classifiers and their applications to handwriting recognition Xu, L.; Krzyzak, A.; Suen, C. Y. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 22, Issue 3 https://doi.org/10.1109/21.155943	journal	January 1992
On the use of instantaneous and transitional spectral information in speaker recognition Soong, F. K.; Rosenberg, A. E. IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. 36, Issue 6 https://doi.org/10.1109/29.1598	journal	June 1988
Convex optimization approach to identify fusion for multisensor target tracking No authors listed IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, Vol. 31, Issue 3 https://doi.org/10.1109/3468.925656	journal	May 2001
An introduction to multisensor data fusion Hall, D. L.; Llinas, J. Proceedings of the IEEE, Vol. 85, Issue 1 https://doi.org/10.1109/5.554205	journal	January 1997
Sparse subspace clustering Elhamifar, Ehsan; Vidal, Rene 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), 2009 IEEE Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2009.5206547	conference	June 2009
Vehicle re-identification with a single magnetic sensor Charbonnier, Sylvie; Pitton, Anne-Cecile; Vassilev, Andrea 2012 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings https://doi.org/10.1109/I2MTC.2012.6229117	conference	May 2012
Clustering disjoint subspaces via sparse representation Elhamifar, Ehsan; Vidal, Rene 2010 IEEE International Conference on Acoustics, Speech and Signal Processing https://doi.org/10.1109/ICASSP.2010.5495317	conference	March 2010
Multi-task low-rank affinity pursuit for image segmentation Cheng, Bin; Liu, Guangcan; Wang, Jingdong 2011 International Conference on Computer Vision https://doi.org/10.1109/ICCV.2011.6126528	conference	November 2011
Low-Rank Tensor Constrained Multiview Subspace Clustering Zhang, Changqing; Fu, Huazhu; Liu, Si 2015 IEEE International Conference on Computer Vision (ICCV) https://doi.org/10.1109/ICCV.2015.185	conference	December 2015
Critiques on some combination rules for probability theory based on optimization techniques Florea, Mihai Cristian; Bosse, Eloi 2007 10th International Conference on Information Fusion https://doi.org/10.1109/ICIF.2007.4408062	conference	July 2007
Vehicle detection and localization using Unattended Ground Magnetometer Sensors Christou, C. T.; Jacyna, G. M. 2010 13th International Conference on Information Fusion https://doi.org/10.1109/ICIF.2010.5711899	conference	July 2010
Kernel sparse subspace clustering Patel, Vishal M.; Vidal, Rene 2014 IEEE International Conference on Image Processing (ICIP) https://doi.org/10.1109/ICIP.2014.7025576	conference	October 2014
Improved adaptive Gaussian mixture model for background subtraction Zivkovic, Z. Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. https://doi.org/10.1109/ICPR.2004.1333992	conference	January 2004
Vehicle re-identification using wireless magnetic sensors: Algorithm revision, modifications and performance analysis Sanchez, Rene O.; Flores, Christopher; Horowitz, Roberto 2011 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2011), Proceedings of 2011 IEEE International Conference on Vehicular Electronics and Safety https://doi.org/10.1109/ICVES.2011.5983819	conference	July 2011
On the Role of Sparse and Redundant Representations in Image Processing Elad, Michael; Figueiredo, Mário A. T.; Ma, Yi Proceedings of the IEEE, Vol. 98, Issue 6 https://doi.org/10.1109/JPROC.2009.2037655	journal	June 2010
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects Lahat, Dana; Adali, Tulay; Jutten, Christian Proceedings of the IEEE, Vol. 103, Issue 9 https://doi.org/10.1109/JPROC.2015.2460697	journal	September 2015
Multiscale Hybrid Linear Models for Lossy Image Representation Hong, Wei; Wright, John; Huang, Kun IEEE Transactions on Image Processing, Vol. 15, Issue 12 https://doi.org/10.1109/TIP.2006.882016	journal	December 2006
Analysis Dictionary Learning Based Classification: Structure for Robustness Tang, Wen; Panahi, Ashkan; Krim, Hamid IEEE Transactions on Image Processing, Vol. 28, Issue 12 https://doi.org/10.1109/TIP.2019.2919409	journal	December 2019
Prediction Intervals to Account for Uncertainties in Travel Time Prediction Khosravi, Abbas; Mazloumi, Ehsan; Nahavandi, Saeid IEEE Transactions on Intelligent Transportation Systems, Vol. 12, Issue 2 https://doi.org/10.1109/TITS.2011.2106209	journal	June 2011
Robust Recovery of Subspace Structures by Low-Rank Representation Liu, Guangcan; Lin, Zhouchen; Yan, Shuicheng IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, Issue 1 https://doi.org/10.1109/TPAMI.2012.88	journal	January 2013
Sparse Subspace Clustering: Algorithm, Theory, and Applications Elhamifar, E.; Vidal, R. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, Issue 11 https://doi.org/10.1109/TPAMI.2013.57	journal	November 2013
Vehicle Classification and Identification Using Multi-Modal Sensing and Signal Learning Kerekes, Ryan A.; Karnowski, Thomas P.; Kuhn, Mike 2017 IEEE 85th Vehicular Technology Conference (VTC Spring) https://doi.org/10.1109/VTCSpring.2017.8108568	conference	June 2017
Robust principal component analysis? Candès, Emmanuel J.; Li, Xiaodong; Ma, Yi Journal of the ACM, Vol. 58, Issue 3 https://doi.org/10.1145/1970392.1970395	journal	May 2011
RFTraffic: a study of passive traffic awareness using emitted RF noise from the vehicles Ding, Yong; Banitalebi, Behnam; Miyaki, Takashi EURASIP Journal on Wireless Communications and Networking, Vol. 2012, Issue 1 https://doi.org/10.1186/1687-1499-2012-8	journal	January 2012
A geometric analysis of subspace clustering with outliers Soltanolkotabi, Mahdi; Candés, Emmanuel J. The Annals of Statistics, Vol. 40, Issue 4 https://doi.org/10.1214/12-AOS1034	journal	August 2012
The use of RFID for traffic management Kathawala, Yunus A.; Tueck, Benjamin International Journal of Technology, Policy and Management, Vol. 8, Issue 2 https://doi.org/10.1504/IJTPM.2008.017215	journal	January 2008
A Note on the Use of Principal Components in Regression Jolliffe, Ian T. Applied Statistics, Vol. 31, Issue 3 https://doi.org/10.2307/2348005	journal	January 1982
Information Subspace-Based Fusion for Vehicle Classification Ghanem, Sally; Panahi, Ashkan; Krim, Hamid 2018 26th European Signal Processing Conference (EUSIPCO) https://doi.org/10.23919/EUSIPCO.2018.8553445	conference	September 2018

Similar Records

Beyond union of subspaces: Subspace pursuit on Grassmann manifold for data representation

Journal Article · Mon Feb 29 19:00:00 EST 2016 · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · OSTI ID:1438403

Scaling Subspace-Driven Approaches Using Information Fusion

Book · Tue Jan 31 23:00:00 EST 2023 · OSTI ID:1972569

Bi-sparsity pursuit: A paradigm for robust subspace recovery

Journal Article · Thu May 24 20:00:00 EDT 2018 · Signal Processing · OSTI ID:1614542

Related Subjects

47 OTHER INSTRUMENTATION
Sensor fusion
data fusion
data integration
data models
magnetic sensors
multimodal data
sensor phenomena and characterization
sparse learning
sparse matrices
unsupervised classification

Robust Group Subspace Recovery: A New Approach for Multi-Modality Data Fusion

Citation Formats

References (38)

Similar Records

Related Subjects