A statistical approach to combining multisource information in one-class classifiers

Simonson, Katherine M.; Derek West, R.; Hansen, Ross L.; LaBruyere, Thomas E.; Van Benthem, Mark H.

doi:10.1002/sam.11342

Title: A statistical approach to combining multisource information in one-class classifiers

Journal Article · Thu Jun 08 00:00:00 EDT 2017 · Statistical Analysis and Data Mining

DOI:https://doi.org/10.1002/sam.11342· OSTI ID:1399493

^[1]; Derek West, R. ^[1]; Hansen, Ross L. ^[1]; LaBruyere, Thomas E. ^[1]; Van Benthem, Mark H. ^[1]

Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

A new method is introduced for combining information from multiple sources to support one‐class classification. The contributing sources may represent measurements taken by different sensors of the same physical entity, repeated measurements by a single sensor, or numerous features computed from a single measured image or signal. The approach utilizes the theory of statistical hypothesis testing, and applies Fisher's technique for combining p ‐values, modified to handle nonindependent sources. Classifier outputs take the form of fused p ‐values, which may be used to gauge the consistency of unknown entities with one or more class hypotheses. The approach enables rigorous assessment of classification uncertainties, and allows for traceability of classifier decisions back to the constituent sources, both of which are important for high‐consequence decision support. Application of the technique is illustrated in two challenge problems, one for skin segmentation and the other for terrain labeling. The method is seen to be particularly effective for relatively small training samples.

View Accepted Manuscript (DOE)

View Accepted Manuscript (Publisher)

Cite

Export

Save

Research Organization:: Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA); SNL Laboratory Directed Research and Development (LDRD) program

Grant/Contract Number:: AC04-94AL85000

OSTI ID:: 1399493

Alternate ID(s):: OSTI ID: 1400859

Report Number(s):: SAND2017-2026J; 651299

Journal Information:: Statistical Analysis and Data Mining, Vol. 10, Issue 4; ISSN 1932-1864

Publisher:: WileyCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 9 works

Citation information provided by
Web of Science

References (45)

The Optics of Human Skin Anderson, R. Rox; Parrish, John A. Journal of Investigative Dermatology, Vol. 77, Issue 1, p. 13-19 https://doi.org/10.1111/1523-1747.ep12479191	journal	July 1981
Log-polar wavelet energy signatures for rotation and scale invariant texture classification IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, Issue 5 https://doi.org/10.1109/TPAMI.2003.1195993	journal	May 2003
Polarimetric SAR interferometry Cloude, S. R.; Papathanassiou, K. P. IEEE Transactions on Geoscience and Remote Sensing, Vol. 36, Issue 5 https://doi.org/10.1109/36.718859	journal	January 1998
Learning Hierarchical Features for Scene Labeling Farabet, Clement; Couprie, Camille; Najman, Laurent IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, Issue 8 https://doi.org/10.1109/TPAMI.2012.231	journal	August 2013
Multiple classifiers applied to multisource remote sensing data Briem, G. J.; Benediktsson, J. A.; Sveinsson, J. R. IEEE Transactions on Geoscience and Remote Sensing, Vol. 40, Issue 10 https://doi.org/10.1109/TGRS.2002.802476	journal	January 2002
Asymptotic Optimality of Fisher's Method of Combining Independent Tests II Littell, Ramon C.; Folks, J. Leroy Journal of the American Statistical Association, Vol. 68, Issue 341 https://doi.org/10.1080/01621459.1973.10481362	journal	March 1973
A review of novelty detection Pimentel, Marco A. F.; Clifton, David A.; Clifton, Lei Signal Processing, Vol. 99 https://doi.org/10.1016/j.sigpro.2013.12.026	journal	June 2014
A Functional Data—Analytic Approach to Signal Discrimination Hall, Peter; Poskitt, D. S.; Presnell, Brett Technometrics, Vol. 43, Issue 1 https://doi.org/10.1198/00401700152404273	journal	February 2001
Expert guided natural language processing using one-class classification Joffe, Erel; Pettigrew, Emily J.; Herskovic, Jorge R. Journal of the American Medical Informatics Association, Vol. 22, Issue 5 https://doi.org/10.1093/jamia/ocv010	journal	June 2015
A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting Freund, Yoav; Schapire, Robert E. Journal of Computer and System Sciences, Vol. 55, Issue 1 https://doi.org/10.1006/jcss.1997.1504	journal	August 1997
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods Achanta, R.; Shaji, A.; Smith, K. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 34, Issue 11, p. 2274-2282 https://doi.org/10.1109/TPAMI.2012.120	journal	November 2012
An Empirical Comparison of Expert-Derived and Data-Derived Classification Trees Chiogna, M.; Spiegelhalter, D. J.; Franklin, R. C. G. Statistics in Medicine, Vol. 15, Issue 2 https://doi.org/10.1002/(SICI)1097-0258(19960130)15:2<157::AID-SIM149>3.0.CO;2-5	journal	January 1996
Combining dependent P-values Kost, James T.; McDermott, Michael P. Statistics & Probability Letters, Vol. 60, Issue 2 https://doi.org/10.1016/S0167-7152(02)00310-3	journal	November 2002
Bagging predictors Breiman, Leo Machine Learning, Vol. 24, Issue 2, p. 123-140 https://doi.org/10.1007/BF00058655	journal	August 1996
From colour to tissue histology: Physics-based interpretation of images of pigmented skin lesions Claridge, Ela; Cotton, Symon; Hall, Per Medical Image Analysis, Vol. 7, Issue 4 https://doi.org/10.1016/S1361-8415(03)00033-1	journal	December 2003
Methods of combining multiple classifiers and their applications to handwriting recognition Xu, L.; Krzyzak, A.; Suen, C. Y. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 22, Issue 3 https://doi.org/10.1109/21.155943	journal	January 1992
One-class classification based authentication of peanut oils by fatty acid profiles Zhang, Liangxiao; Li, Peiwu; Sun, Xiaoman RSC Advances, Vol. 5, Issue 103 https://doi.org/10.1039/C5RA07329D	journal	January 2015
An overview of text-independent speaker recognition: From features to supervectors Kinnunen, Tomi; Li, Haizhou Speech Communication, Vol. 52, Issue 1 https://doi.org/10.1016/j.specom.2009.08.009	journal	January 2010
The FERET evaluation methodology for face-recognition algorithms Phillips, P. J.; Rauss, P. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.1997.609311	conference	January 1997
Active and dynamic information fusion for facial expression understanding from image sequences IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, Issue 5 https://doi.org/10.1109/TPAMI.2005.93	journal	May 2005
Growing a multi-class classifier with a reject option Tax, D. M. J.; Duin, R. P. W. Pattern Recognition Letters, Vol. 29, Issue 10 https://doi.org/10.1016/j.patrec.2008.03.010	journal	July 2008
General Four-Component Scattering Power Decomposition With Unitary Transformation of Coherency Matrix Singh, Gulab; Yamaguchi, Yoshio; Park, Sang-Eun IEEE Transactions on Geoscience and Remote Sensing, Vol. 51, Issue 5 https://doi.org/10.1109/TGRS.2012.2212446	journal	May 2013
Classification and Extraction of Spatial Features in Urban Areas Using High-Resolution Multispectral Imagery Huang, Xin; Zhang, Liangpei; Li, Pingxiang IEEE Geoscience and Remote Sensing Letters, Vol. 4, Issue 2 https://doi.org/10.1109/LGRS.2006.890540	journal	April 2007
Some bivariate uniform distributions Barnett, Vic Communications in Statistics - Theory and Methods, Vol. 9, Issue 4 https://doi.org/10.1080/03610928008827893	journal	January 1980
Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors Adam, Amit; Rivlin, Ehud; Shimshoni, Ilan IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, Issue 3 https://doi.org/10.1109/TPAMI.2007.70825	journal	March 2008
A survey on feature selection methods Chandrashekar, Girish; Sahin, Ferat Computers & Electrical Engineering, Vol. 40, Issue 1 https://doi.org/10.1016/j.compeleceng.2013.11.024	journal	January 2014
A systematic comparison of methods for combining p-values from independent tests Loughin, Thomas M. Computational Statistics & Data Analysis, Vol. 47, Issue 3 https://doi.org/10.1016/j.csda.2003.11.020	journal	October 2004
Soft computing methods applied to combination of one-class classifiers Wilk, Tomasz; Wozniak, Michal Neurocomputing, Vol. 75, Issue 1 https://doi.org/10.1016/j.neucom.2011.02.023	journal	January 2012
The strength of weak learnability Schapire, Robert E. Machine Learning, Vol. 5, Issue 2 https://doi.org/10.1007/BF00116037	journal	June 1990
Estimating the Support of a High-Dimensional Distribution Schölkopf, Bernhard; Platt, John C.; Shawe-Taylor, John Neural Computation, Vol. 13, Issue 7 https://doi.org/10.1162/089976601750264965	journal	July 2001
Evolving feature selection Liu, H.; Dougherty, E. R.; Dy, J. G. IEEE Intelligent Systems, Vol. 20, Issue 6 https://doi.org/10.1109/MIS.2005.105	journal	November 2005
Wavelet packet feature extraction for vibration monitoring Yen, G. G.; Lin, K. -C. IEEE Transactions on Industrial Electronics, Vol. 47, Issue 3 https://doi.org/10.1109/41.847906	journal	June 2000
Distribution of Fisher's combination statistic when the tests are dependent Yang, James J. Journal of Statistical Computation and Simulation, Vol. 80, Issue 1 https://doi.org/10.1080/00949650802412607	journal	January 2010
Combining probability from independent tests: the weighted Z-method is superior to Fisher's approach: Combining probabilities from many tests Whitlock, M. C. Journal of Evolutionary Biology, Vol. 18, Issue 5 https://doi.org/10.1111/j.1420-9101.2005.00917.x	journal	August 2005
ECG Beats Classification Using Mixture of Features Das, Manab Kumar; Ari, Samit International Scholarly Research Notices, Vol. 2014 https://doi.org/10.1155/2014/178436	journal	January 2014
Statistical pattern recognition: a review Jain, A. K.; Duin, P. W. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, Issue 1 https://doi.org/10.1109/34.824819	journal	January 2000
Support-vector networks Cortes, Corinna; Vapnik, Vladimir Machine Learning, Vol. 20, Issue 3 https://doi.org/10.1007/BF00994018	journal	September 1995
A Fast Learning Algorithm for Deep Belief Nets Hinton, Geoffrey E.; Osindero, Simon; Teh, Yee-Whye Neural Computation, Vol. 18, Issue 7 https://doi.org/10.1162/neco.2006.18.7.1527	journal	July 2006
Combination of multiple classifiers using local accuracy estimates Woods, K.; Kegelmeyer, W. P.; Bowyer, K. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, Issue 4 https://doi.org/10.1109/34.588027	journal	April 1997
A New Coherency Formalism for Change Detection and Phenomenology in SAR Imagery: A Field Approach Sabry, R. IEEE Geoscience and Remote Sensing Letters, Vol. 6, Issue 3 https://doi.org/10.1109/LGRS.2009.2016359	journal	July 2009
On the Combination of Independent Test Statistics van Zwet, W. R.; Oosterhoff, J. The Annals of Mathematical Statistics, Vol. 38, Issue 3 https://doi.org/10.1214/aoms/1177698861	journal	June 1967
Effective dimension reduction methods for tumor classification using gene expression data Antoniadis, A.; Lambert-Lacroix, S.; Leblanc, F. Bioinformatics, Vol. 19, Issue 5 https://doi.org/10.1093/bioinformatics/btg062	journal	March 2003
400: A Method for Combining Non-Independent, One-Sided Tests of Significance Brown, Morton B. Biometrics, Vol. 31, Issue 4 https://doi.org/10.2307/2529826	journal	December 1975
A Review of Anomaly based Intrusion Detection Systems Jyothsna, V.; V. Rama Prasad, V.; Munivara Prasad, K. International Journal of Computer Applications, Vol. 28, Issue 7 https://doi.org/10.5120/3399-4730	journal	August 2011
Arcing classifier (with discussion and a rejoinder by the author) Breiman, Leo The Annals of Statistics, Vol. 26, Issue 3 https://doi.org/10.1214/aos/1024691079	journal	June 1998

Linked Research (4)

Similar Records

Single-Pol Synthetic Aperture Radar Terrain Classification using Multiclass Confidence for One-Class Classifiers

Journal Article · Thu Oct 01 00:00:00 EDT 2015 · Sandia journal manuscript; Not yet accepted for publication · OSTI ID:1399493

Koch, Mark William; Steinbach, Ryan Matthew; Moya, Mary M

Sensor feature fusion for detecting buried objects

Conference · Thu Apr 01 00:00:00 EST 1993 · OSTI ID:1399493

Clark, G A; Sengupta, S K; Sherwood, R J; +6 more

Classifiers for Dissolution Events in Processing Facility Using Effluents Measurements

Conference · Mon Jul 01 00:00:00 EDT 2019 · OSTI ID:1399493

Rao, Nageswara S.; Greulich, Christopher; Sen, Satyabrata; +8 more

Related Subjects

97 MATHEMATICS AND COMPUTING
classification
dependent p-values
Fisher's combination method
gamma distribution
image segmentation
multisource fusion

Dataset for: A Statistical Approach to Combining Multi-Source Information in One-Class Classifiers Simonson, Katherine; Hansen, Ross; LaBruyere, Thomas https://doi.org/10.6084/m9.figshare.c.3682954.v1 The current record is supplemented by this collection	collection	June 2017
Dataset for: A Statistical Approach to Combining Multi-Source Information in One-Class Classifiers Simonson, Katherine; West, R. Derek; Hansen, Ross https://doi.org/10.6084/m9.figshare.4620124 The current record is supplemented by this dataset	dataset	January 2017
Dataset for: A Statistical Approach to Combining Multi-Source Information in One-Class Classifiers Simonson, Katherine; West, R. Derek; Hansen, Ross https://doi.org/10.6084/m9.figshare.4620124.v1 The current record is supplemented by this dataset	dataset	January 2017
Dataset for: A Statistical Approach to Combining Multi-Source Information in One-Class Classifiers [Supplemental Data] Simonson, Katherine; West, R. Derek; Hansen, Ross https://doi.org/10.6084/m9.figshare.c.3682954 The current record is supplemented by this dataset	dataset	June 2017

Title: A statistical approach to combining multisource information in one-class classifiers

Citation Formats

References (45)

Linked Research (4)

Similar Records

Related Subjects