Utility of multispectral imaging for nuclear classification of routine clinical histopathology imagery

Boucheron, Laura E.; Bi, Zhiqiang; Harvey, Neal R.; Manjunath, BS; Rimm, David L.

doi:10.1186/1471-2121-8-s1-s8

Utility of multispectral imaging for nuclear classification of routine clinical histopathology imagery

Journal Article · Tue Jul 10 00:00:00 EDT 2007 · BMC Cell Biology

DOI:https://doi.org/10.1186/1471-2121-8-s1-s8· OSTI ID:1626368

Boucheron, Laura E. ^[1]; Bi, Zhiqiang ^[2]; Harvey, Neal R. ^[3]; Manjunath, BS ^[2]; Rimm, David L. ^[4]

Univ. of California, Santa Barbara, CA (United States). Electrical and Computer Engineering Dept.; Los Alamos National Lab. (LANL), Los Alamos, NM (United States); DOE/OSTI
Univ. of California, Santa Barbara, CA (United States). Electrical and Computer Engineering Dept.
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Yale Univ., New Haven, CT (United States). Dept. of Pathology

Background: We present an analysis of the utility of multispectral versus standard RGB imagery for routine H&E stained histopathology images, in particular for pixel-level classification of nuclei. Our multispectral imagery has 29 spectral bands, spaced 10 nm within the visual range of 420–700 nm. It has been hypothesized that the additional spectral bands contain further information useful for classification as compared to the 3 standard bands of RGB imagery. We present analyses of our data designed to test this hypothesis. Results: For classification using all available image bands, we find the best performance (equal tradeoff between detection rate and false alarm rate) is obtained from either the multispectral or our "ccd" RGB imagery, with an overall increase in performance of 0.79% compared to the next best performing image type. For classification using single image bands, the single best multispectral band (in the red portion of the spectrum) gave a performance increase of 0.57%, compared to performance of the single best RGB band (red). Additionally, red bands had the highest coefficients/ preference in our classifiers. Principal components analysis of the multispectral imagery indicates only two significant image bands, which is not surprising given the presence of two stains. Conclusion: Our results indicate that multispectral imagery for routine H&E stained histopathology provides minimal additional spectral information for a pixel-level nuclear classification task than would standard RGB imagery.

View Accepted Manuscript (DOE)

Research Organization:: Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)

Sponsoring Organization:: USDOE Office of Science (SC); National Science Foundation (NSF)

OSTI ID:: 1626368

Journal Information:: BMC Cell Biology, Journal Name: BMC Cell Biology Journal Issue: S1 Vol. 8; ISSN 1471-2121

Publisher:: BioMed CentralCopyright Statement

Country of Publication:: United States

Language:: English

References (22)

Nuclear chromatin texture analysis of nonmalignant tissue can detect adjacent prostatic adenocarcinoma Mairinger, T.; Mikuz, G.; Gschwendtner, A. The Prostate, Vol. 41, Issue 1 https://doi.org/10.1002/(sici)1097-0045(19990915)41:1<12::aid-pros3>3.0.co;2-#	journal	September 1999
Automated breast tumor diagnosis and grading based on wavelet chromatin texture description Weyn, Barbara; van de Wouwer, Gert; van Daele, Andr� Cytometry, Vol. 33, Issue 1 https://doi.org/10.1002/(sici)1097-0320(19980901)33:1<32::aid-cyto4>3.0.co;2-d	journal	September 1998
Computer-assisted differential diagnosis of malignant mesothelioma based on syntactic structure analysis Weyn, Barbara; van de Wouwer, Gert; Kumar-Singh, Samir Cytometry, Vol. 35, Issue 1 https://doi.org/10.1002/(sici)1097-0320(19990101)35:1<23::aid-cyto4>3.0.co;2-p	journal	January 1999
Computerized contextual analysis in diagnosis Zahniser, David J.; Isenstein, Louise M.; Hutchinson, Martha L. Cancer Letters, Vol. 77, Issue 2-3 https://doi.org/10.1016/0304-3835(94)90096-5	journal	March 1994
Pattern Recognition Theodoridis, Sergios Encyclopedia of Information Systems https://doi.org/10.1016/b0-12-227240-4/00132-5	book	January 2003
Detection of malignancy in cytology specimens using spectral–spatial analysis Angeletti, Cesar; Harvey, Neal R.; Khomitch, Vitali Laboratory Investigation, Vol. 85, Issue 12 https://doi.org/10.1038/labinvest.3700357	journal	October 2005
Wavelets as chromatin texture descriptors for the automated identification of neoplastic nuclei Van De Wouwer, G.; Weyn, B.; Scheunders, P. Journal of Microscopy, Vol. 197, Issue 1, p. 25-35 https://doi.org/10.1046/j.1365-2818.2000.00594.x	journal	January 2000
Computer-aided detection of breast cancer nuclei Schnorrenberg, F.; Pattichis, C. S.; Kyriacou, K. C. IEEE Transactions on Information Technology in Biomedicine, Vol. 1, Issue 2 https://doi.org/10.1109/4233.640655	journal	June 1997
A quadratic classifier based on multispectral texture features for prostate cancer diagnosis Roula, M. A.; Bouridane, A.; Kurugollu, F. Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings. https://doi.org/10.1109/isspa.2003.1224809	conference	January 2003
Biomedical applications of the information-efficient spectral imaging sensor (ISIS) Gentry, Stephen M.; Levenson, Richard M. BiOS '99 International Biomedical Optics Symposium, SPIE Proceedings https://doi.org/10.1117/12.346734	conference	April 1999
Computerized Scene Segmentation for the Discrimination of Architectural Features in Ductal Proliferative Lesions of the Breast Anderson, Neil H.; Hamilton, Peter W.; Bartels, Peter H. The Journal of Pathology, Vol. 181, Issue 4 https://doi.org/10.1002/(SICI)1096-9896(199704)181:4<374::AID-PATH795>3.0.CO;2-N	journal	April 1997
Value of morphometry, texture analysis, densitometry, and histometry in the differential diagnosis and prognosis of malignant mesothelioma Weyn, Barbara; Van De Wouwer, Gert; Koprowski, Marek The Journal of Pathology, Vol. 189, Issue 4 https://doi.org/10.1002/(SICI)1096-9896(199912)189:4<581::AID-PATH464>3.0.CO;2-P	journal	December 1999
Nuclear chromatin texture analysis of nonmalignant tissue can detect adjacent prostatic adenocarcinoma Mairinger, T.; Mikuz, G.; Gschwendtner, A. The Prostate, Vol. 41, Issue 1 https://doi.org/10.1002/(SICI)1097-0045(19990915)41:1<12::AID-PROS3>3.0.CO;2-#	journal	September 1999
Automated breast tumor diagnosis and grading based on wavelet chromatin texture description Weyn, Barbara; van de Wouwer, Gert; van Daele, Andr� Cytometry, Vol. 33, Issue 1 https://doi.org/10.1002/(SICI)1097-0320(19980901)33:1<32::AID-CYTO4>3.0.CO;2-D	journal	September 1998
Computer-assisted differential diagnosis of malignant mesothelioma based on syntactic structure analysis Weyn, Barbara; van de Wouwer, Gert; Kumar-Singh, Samir Cytometry, Vol. 35, Issue 1 https://doi.org/10.1002/(SICI)1097-0320(19990101)35:1<23::AID-CYTO4>3.0.CO;2-P	journal	January 1999
Diagnostic classification of urothelial cells in urine cytology specimens using exclusively spectral information Jaganath, Rajesh; Angeletti, Cesar; Levenson, Richard Cancer, Vol. 102, Issue 3 https://doi.org/10.1002/cncr.20302	journal	April 2004
High-resolution image cytometry on smears of normal oral mucosa: a possible approach for the early detection of laryngopharyngeal cancers: Image Analysis of Mucosal Scrapings for Detection of Laryngopharyngeal Cancers Neher, Andreas; Öfner, Günter; Appenroth, Elisabeth Head & Neck, Vol. 26, Issue 8 https://doi.org/10.1002/hed.20020	journal	June 2004
Comparison of GENIE and conventional supervised classifiers for multispectral image feature extraction Harvey, N. R.; Theiler, J.; Brumby, S. P. IEEE Transactions on Geoscience and Remote Sensing, Vol. 40, Issue 2 https://doi.org/10.1109/36.992801	journal	January 2002
Independent component representations for face recognition Stewart Bartlett, Marian; Lades, Martin H.; Sejnowski, Terrence J. Photonics West '98 Electronic Imaging, SPIE Proceedings https://doi.org/10.1117/12.320144	conference	July 1998
Spectral imaging in biomedicine: a selective overview Levenson, Richard M.; Wachman, Elliot S.; Niu, Wenhua SPIE's International Symposium on Optical Science, Engineering, and Instrumentation, SPIE Proceedings https://doi.org/10.1117/12.328111	conference	October 1998
Spectral imaging for brightfield microscopy Levenson, Richard M.; Cronin, Paul J.; Pankratov, Kirill K. Biomedical Optics 2003, SPIE Proceedings https://doi.org/10.1117/12.485550	conference	July 2003
Spectral Imaging and Pathology: Seeing More Levenson, Richard M. Laboratory Medicine, Vol. 35, Issue 4 https://doi.org/10.1309/KRNFWQQEUPLQL76L	journal	April 2004

Cited By (14)

Application of multispectral imaging in quantitative immunohistochemistry study of breast cancer: a comparative study Liu, Wen-Lou; Wang, Lin-Wei; Chen, Jia-Mei Tumor Biology, Vol. 37, Issue 4 https://doi.org/10.1007/s13277-015-4327-9	journal	November 2015
Segmenting Diabetic Retinopathy Lesions in Multispectral Images Using Low-Dimensional Spatial-Spectral Matrix Representation He, Yunlong; Jiao, Wanzhen; Shi, Yunfeng IEEE Journal of Biomedical and Health Informatics, Vol. 24, Issue 2 https://doi.org/10.1109/jbhi.2019.2912668	journal	February 2020
Histopathological Image Analysis: A Review Gurcan, M. N.; Boucheron, L. E.; Can, A. IEEE Reviews in Biomedical Engineering, Vol. 2 https://doi.org/10.1109/rbme.2009.2034865	journal	January 2009
Development of Multiscale Biological Image Data Analysis: Review of 2006 International Workshop on Multiscale Biological Imaging, Data Mining and Informatics, Santa Barbara, USA (BII06) Auer, Manfred; Peng, Hanchuan; Singh, Ambuj BMC Cell Biology, Vol. 8, Issue S1 https://doi.org/10.1186/1471-2121-8-s1-s1	journal	July 2007
Segmentation of epidermal tissue with histopathological damage in images of haematoxylin and eosin stained human skin Haggerty, Juliana M.; Wang, Xiao N.; Dickinson, Anne BMC Medical Imaging, Vol. 14, Issue 1 https://doi.org/10.1186/1471-2342-14-7	journal	February 2014
Computational Pathology: Challenges and Promises for Tissue Analysis Fuchs, Thomas J.; Buhmann, Joachim M. arXiv https://doi.org/10.48550/arxiv.1601.00027	text	January 2016
Improving Prostate Cancer Classification: A Round Robin Forward Sequential Selection Approach Bouatmane, Sabrina; Bouridane, Ahmed; Ali, Mohamed Prostate Cancer - Original Scientific Reports and Case Studies https://doi.org/10.5772/26142	book	November 2011
Photothermal multispectral image cytometry for quantitative histology of nanoparticles and micrometastasis in intact, stained and selectively burned tissues Nedosekin, Dmitry A.; Shashkov, Evgeny V.; Galanzha, Ekaterina I. Cytometry Part A, Vol. 77A, Issue 11 https://doi.org/10.1002/cyto.a.20977	journal	October 2010
In-vivo multispectral video endoscopy towards in-vivo hyperspectral video endoscopy Hohmann, Martin; Kanawade, R.; Klämpfl, F. Journal of Biophotonics, Vol. 10, Issue 4 https://doi.org/10.1002/jbio.201600021	journal	July 2016
Hyperspectral imaging for tissue classification, a way toward smart laparoscopic colorectal surgery Baltussen, Elisabeth J. M.; Kok, Esther N. D.; Brouwer de Koning, Susan G. Journal of Biomedical Optics, Vol. 24, Issue 01 https://doi.org/10.1117/1.jbo.24.1.016002	journal	January 2019
Classification of hyperspectral images for detection of hepatic carcinoma cells based on spectral–spatial features of nucleus Chen, Yao; Zhu, Siqi; Fu, Shenhe Journal of Innovative Optical Health Sciences, Vol. 13, Issue 01 https://doi.org/10.1142/s1793545820500029	journal	December 2019
Detection of pancreatic tumor cell nuclei via a hyperspectral analysis of pathological slides based on stain spectra Ishikawa, Masahiro; Okamoto, Chisato; Shinoda, Kazuma Biomedical Optics Express, Vol. 10, Issue 9 https://doi.org/10.1364/boe.10.004568	journal	January 2019
Using spectral imaging for the analysis of abnormalities for colorectal cancer: When is it helpful? Awan, Ruqayya; Al-Maadeed, Somaya; Al-Saady, Rafif PLOS ONE, Vol. 13, Issue 6 https://doi.org/10.1371/journal.pone.0197431	journal	June 2018
Artificial Intelligence in Lung Cancer Pathology Image Analysis Wang, Shidan; Yang, Donghan M.; Rong, Ruichen Cancers, Vol. 11, Issue 11 https://doi.org/10.3390/cancers11111673	journal	October 2019

Similar Records

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

Journal Article · Tue Oct 07 20:00:00 EDT 2025 · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · OSTI ID:3006502

Land cover classification in multispectral imagery using clustering of sparse approximations over learned feature dictionaries

Journal Article · Mon Dec 08 23:00:00 EST 2014 · Journal of Applied Remote Sensing · OSTI ID:1239298

Joint spatio-spectral based edge detection for multispectral infrared imagery.

Conference · Tue Jun 01 00:00:00 EDT 2010 · OSTI ID:1021150

Related Subjects

59 BASIC BIOLOGICAL SCIENCES
Cell Biology

Utility of multispectral imaging for nuclear classification of routine clinical histopathology imagery

Citation Formats

References (22)

Cited By (14)

Similar Records

Related Subjects