Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Removing cosmic spikes using a hyperspectral upper-bound spectrum method

Journal Article · · Applied Spectroscopy
 [1];  [1]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States). Bioenergy and Defense Technologies

Cosmic ray spikes are especially problematic for hyperspectral imaging, due to the large number of spikes often present and their negative effects upon subsequent chemometric analysis. Fortunately, while the large number of spectra acquired in a hyperspectral imaging data set increases the probability and number of cosmic spikes observed, the multitude of spectra can also aid in the effective recognition and removal of the cosmic spikes. Dongmao Zhang and Dor Ben-Amotz were perhaps the first to leverage the additional spatial dimension of hyperspectral data matrices (DM). They integrated principal component analysis (PCA) into the upper bound spectrum method (UBS), resulting in a hybrid method (UBS-DM) for hyperspectral images. Here, we expand upon their use of PCA, recognizing that principal components primarily present in only a few pixels most likely correspond to cosmic spikes. Eliminating the contribution of those principal components in those pixels improves the cosmic spike removal. Both simulated and experimental hyperspectral Raman image data sets are used to test the newly developed UBS-DM-hyperspectral (UBS-DM-HS) method which extends the UBS-DM method by leveraging characteristics of hyperspectral datasets. Lastly, a comparison is provided between the performance of the UBS-DM-HS method and other methods suitable for despiking hyperspectral images, evaluating both their ability to remove cosmic ray spikes and the extent to which they introduce spectral bias.

Research Organization:
Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC04-94AL85000
OSTI ID:
1336918
Report Number(s):
SAND2016-8518J; 647028
Journal Information:
Applied Spectroscopy, Journal Name: Applied Spectroscopy; ISSN 0003-7028
Publisher:
Society for Applied SpectroscopyCopyright Statement
Country of Publication:
United States
Language:
English

References (28)

Information-theoretic chemometric analyses of Raman data for chemical reaction studies: Information-theoretic chemometric analyses of Raman data journal January 2011
Application of principal component analysis to detect outliers and spectral deviations in near-field surface-enhanced Raman spectra journal November 2001
Multivariate curve resolution: A review of advanced and tailored applications and challenges journal February 2013
Kernel principal component analysis residual diagnosis (KPCARD): An automated method for cosmic ray artifact removal in Raman spectra journal March 2016
Preprocessing strategies to improve MCR analyses of hyperspectral images journal August 2012
Spike Removal and Denoising of Raman Spectra by Wavelet Transform Methods journal September 2001
Polynomial filters for data sets with outlying or missing observations: application to charge-coupled-device-detected Raman spectra contaminated by cosmic rays journal November 1990
Outlier Detection in Multivariate Analytical Chemical Data journal June 1998
Evaluation of Cosmic Ray Rejection Algorithms on Single-Shot Exposures journal January 2005
Influence of Terrestrial Cosmic Rays on the Reliability of CCD Image Sensors—Part 1: Experiments at Room Temperature journal January 2007
Design, construction, characterization, and application of a hyperspectral microarray scanner journal January 2004
Hyperspectral confocal microscope journal January 2006
Stripping of Cosmic Spike Spectral Artifacts Using a New Upper-Bound Spectrum Algorithm journal November 2001
Removal of Cosmic Spikes from Hyper-Spectral Images Using a Hybrid Upper-Bound Spectrum Method journal January 2002
Identification of Outliers in Hyperspectral Raman Image Data by Nearest Neighbor Comparison journal November 2002
Practical Algorithm for Reducing Convex Spike Noises on a Spectrum journal March 2003
Image Curvature Correction and Cosmic Removal for High-Throughput Dispersive Raman Spectroscopy journal November 2003
Single Scan Cosmic Spike Removal Using the Upper Bound Spectrum Method journal October 2003
A Practical Algorithm to Remove Cosmic Spikes in Raman Imaging Data for Pharmaceutical Applications journal September 2007
Hyperspectral Confocal Fluorescence Imaging: Exploring Alternative Multivariate Curve Resolution Approaches journal March 2009
Removing Cosmic Ray Features from Raman Map Data by a Refined Nearest Neighbor Comparison Method as a Precursor for Chemometric Analysis journal February 2010
Simple and Efficient Method to Eliminate Spike Noise from Spectra Recorded on Charge-Coupled Device Detectors journal January 1993
Hyperspectral Raman Microscopic Imaging Using Powell Lens Line Illumination journal September 1998
An Improved Algorithm to Remove Cosmic Spikes in Raman Spectra for Online Monitoring journal November 2011
Automated Cosmic Spike Filter Optimized for Process Raman Spectroscopy journal November 2012
Automated Quantitative Spectroscopic Analysis Combining Background Subtraction, Cosmic Ray Removal, and Peak Fitting journal August 2013
Autocorrelation Analysis Combined with a Wavelet Transform Method to Detect and Remove Cosmic Rays in a Single Raman Spectrum journal August 2015
Desenvolvimento de um algoritmo para identificação e correção de spikes em espectroscopia raman de imagem journal January 2012

Cited By (1)

An Algorithm for the Removal of Cosmic Ray Artifacts in Spectral Data Sets journal April 2019

Similar Records

Sandia Hyperspectral Upper-Bound Spectrum Version 1.0
Software · Sun Apr 10 20:00:00 EDT 2016 · OSTI ID:code-45227

Application of principal component analysis and information fusion technique to detect hotspots in NOAA/AVHRR images of Jharia coalfield, India - article no. 013523
Journal Article · Sun Jul 01 00:00:00 EDT 2007 · Journal of Applied Remote Sensing · OSTI ID:21125915

Generative and Encoded Anomaly Detectors
Conference · Wed Dec 04 23:00:00 EST 2019 · OSTI ID:1765137