skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Removing cosmic spikes using a hyperspectral upper-bound spectrum method

Journal Article · · Applied Spectroscopy
 [1];  [1]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States). Bioenergy and Defense Technologies

Cosmic ray spikes are especially problematic for hyperspectral imaging, due to the large number of spikes often present and their negative effects upon subsequent chemometric analysis. Fortunately, while the large number of spectra acquired in a hyperspectral imaging data set increases the probability and number of cosmic spikes observed, the multitude of spectra can also aid in the effective recognition and removal of the cosmic spikes. Dongmao Zhang and Dor Ben-Amotz were perhaps the first to leverage the additional spatial dimension of hyperspectral data matrices (DM). They integrated principal component analysis (PCA) into the upper bound spectrum method (UBS), resulting in a hybrid method (UBS-DM) for hyperspectral images. Here, we expand upon their use of PCA, recognizing that principal components primarily present in only a few pixels most likely correspond to cosmic spikes. Eliminating the contribution of those principal components in those pixels improves the cosmic spike removal. Both simulated and experimental hyperspectral Raman image data sets are used to test the newly developed UBS-DM-hyperspectral (UBS-DM-HS) method which extends the UBS-DM method by leveraging characteristics of hyperspectral datasets. Lastly, a comparison is provided between the performance of the UBS-DM-HS method and other methods suitable for despiking hyperspectral images, evaluating both their ability to remove cosmic ray spikes and the extent to which they introduce spectral bias.

Research Organization:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC04-94AL85000
OSTI ID:
1336918
Report Number(s):
SAND2016-8518J; 647028
Journal Information:
Applied Spectroscopy, Journal Name: Applied Spectroscopy; ISSN 0003-7028
Publisher:
Society for Applied SpectroscopyCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 3 works
Citation information provided by
Web of Science

References (28)

Simple and Efficient Method to Eliminate Spike Noise from Spectra Recorded on Charge-Coupled Device Detectors journal January 1993
An Improved Algorithm to Remove Cosmic Spikes in Raman Spectra for Online Monitoring journal November 2011
Information-theoretic chemometric analyses of Raman data for chemical reaction studies: Information-theoretic chemometric analyses of Raman data journal January 2011
Hyperspectral Confocal Fluorescence Imaging: Exploring Alternative Multivariate Curve Resolution Approaches journal March 2009
Evaluation of Cosmic Ray Rejection Algorithms on Single-Shot Exposures journal January 2005
A Practical Algorithm to Remove Cosmic Spikes in Raman Imaging Data for Pharmaceutical Applications journal September 2007
Hyperspectral Raman Microscopic Imaging Using Powell Lens Line Illumination journal September 1998
Outlier Detection in Multivariate Analytical Chemical Data journal June 1998
Preprocessing strategies to improve MCR analyses of hyperspectral images journal August 2012
Polynomial filters for data sets with outlying or missing observations: application to charge-coupled-device-detected Raman spectra contaminated by cosmic rays journal November 1990
Kernel principal component analysis residual diagnosis (KPCARD): An automated method for cosmic ray artifact removal in Raman spectra journal March 2016
Design, construction, characterization, and application of a hyperspectral microarray scanner journal January 2004
Desenvolvimento de um algoritmo para identificação e correção de spikes em espectroscopia raman de imagem journal January 2012
Removal of Cosmic Spikes from Hyper-Spectral Images Using a Hybrid Upper-Bound Spectrum Method journal January 2002
Application of principal component analysis to detect outliers and spectral deviations in near-field surface-enhanced Raman spectra journal November 2001
Spike Removal and Denoising of Raman Spectra by Wavelet Transform Methods journal September 2001
Image Curvature Correction and Cosmic Removal for High-Throughput Dispersive Raman Spectroscopy journal November 2003
Autocorrelation Analysis Combined with a Wavelet Transform Method to Detect and Remove Cosmic Rays in a Single Raman Spectrum journal August 2015
Removing Cosmic Ray Features from Raman Map Data by a Refined Nearest Neighbor Comparison Method as a Precursor for Chemometric Analysis journal February 2010
Automated Cosmic Spike Filter Optimized for Process Raman Spectroscopy journal November 2012
Stripping of Cosmic Spike Spectral Artifacts Using a New Upper-Bound Spectrum Algorithm journal November 2001
Automated Quantitative Spectroscopic Analysis Combining Background Subtraction, Cosmic Ray Removal, and Peak Fitting journal August 2013
Practical Algorithm for Reducing Convex Spike Noises on a Spectrum journal March 2003
Influence of Terrestrial Cosmic Rays on the Reliability of CCD Image Sensors—Part 1: Experiments at Room Temperature journal January 2007
Hyperspectral confocal microscope journal January 2006
Multivariate curve resolution: A review of advanced and tailored applications and challenges journal February 2013
Single Scan Cosmic Spike Removal Using the Upper Bound Spectrum Method journal October 2003
Identification of Outliers in Hyperspectral Raman Image Data by Nearest Neighbor Comparison journal November 2002

Cited By (1)

An Algorithm for the Removal of Cosmic Ray Artifacts in Spectral Data Sets journal April 2019