Automatic Kalman-filter-based wavelet shrinkage denoising of 1D stellar spectra

Gilda, Sankalp; Slepian, Zachary

doi:10.1093/mnras/stz2577

Title: Automatic Kalman-filter-based wavelet shrinkage denoising of 1D stellar spectra

Journal Article · Mon Sep 16 00:00:00 EDT 2019 · Monthly Notices of the Royal Astronomical Society

DOI:https://doi.org/10.1093/mnras/stz2577· OSTI ID:1603546

Gilda, Sankalp ^[1]; Slepian, Zachary ^[2]

Univ. of Florida, Gainesville, FL (United States)
Univ. of Florida, Gainesville, FL (United States); Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Univ. of California, Berkeley, CA (United States)

We propose a non-parametric method to denoise 1D stellar spectra based on wavelet shrinkage followed by adaptive Kalman thresholding. Wavelet shrinkage denoising involves applying the discrete wavelet transform (DWT) to the input signal, ‘shrinking’ certain frequency components in the transform domain, and then applying inverse DWT to the reduced components. The performance of this procedure is influenced by the choice of base wavelet, the number of decomposition levels, and the thresholding function. Typically, these parameters are chosen by ‘trial and error’, which can be strongly dependent on the properties of the data being denoised. We here introduce an adaptive Kalman-filter-based thresholding method that eliminates the need for choosing the number of decomposition levels. We use the ‘Haar’ wavelet basis, which we found to provide excellent filtering for 1D stellar spectra, at a low computational cost. We introduce various levels of Poisson noise into synthetic PHOENIX spectra, and test the performance of several common denoising methods against our own. It proves superior in terms of noise suppression and peak shape preservation. Finally, we expect it may also be of use in automatically and accurately filtering low signal-to-noise galaxy and quasar spectra obtained from surveys such as SDSS, Gaia, LSST, PESSTO, VANDELS, LEGA-C, and DESI.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)

Sponsoring Organization:: USDOE Office of Science (SC)

Grant/Contract Number:: AC02-05CH11231

OSTI ID:: 1603546

Journal Information:: Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 4; ISSN 0035-8711

Publisher:: Royal Astronomical SocietyCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 1 work

Citation information provided by
Web of Science

References (32)

A New Signal Denoising Algorithm from Wavelet Modulus Maxima Liu, Yi; Cheng, Xu Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007) https://doi.org/10.1109/FSKD.2007.90	conference	August 2007
The Effect of AGN Heating on the Low-redshift Ly α Forest Gurvich, Alex; Burkhart, Blakesley; Bird, Simeon The Astrophysical Journal, Vol. 835, Issue 2 https://doi.org/10.3847/1538-4357/835/2/175	journal	January 2017
Bayesian unscented Kalman filter for state estimation of nonlinear and non-Gaussian systems Liu, Zhong; Chan, Shing-Chow; Wu, Ho-Chun 2016 24th European Signal Processing Conference (EUSIPCO) https://doi.org/10.1109/EUSIPCO.2016.7760287	conference	August 2016
Multiwavelets denoising using neighboring coefficients Chen, G. Y.; Bui, T. D. IEEE Signal Processing Letters, Vol. 10, Issue 7 https://doi.org/10.1109/LSP.2003.811586	journal	July 2003
Parameter estimation for leaky aquifers using the extended Kalman filter, and considering model and data measurement uncertainties Yeh, H. D.; Huang, Y. C. Journal of Hydrology, Vol. 302, Issue 1-4 https://doi.org/10.1016/j.jhydrol.2004.06.035	journal	February 2005
A theory for multiresolution signal decomposition: the wavelet representation Mallat, S. G. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 11, Issue 7 https://doi.org/10.1109/34.192463	journal	July 1989
A method of eliminating the signal-dependent random noise from the raw CMOS image sensor data based on Kalman filter Zhang, Yu; Wang, Guangyi; Xu, Jiangtao Signal Processing, Vol. 104 https://doi.org/10.1016/j.sigpro.2014.04.026	journal	November 2014
An introduction to wavelets Graps, A. IEEE Computational Science and Engineering, Vol. 2, Issue 2 https://doi.org/10.1109/99.388960	journal	July 1995
Speech denoising using discrete wavelet packet decomposition technique Oktar, Mehmet Alper; Nibouche, Mokhtar; Baltaci, Yusuf 2016 24th Signal Processing and Communication Application Conference (SIU) https://doi.org/10.1109/SIU.2016.7495865	conference	May 2016
Warm dark matter as a solution to the small scale crisis: New constraints from high redshift Lyman- $α$ forest data Viel, Matteo; Becker, George D.; Bolton, James S. Physical Review D, Vol. 88, Issue 4 https://doi.org/10.1103/PhysRevD.88.043502	journal	August 2013
Wavelet Threshold Estimators for Data with Correlated Noise Johnstone, Iain M.; Silverman, Bernard W. Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 59, Issue 2 https://doi.org/10.1111/1467-9868.00071	journal	May 1997
The what, how, and why of wavelet shrinkage denoising Taswell, C. Computing in Science & Engineering, Vol. 2, Issue 3 https://doi.org/10.1109/5992.841791	journal	January 2000
A New Wavelet Denoising Method for Selecting Decomposition Levels and Noise Thresholds Srivastava, Madhur; Anderson, C. Lindsay; Freed, Jack H. IEEE Access, Vol. 4 https://doi.org/10.1109/ACCESS.2016.2587581	journal	January 2016
Adapting to Unknown Smoothness via Wavelet Shrinkage Donoho, David L.; Johnstone, Iain M. Journal of the American Statistical Association, Vol. 90, Issue 432 https://doi.org/10.1080/01621459.1995.10476626	journal	December 1995
A novel technique for selecting mother wavelet function using an intelli gent fault diagnosis system Rafiee, J.; Tse, P. W.; Harifi, A. Expert Systems with Applications, Vol. 36, Issue 3 https://doi.org/10.1016/j.eswa.2008.05.052	journal	April 2009
A wavelet-based data pre-processing analysis approach in mass spectrometry Li, Xiaoli; Li, Jin; Yao, Xin Computers in Biology and Medicine, Vol. 37, Issue 4 https://doi.org/10.1016/j.compbiomed.2006.08.009	journal	April 2007
Adaptive wavelet packet thresholding with iterative Kalman filter for speech enhancement Zhao, Mengjiao; Zhu, Wei-Ping 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP) https://doi.org/10.1109/GlobalSIP.2017.8308606	conference	November 2017
Image Quality Assessment: From Error Visibility to Structural Similarity Wang, Z.; Bovik, A. C.; Sheikh, H. R. IEEE Transactions on Image Processing, Vol. 13, Issue 4 https://doi.org/10.1109/TIP.2003.819861	journal	April 2004
A New Approach to Linear Filtering and Prediction Problems Kalman, R. E. Journal of Basic Engineering, Vol. 82, Issue 1 https://doi.org/10.1115/1.3662552	journal	March 1960
Improved Image Denoising Technique Using Neighboring Wavelet Coefficients of Optimal Wavelet with Adaptive Thresholding Kumar, Rakesh; Saini, B. S. International Journal of Computer Theory and Engineering https://doi.org/10.7763/IJCTE.2012.V4.491	journal	January 2012
Wavelet-Based Combined Signal Filtering and Prediction Renaud, O.; Starck, J. -L.; Murtagh, F. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), Vol. 35, Issue 6 https://doi.org/10.1109/TSMCB.2005.850182	journal	December 2005
Adaptive wavelet thresholding for image denoising and compression Chang, S. G.; Vetterli, M. IEEE Transactions on Image Processing, Vol. 9, Issue 9 https://doi.org/10.1109/83.862633	journal	January 2000
Covariance matching based adaptive unscented Kalman filter for direct filtering in INS/GNSS integration Meng, Yang; Gao, Shesheng; Zhong, Yongmin Acta Astronautica, Vol. 120 https://doi.org/10.1016/j.actaastro.2015.12.014	journal	March 2016
Ideal spatial adaptation by wavelet shrinkage Donoho, David L.; Johnstone, Iain M. Biometrika, Vol. 81, Issue 3 https://doi.org/10.1093/biomet/81.3.425	journal	September 1994
Auto Regressive Moving Average (ARMA) Modeling Method for Gyro Random Noise Using a Robust Kalman Filter Huang, Lei Sensors, Vol. 15, Issue 10 https://doi.org/10.3390/s151025277	journal	September 2015
On-line Support Vector Regression of the transition model for the Kalman filter Salti, Samuele; Di Stefano, Luigi Image and Vision Computing, Vol. 31, Issue 6-7 https://doi.org/10.1016/j.imavis.2012.09.008	journal	June 2013
Analysis of time-varying signals using continuous wavelet and synchrosqueezed transforms Tary, Jean Baptiste; Herrera, Roberto Henry; van der Baan, Mirko Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 376, Issue 2126 https://doi.org/10.1098/rsta.2017.0254	journal	July 2018
Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures IEEE Signal Processing Magazine, Vol. 26, Issue 1 https://doi.org/10.1109/MSP.2008.930649	journal	January 2009
Learning to swim in a sea of wavelets Bultheel, Adhemar Bulletin of the Belgian Mathematical Society - Simon Stevin, Vol. 2, Issue 1 https://doi.org/10.36045/bbms/1103408773	journal	January 1995
New constraints on the free-streaming of warm dark matter from intermediate and small scale Lyman- $α$ forest data Iršič, Vid; Viel, Matteo; Haehnelt, Martin G. Physical Review D, Vol. 96, Issue 2 https://doi.org/10.1103/PhysRevD.96.023522	journal	July 2017
Adaptive unscented Kalman filter for parameter and state estimation of nonlinear high-speed objects Deng, Fang; Chen, Jie; Chen, Chen Journal of Systems Engineering and Electronics, Vol. 24, Issue 4 https://doi.org/10.1109/JSEE.2013.00076	journal	August 2013
A new extensive library of PHOENIX stellar atmospheres and synthetic spectra Husser, T. -O.; Wende-von Berg, S.; Dreizler, S. Astronomy & Astrophysics, Vol. 553 https://doi.org/10.1051/0004-6361/201219058	journal	April 2013

Cited By (1)

A Novel Use of Discrete Wavelet Transform Features in the Prediction of Epileptic Seizures from EEG Data Feudjio, Cyrille; Noyum, Victoire Djimna; Mofendjou, Younous Perieukeu arXiv https://doi.org/10.48550/arxiv.2102.01647	preprint	January 2021

Similar Records

Empirical Mode Decomposition Technique with Conditional Mutual Information for Denoising Operational Sensor Data

Journal Article · Fri Apr 15 00:00:00 EDT 2011 · IEEE Sensors Journal · OSTI ID:1603546

Omitaomu, Olufemi A.; Protopopescu, Vladimir A.; Ganguly, Auroop R.

A Step-Down Test Procedure for Wavelet Shrinkage Using Bootstrapping

Journal Article · Fri Sep 18 00:00:00 EDT 2020 · IEEE Access · OSTI ID:1603546

Lim, Munwon; Omitaomu, Olufemi A.; Bae, Suk Joo

Denoising solar radiation data using coiflet wavelets

Journal Article · Fri Oct 24 00:00:00 EDT 2014 · AIP Conference Proceedings · OSTI ID:1603546

Sulaiman, Jumat; Ismail, Mohd Tahir

Related Subjects

79 ASTRONOMY AND ASTROPHYSICS
data analysis
statistical
image processing
spectroscopic

Title: Automatic Kalman-filter-based wavelet shrinkage denoising of 1D stellar spectra

Citation Formats

References (32)

Cited By (1)

Similar Records

Related Subjects