Bayesian K-SVD Using Fast Variational Inference
- Univ. de Granada, Granada (Spain)
- Politecnico di Torino, Turin (Italy)
- Northwestern Univ., Evanston, IL (United States)
Recent work in signal processing in general and image processing in particular deals with sparse representation related problems. Two such problems are of paramount importance: an overriding need for designing a well-suited overcomplete dictionary containing a redundant set of atoms— i.e., basis signals—and how to find a sparse representation of a given signal with respect to the chosen dictionary. Dictionary learning techniques, among which we find the popular K-singular value decomposition algorithm, tackle these problems by adapting a dictionary to a set of training data. A common drawback of such techniques is the need for parameter-tuning. In order to overcome this limitation, we propose a fullyautomated Bayesian method that considers the uncertainty of the estimates and produces a sparse representation of the data without prior information on the number of non-zeros in each representation vector. We follow a Bayesian approach that uses a three-tiered hierarchical prior to enforce sparsity on the representations and develop an efficient variational inference framework that reduces computational complexity. Furthermore, we describe a greedy approach that speeds up the whole process. Lastly, we present experimental results that show superior performance on two different applications with real images: denoising and inpainting.
- Research Organization:
- Northwestern Univ., Evanston, IL (United States)
- Sponsoring Organization:
- USDOE National Nuclear Security Administration (NNSA), Office of Nonproliferation and Verification Research and Development (NA-22)
- DOE Contract Number:
- NA0002520
- OSTI ID:
- 1487464
- Journal Information:
- IEEE Transactions on Image Processing, Vol. 26, Issue 7; ISSN 1057-7149
- Publisher:
- IEEE
- Country of Publication:
- United States
- Language:
- English
Similar Records
Dictionary construction in sparse methods for image restoration
A regression algorithm for accelerated lattice QCD that exploits sparse inference on the D-Wave quantum annealer