Dictionary construction in sparse methods for image restoration

Wohlberg, Brendt

Title: Dictionary construction in sparse methods for image restoration

Full Record
Other Related Research

Abstract

Sparsity-based methods have achieved very good performance in a wide variety of image restoration problems, including denoising, inpainting, super-resolution, and source separation. These methods are based on the assumption that the image to be reconstructed may be represented as a superposition of a few known components, and the appropriate linear combination of components is estimated by solving an optimization such as Basis Pursuit De-Noising (BPDN). Considering that the K-SVD constructs a dictionary which has been optimised for mean performance over a training set, it is not too surprising that better performance can be achieved by selecting a custom dictionary for each individual block to be reconstructed. The nearest neighbor dictionary construction can be understood geometrically as a method for estimating the local projection into the manifold of image blocks, whereas the K-SVD dictionary makes more sense within a source-coding framework (it is presented as a generalization of the k-means algorithm for constructing a VQ codebook), is therefore, it could be argued, less appropriate in principle, for reconstruction problems. One can, of course, motivate the use of the K-SVD in reconstruction application on practical grounds, avoiding the computational expense of constructing a different dictionary for each block to be denoised. Sincemore »« less

Authors:

Wohlberg, Brendt ^[1]

Los Alamos National Laboratory

Publication Date:: Fri Jan 01 00:00:00 EST 2010

Research Org.:: Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)

Sponsoring Org.:: USDOE

OSTI Identifier:: 983230

Report Number(s):: LA-UR-10-00042; LA-UR-10-42
TRN: US201014%%427

DOE Contract Number:: AC52-06NA25396

Resource Type:: Journal Article

Country of Publication:: United States

Language:: English

Subject:: 99 GENERAL AND MISCELLANEOUS; ALGORITHMS; CONSTRUCTION; OPTIMIZATION; PERFORMANCE; TRAINING

Citation Formats


                    Wohlberg, Brendt. Dictionary construction in sparse methods for image restoration.  United States: N. p., 2010. 
        Web.

Copy to clipboard


                    Wohlberg, Brendt. Dictionary construction in sparse methods for image restoration.  United States.

Copy to clipboard


                    Wohlberg, Brendt. 2010.  
        "Dictionary construction in sparse methods for image restoration".  United States.  https://www.osti.gov/servlets/purl/983230.

Copy to clipboard


                    
@article{osti_983230,

  title        = {Dictionary construction in sparse methods for image restoration},

  author       = {Wohlberg, Brendt},

  abstractNote = {Sparsity-based methods have achieved very good performance in a wide variety of image restoration problems, including denoising, inpainting, super-resolution, and source separation. These methods are based on the assumption that the image to be reconstructed may be represented as a superposition of a few known components, and the appropriate linear combination of components is estimated by solving an optimization such as Basis Pursuit De-Noising (BPDN). Considering that the K-SVD constructs a dictionary which has been optimised for mean performance over a training set, it is not too surprising that better performance can be achieved by selecting a custom dictionary for each individual block to be reconstructed. The nearest neighbor dictionary construction can be understood geometrically as a method for estimating the local projection into the manifold of image blocks, whereas the K-SVD dictionary makes more sense within a source-coding framework (it is presented as a generalization of the k-means algorithm for constructing a VQ codebook), is therefore, it could be argued, less appropriate in principle, for reconstruction problems. One can, of course, motivate the use of the K-SVD in reconstruction application on practical grounds, avoiding the computational expense of constructing a different dictionary for each block to be denoised. Since the performance of the nearest neighbor dictionary decreases when the dictionary becomes sufficiently large, this method is also superior to the approach of utilizing the entire training set as a dictionary (and this can also be understood within the image block manifold model). In practical terms, the tradeoff is between the computational cost of a nearest neighbor search (which can be achieved very efficiently), or of increased cost at the sparse optimization.},

  doi          = {},

  url          = {https://www.osti.gov/biblio/983230},
  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {Fri Jan 01 00:00:00 EST 2010},

  month        = {Fri Jan 01 00:00:00 EST 2010}

}

Copy to clipboard

Journal Article:

View Journal Article (1.03 MB)

Other availability

Find in Google Scholar

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Similar records in OSTI.GOV collections:

TU-F-BRF-06: 3D Pancreas MRI Segmentation Using Dictionary Learning and Manifold Clustering

Journal Article Gou, S; Rapacchi, S; Hu, P; ... - Medical Physics

Purpose: The recent advent of MRI guided radiotherapy machines has lent an exciting platform for soft tissue target localization during treatment. However, tools to efficiently utilize MRI images for such purpose have not been developed. Specifically, to efficiently quantify the organ motion, we develop an automated segmentation method using dictionary learning and manifold clustering (DLMC). Methods: Fast 3D HASTE and VIBE MR images of 2 healthy volunteers and 3 patients were acquired. A bounding box was defined to include pancreas and surrounding normal organs including the liver, duodenum and stomach. The first slice of the MRI was used for dictionarymore »« less
https://doi.org/10.1118/1.4889324
Bayesian K-SVD Using Fast Variational Inference

Journal Article Serra, Juan; Testa, Matteo; Molina, Rafael; ... - IEEE Transactions on Image Processing

Recent work in signal processing in general and image processing in particular deals with sparse representation related problems. Two such problems are of paramount importance: an overriding need for designing a well-suited overcomplete dictionary containing a redundant set of atoms— i.e., basis signals—and how to find a sparse representation of a given signal with respect to the chosen dictionary. Dictionary learning techniques, among which we find the popular K-singular value decomposition algorithm, tackle these problems by adapting a dictionary to a set of training data. A common drawback of such techniques is the need for parameter-tuning. In order to overcomemore »« less
https://doi.org/10.1109/TIP.2017.2681436
Path-Based Dictionary Augmentation: A Framework for Improving $$k$$ -Sparse Image Processing

Journal Article Emerson, Tegan; Olson, Colin; Doster, Timothy - IEEE Transactions on Image Processing

In this study, we have previously shown that augmenting orthogonal matching pursuit (OMP) with an additional step in the identification stage of each pursuit iteration yields improved $$k$$ -sparse reconstruction and denoising performance relative to baseline OMP. At each iteration a “path” or geodesic, is generated between the two dictionary atoms that are most correlated with the residual and from this path a new atom that has a greater correlation to the residual than either of the two bracketing atoms is selected. Here, we provide new computational results illustrating improvements in sparse coding and denoising on canonical datasets using bothmore »« less
Cited by 1
https://doi.org/10.1109/TIP.2019.2927331

Full Text Available
SU-F-I-12: Region-Specific Dictionary Learning for Low-Dose X-Ray CT Reconstruction

Journal Article Xu, Q; Han, H; Xing, L - Medical Physics

Purpose: Dictionary learning based method has attracted more and more attentions in low-dose CT due to the superior performance on suppressing noise and preserving structural details. Considering the structures and noise vary from region to region in one imaging object, we propose a region-specific dictionary learning method to improve the low-dose CT reconstruction. Methods: A set of normal-dose images was used for dictionary learning. Segmentations were performed on these images, so that the training patch sets corresponding to different regions can be extracted out. After that, region-specific dictionaries were learned from these training sets. For the low-dose CT reconstruction, amore »« less
https://doi.org/10.1118/1.4955840
A regression algorithm for accelerated lattice QCD that exploits sparse inference on the D-Wave quantum annealer

Journal Article Nguyen, Nga; Kenyon, Garrett; Yoon, Boram - Scientific Reports

We propose a regression algorithm that utilizes a learned dictionary optimized for sparse inference on a D-Wave quantum annealer. In this regression algorithm, we concatenate the independent and dependent variables as a combined vector, and encode the high-order correlations between them into a dictionary optimized for sparse reconstruction. On a test dataset, the dependent variable is initialized to its average value and then a sparse reconstruction of the combined vector is obtained in which the dependent variable is typically shifted closer to its true value, as in a standard inpainting or denoising task. Here, a quantum annealer, which can presumablymore »« less
Cited by 4
https://doi.org/10.1038/s41598-020-67769-x

Full Text Available

Similar Records