Variational Bayesian Blind Image Deconvolution: A review

Ruiz, Pablo; Zhou, Xu; Mateos, Javier; Molina, Rafael; Katsaggelos, Aggelos K.

doi:10.1016/j.dsp.2015.04.012

Variational Bayesian Blind Image Deconvolution: A review

Journal Article · 04 May 2015 · Digital Signal Processing

DOI:https://doi.org/10.1016/j.dsp.2015.04.012· OSTI ID:1487825

Ruiz, Pablo ^[1]; ^[2]; Mateos, Javier ^[3]; Molina, Rafael ^[3]; ^[4]

Univ. de Granada, Granada (Spain); Northwestern University
Beihang Univ., Beijing (China)
Univ. de Granada, Granada (Spain)
Northwestern Univ., Evanston, IL (United States)

In this study, we provide a review of the recent literature on Bayesian Blind Image Deconvolution (BID) methods. We believe that two events have marked the recent history of BID: the predominance of Variational Bayes (VB) inference as a tool to solve BID problems and the increasing interest of the computer vision community in solving BID problems. VB inference in combination with recent image models like the ones based on Super Gaussian (SG) and Scale Mixture of Gaussians (SMG) representations have led to the use of very general and powerful tools to provide clear images from blurry observations. In the provided review emphasis is paid on VB inference and the use of SG and SMG models with coverage of recent advances in sampling methods. We also provide examples of current state of the art BID methods and discuss problems that very likely will mark the near future of BID.

View Accepted Manuscript (DOE)

Research Organization:: Northwestern Univ., Evanston, IL (United States)

Sponsoring Organization:: USDOE; USDOE National Nuclear Security Administration (NNSA), Office of Nonproliferation and Verification Research and Development (NA-22)

Grant/Contract Number:: NA0002520

OSTI ID:: 1487825

Alternate ID(s):: OSTI ID: 1556195

Journal Information:: Digital Signal Processing, Journal Name: Digital Signal Processing Journal Issue: C Vol. 47; ISSN 1051-2004

Publisher:: ElsevierCopyright Statement

Country of Publication:: United States

Language:: English

References (44)

Non-uniform Deblurring for Shaken Images Whyte, Oliver; Sivic, Josef; Zisserman, Andrew International Journal of Computer Vision, Vol. 98, Issue 2 https://doi.org/10.1007/s11263-011-0502-7	journal	October 2011
Deblurring Shaken and Partially Saturated Images Whyte, Oliver; Sivic, Josef; Zisserman, Andrew International Journal of Computer Vision, Vol. 110, Issue 2 https://doi.org/10.1007/s11263-014-0727-3	journal	May 2014
Bayesian deconvolution of Bernoulli-Gaussian processes Lavielle, Marc Signal Processing, Vol. 33, Issue 1 https://doi.org/10.1016/0165-1684(93)90079-P	journal	July 1993
Nonlinear total variation based noise removal algorithms Rudin, Leonid I.; Osher, Stanley; Fatemi, Emad Physica D: Nonlinear Phenomena, Vol. 60, Issue 1-4 https://doi.org/10.1016/0167-2789(92)90242-F	journal	November 1992
A multiple input image restoration approach Katsaggelos, Aggelos K. Journal of Visual Communication and Image Representation, Vol. 1, Issue 1 https://doi.org/10.1016/1047-3203(90)90019-R	journal	September 1990
Markov chain Monte Carlo methods with applications to signal processing Fitzgerald, W. J. Signal Processing, Vol. 81, Issue 1 https://doi.org/10.1016/S0165-1684(00)00187-0	journal	January 2001
A boundary condition based deconvolution framework for image deblurring Zhou, Xu; Zhou, Fugen; Bai, Xiangzhi Journal of Computational and Applied Mathematics, Vol. 261 https://doi.org/10.1016/j.cam.2013.10.028	journal	May 2014
Blind motion deblurring using optical flow Xu, Yuquan; Hu, Xiyuan; Peng, Silong Optik, Vol. 126, Issue 1 https://doi.org/10.1016/j.ijleo.2014.08.139	journal	January 2015
Space-variant blur deconvolution and denoising in the dual exposure problem Tallón, Miguel; Mateos, Javier; Babacan, S. Derin Information Fusion, Vol. 14, Issue 4 https://doi.org/10.1016/j.inffus.2012.08.003	journal	October 2013
Robust blind motion deblurring using near-infrared flash image Li, Wen; Zhang, Jun; Dai, Qiong-hai Journal of Visual Communication and Image Representation, Vol. 24, Issue 8 https://doi.org/10.1016/j.jvcir.2013.09.008	journal	November 2013
Video-based non-uniform object motion blur estimation and deblurring Deng, Xiaoyu; Shen, Yan; Song, Mingli Neurocomputing, Vol. 86 https://doi.org/10.1016/j.neucom.2012.01.017	journal	June 2012
Enhanced sampling schemes for MCMC based blind Bernoulli–Gaussian deconvolution Ge, D.; Idier, J.; Le Carpentier, E. Signal Processing, Vol. 91, Issue 4 https://doi.org/10.1016/j.sigpro.2010.08.009	journal	April 2011
Simultaneous recursive displacement estimation and restoration of noisy-blurred image sequences Brailean, J. C.; Katsaggelos, A. K. IEEE Transactions on Image Processing, Vol. 4, Issue 9 https://doi.org/10.1109/83.413168	journal	January 1995
Multichannel blind deconvolution of spatially misaligned images Sroubek, F.; Flusser, J. IEEE Transactions on Image Processing, Vol. 14, Issue 7 https://doi.org/10.1109/TIP.2005.849322	journal	July 2005
Blind Deconvolution Using a Variational Approach to Parameter, Image, and Blur Estimation Molina, Rafael; Mateos, Javier; Katsaggelos, Aggelos K. IEEE Transactions on Image Processing, Vol. 15, Issue 12 https://doi.org/10.1109/TIP.2006.881972	journal	January 2006
Parameter Estimation in TV Image Restoration Using Variational Distribution Approximation Babacan, S. D.; Molina, R.; Katsaggelos, A. K. IEEE Transactions on Image Processing, Vol. 17, Issue 3 https://doi.org/10.1109/TIP.2007.916051	journal	March 2008
Variational Bayesian Image Restoration Based on a Product of $t$-Distributions Image Prior Chantas, G.; Galatsanos, N.; Likas, A. IEEE Transactions on Image Processing, Vol. 17, Issue 10 https://doi.org/10.1109/TIP.2008.2002828	journal	October 2008
Variational Bayesian Blind Deconvolution Using a Total Variation Prior Babacan, S. D.; Molina, R.; Katsaggelos, A. K. IEEE Transactions on Image Processing, Vol. 18, Issue 1 https://doi.org/10.1109/TIP.2008.2007354	journal	January 2009
Variational Bayesian Image Restoration With a Product of Spatially Weighted Total Variation Image Priors Chantas, Giannis; Galatsanos, Nikolaos P.; Molina, Rafael IEEE Transactions on Image Processing, Vol. 19, Issue 2 https://doi.org/10.1109/TIP.2009.2033398	journal	February 2010
Bayesian Blind Deconvolution From Differently Exposed Image Pairs Babacan, Sevket Derin; Wang, Jingnan; Molina, Rafael IEEE Transactions on Image Processing, Vol. 19, Issue 11, p. 2874-2888 https://doi.org/10.1109/TIP.2010.2052263	journal	June 2010
Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction Nikolova, Mila; Ng, Michael K.; Tam, Chi-Pan IEEE Transactions on Image Processing, Vol. 19, Issue 12, p. 3073-3088 https://doi.org/10.1109/TIP.2010.2052275	journal	December 2010
Restoration of Poissonian Images Using Alternating Direction Optimization Figueiredo, M. A. T.; Bioucas-Dias, J. M. IEEE Transactions on Image Processing, Vol. 19, Issue 12 https://doi.org/10.1109/TIP.2010.2053941	journal	December 2010
Robust Multichannel Blind Deconvolution via Fast Alternating Minimization Sroubek, F.; Milanfar, P. IEEE Transactions on Image Processing, Vol. 21, Issue 4 https://doi.org/10.1109/TIP.2011.2175740	journal	April 2012
Non-Uniform Deblurring in HDR Image Reconstruction Vijay, Channarayapatna Shivaram; Paramanand, Chandramouli; Rajagopalan, Ambasamudram Narayanan IEEE Transactions on Image Processing, Vol. 22, Issue 10 https://doi.org/10.1109/TIP.2013.2257809	journal	October 2013
Robust Estimation of Motion Blur Kernel Using a Piecewise-Linear Model Oh, Sungchan; Kim, Gyeonghwan IEEE Transactions on Image Processing, Vol. 23, Issue 3, p. 1394-1407 https://doi.org/10.1109/TIP.2014.2303637	journal	January 2014
Blind Image Deblurring Using Spectral Properties of Convolution Operators Liu, Guangcan; Chang, Shiyu; Ma, Yi IEEE Transactions on Image Processing, Vol. 23, Issue 12 https://doi.org/10.1109/TIP.2014.2362055	journal	December 2014
Scene Text Deblurring Using Text-Specific Multiscale Dictionaries Cao, Xiaochun; Ren, Wenqi; Zuo, Wangmeng IEEE Transactions on Image Processing, Vol. 24, Issue 4, p. 1302-1314 https://doi.org/10.1109/TIP.2015.2400217	journal	February 2015
Variational Bayesian Methods For Multimedia Problems Chen, Zhaofu; Babacan, S. Derin; Molina, Rafael IEEE Transactions on Multimedia, Vol. 16, Issue 4 https://doi.org/10.1109/TMM.2014.2307692	journal	June 2014
Efficient Patch-Wise Non-Uniform Deblurring for a Single Image Yu, Xin; Xu, Feng; Zhang, Shunli IEEE Transactions on Multimedia, Vol. 16, Issue 6 https://doi.org/10.1109/TMM.2014.2321734	journal	October 2014
Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images Geman, Stuart; Geman, Donald IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-6, Issue 6 https://doi.org/10.1109/TPAMI.1984.4767596	journal	November 1984
Correction of Spatially Varying Image and Video Motion Blur Using a Hybrid Camera Tai, Yu-Wing; Du, Hao; Brown, Michael S. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 32, Issue 6, p. 1012-1028 https://doi.org/10.1109/TPAMI.2009.97	journal	May 2009
Richardson-Lucy Deblurring for Scenes under a Projective Motion Path No authors listed IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, Issue 8 https://doi.org/10.1109/TPAMI.2010.222	journal	August 2011
Understanding Blind Deconvolution Algorithms Levin, A.; Weiss, Y.; Durand, F. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, Issue 12 https://doi.org/10.1109/TPAMI.2011.148	journal	December 2011
Removing Atmospheric Turbulence via Space-Invariant Deconvolution Zhu, Xiang; Milanfar, Peyman IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, Issue 1 https://doi.org/10.1109/TPAMI.2012.82	journal	January 2013
A Variational Approach for Bayesian Blind Image Deconvolution Likas, A. C.; Galatsanos, N. P. IEEE Transactions on Signal Processing, Vol. 52, Issue 8 https://doi.org/10.1109/TSP.2004.831119	journal	August 2004
Blind Deconvolution of Sparse Pulse Sequences Under a Minimum Distance Constraint: A Partially Collapsed Gibbs Sampler Method Kail, Georg; Tourneret, Jean-Yves; Hlawatsch, Franz IEEE Transactions on Signal Processing, Vol. 60, Issue 6 https://doi.org/10.1109/TSP.2012.2190066	journal	June 2012
Enhancing Bayesian Estimators for Removing Camera Shake: Enhancing Bayesian Estimators Wang, C.; Yue, Y.; Dong, F. Computer Graphics Forum, Vol. 32, Issue 6 https://doi.org/10.1111/cgf.12074	journal	March 2013
Image deblurring in smartphone devices using built-in inertial measurement sensors Šindelář, Ondřej; Šroubek, Filip Journal of Electronic Imaging, Vol. 22, Issue 1 https://doi.org/10.1117/1.JEI.22.1.011003	journal	January 2013
Blind nonuniform deblur under projection motion path Zhang, Xin; Sun, Fuchun Journal of Electronic Imaging, Vol. 22, Issue 3 https://doi.org/10.1117/1.JEI.22.3.033034	journal	July 2013
Nonconvex TV$^q$-Models in Image Restoration: Analysis and a Trust-Region Regularization--Based Superlinearly Convergent Solver Hintermüller, Michael; Wu, Tao SIAM Journal on Imaging Sciences, Vol. 6, Issue 3 https://doi.org/10.1137/110854746	journal	January 2013
Optimality Conditions and a Smoothing Trust Region Newton Method for NonLipschitz Optimization Chen, Xiaojun; Niu, Lingfeng; Yuan, Yaxiang SIAM Journal on Optimization, Vol. 23, Issue 3 https://doi.org/10.1137/120871390	journal	January 2013
Image deblurring using inertial measurement sensors Joshi, Neel; Kang, Sing Bing; Zitnick, C. Lawrence ACM Transactions on Graphics, Vol. 29, Issue 4 https://doi.org/10.1145/1778765.1778767	journal	July 2010
Sparse Bayesian blind image deconvolution with parameter estimation Amizic, Bruno; Molina, Rafael; Katsaggelos, Aggelos K. EURASIP Journal on Image and Video Processing, Vol. 2012, Issue 1 https://doi.org/10.1186/1687-5281-2012-20	journal	November 2012
Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers Boyd, Stephen; Parikh, Neal; Chu, Eric https://doi.org/10.1561/2200000016	book	January 2011

Cited By (2)

Fluorescence imaging reversion using spatially variant deconvolution Anastasopoulou, Maria; Gorpas, Dimitris; Koch, Maximilian Scientific Reports, Vol. 9, Issue 1 https://doi.org/10.1038/s41598-019-54578-0	journal	December 2019
Video stabilization in atmosphere turbulent conditions based on the Laplacian-Riesz pyramid Xue, Bindang; Liu, Yi; Cui, Linyan Optics Express, Vol. 24, Issue 24 https://doi.org/10.1364/oe.24.028092	journal	January 2016

Similar Records

Fast Bayesian blind deconvolution with Huber Super Gaussian priors

Journal Article · 2016 · Digital Signal Processing · OSTI ID:1487466

Variational Dirichlet Blur Kernel Estimation

Journal Article · 2015 · IEEE Transactions on Image Processing · OSTI ID:1487984

Blind deconvolution of two-dimensional complex data

Technical Report · 1993 · OSTI ID:10127824

Related Subjects

97 MATHEMATICS AND COMPUTING
Bayesian modeling
Blind deconvolution
Image deblurring
Image restoration
Variational Bayesian

Variational Bayesian Blind Image Deconvolution: A review

Citation Formats

References (44)

Cited By (2)

Similar Records

Related Subjects