Deep Equilibrium Learning of Explicit Regularization Functionals for Imaging Inverse Problems

Zou, Zihao; Liu, Jiaming; Wohlberg, Brendt; Kamilov, Ulugbek S.

doi:10.1109/OJSP.2023.3296036

Deep Equilibrium Learning of Explicit Regularization Functionals for Imaging Inverse Problems

Journal Article · Sun Jan 01 00:00:00 EST 2023 · IEEE Open Journal of Signal Processing (Online)

DOI:https://doi.org/10.1109/OJSP.2023.3296036· OSTI ID:1994422

Zou, Zihao ^[1]; ^[2]; ^[3]; ^[1]

Department of Computer Science &, Engineering, Washington University, St. Louis, MO, USA
Department of Electrical &, Systems Engineering, Washington University, St. Louis, MO, USA
Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA

Not Available

View Journal Article

Research Organization:: Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)

Sponsoring Organization:: National Science Foundation (NSF); USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program

Grant/Contract Number:: 89233218CNA000001

OSTI ID:: 1994422

Alternate ID(s):: OSTI ID: 1993237
OSTI ID: 1994423

Report Number(s):: LA-UR-23-22511; 10184493

Journal Information:: IEEE Open Journal of Signal Processing (Online), Journal Name: IEEE Open Journal of Signal Processing (Online) Vol. 4; ISSN 2644-1322

Publisher:: Institute of Electrical and Electronics EngineersCopyright Statement

Country of Publication:: United States

Language:: English

References (29)

Image Super-Resolution Using Very Deep Residual Channel Attention Networks Zhang, Yulun; Li, Kunpeng; Li, Kai Computer Vision – ECCV 2018 https://doi.org/10.1007/978-3-030-01234-2_18	book	January 2018
Convex Optimization Boyd, Stephen; Vandenberghe, Lieven https://doi.org/10.1017/CBO9780511804441	book	January 2004
NETT: solving inverse problems with deep neural networks Li, Housen; Schwab, Johannes; Antholzer, Stephan Inverse Problems, Vol. 36, Issue 6 https://doi.org/10.1088/1361-6420/ab6d57	journal	June 2020
A Novel Learned Primal-Dual Network for Image Compressive Sensing Zhang, Chaolong; Liu, Yuanyuan; Shang, Fanhua IEEE Access, Vol. 9 https://doi.org/10.1109/ACCESS.2021.3057621	journal	January 2021
Learning Deep CNN Denoiser Prior for Image Restoration Zhang, Kai; Zuo, Wangmeng; Gu, Shuhang 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2017.300	conference	July 2017
ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing Zhang, Jian; Ghanem, Bernard 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2018.00196	conference	June 2018
Total Deep Variation for Linear Inverse Problems Kobler, Erich; Effland, Alexander; Kunisch, Karl 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR42600.2020.00757	conference	June 2020
Plug-and-Play priors for model based reconstruction Venkatakrishnan, Singanallur V.; Bouman, Charles A.; Wohlberg, Brendt 2013 IEEE Global Conference on Signal and Information Processing (GlobalSIP) https://doi.org/10.1109/GlobalSIP.2013.6737048	conference	December 2013
Deep Learning Techniques for Inverse Problems in Imaging Ongie, Gregory; Jalal, Ajil; Metzler, Christopher A. IEEE Journal on Selected Areas in Information Theory, Vol. 1, Issue 1 https://doi.org/10.1109/JSAIT.2020.2991563	journal	May 2020
Convolutional Neural Networks for Inverse Problems in Imaging: A Review McCann, Michael T.; Jin, Kyong Hwan; Unser, Michael IEEE Signal Processing Magazine, Vol. 34, Issue 6 https://doi.org/10.1109/MSP.2017.2739299	journal	November 2017
Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods Lucas, Alice; Iliadis, Michael; Molina, Rafael IEEE Signal Processing Magazine, Vol. 35, Issue 1 https://doi.org/10.1109/MSP.2017.2760358	journal	January 2018
Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing Monga, Vishal; Li, Yuelong; Eldar, Yonina C. IEEE Signal Processing Magazine, Vol. 38, Issue 2 https://doi.org/10.1109/MSP.2020.3016905	journal	March 2021
Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imaging: Theory, algorithms, and applications Kamilov, Ulugbek S.; Bouman, Charles A.; Buzzard, Gregery T. IEEE Signal Processing Magazine, Vol. 40, Issue 1 https://doi.org/10.1109/MSP.2022.3199595	journal	January 2023
Learned Reconstruction Methods With Convergence Guarantees: A survey of concepts and applications Mukherjee, Subhadip; Hauptmann, Andreas; Oktem, Ozan IEEE Signal Processing Magazine, Vol. 40, Issue 1 https://doi.org/10.1109/MSP.2022.3207451	journal	January 2023
Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation Sreehari, Suhas; Venkatakrishnan, Singanallur V.; Wohlberg, Brendt IEEE Transactions on Computational Imaging https://doi.org/10.1109/TCI.2016.2599778	journal	January 2016
Regularization by Denoising: Clarifications and New Interpretations Reehorst, Edward T.; Schniter, Philip IEEE Transactions on Computational Imaging, Vol. 5, Issue 1 https://doi.org/10.1109/TCI.2018.2880326	journal	March 2019
Block Coordinate Regularization by Denoising Sun, Yu; Liu, Jiaming; Kamilov, Ulugbek S. IEEE Transactions on Computational Imaging, Vol. 6 https://doi.org/10.1109/TCI.2020.2996385	journal	January 2020
Deep Equilibrium Architectures for Inverse Problems in Imaging Gilton, Davis; Ongie, Gregory; Willett, Rebecca IEEE Transactions on Computational Imaging, Vol. 7 https://doi.org/10.1109/TCI.2021.3118944	journal	January 2021
Memory-Efficient Model-Based Deep Learning With Convergence and Robustness Guarantees Pramanik, Aniket; Zimmerman, M. Bridget; Jacob, Mathews IEEE Transactions on Computational Imaging, Vol. 9 https://doi.org/10.1109/TCI.2023.3252268	journal	January 2023
An EM algorithm for wavelet-based image restoration Figueiredo, M. A. T.; Nowak, R. D. IEEE Transactions on Image Processing, Vol. 12, Issue 8 https://doi.org/10.1109/TIP.2003.814255	journal	August 2003
Insights Into Analysis Operator Learning: From Patch-Based Sparse Models to Higher Order MRFs No authors listed IEEE Transactions on Image Processing, Vol. 23, Issue 3 https://doi.org/10.1109/TIP.2014.2299065	journal	March 2014
Fast Single Image Super-Resolution Using a New Analytical Solution for $\ell _{2}$ – $\ell _{2}$ Problems Zhao, Ningning; Wei, Qi; Basarab, Adrian IEEE Transactions on Image Processing, Vol. 25, Issue 8 https://doi.org/10.1109/TIP.2016.2567075	journal	August 2016
A Convergent Image Fusion Algorithm Using Scene-Adapted Gaussian-Mixture-Based Denoising Teodoro, Afonso M.; Bioucas-Dias, Jose M.; Figueiredo, Mario A. T. IEEE Transactions on Image Processing, Vol. 28, Issue 1 https://doi.org/10.1109/TIP.2018.2869727	journal	January 2019
Plug-and-Play Image Restoration With Deep Denoiser Prior Zhang, Kai; Li, Yawei; Zuo, Wangmeng IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, Issue 10 https://doi.org/10.1109/TPAMI.2021.3088914	journal	October 2022
Should Penalized Least Squares Regression be Interpreted as Maximum A Posteriori Estimation? Gribonval, Rémi IEEE Transactions on Signal Processing, Vol. 59, Issue 5 https://doi.org/10.1109/TSP.2011.2107908	journal	May 2011
Fixed Point Strategies in Data Science Combettes, Patrick L.; Pesquet, Jean-Christophe IEEE Transactions on Signal Processing, Vol. 69 https://doi.org/10.1109/TSP.2021.3069677	journal	January 2021
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems Beck, Amir; Teboulle, Marc SIAM Journal on Imaging Sciences, Vol. 2, Issue 1 https://doi.org/10.1137/080716542	journal	January 2009
The Little Engine That Could: Regularization by Denoising (RED) Romano, Yaniv; Elad, Michael; Milanfar, Peyman SIAM Journal on Imaging Sciences, Vol. 10, Issue 4 https://doi.org/10.1137/16M1102884	journal	January 2017
JFB: Jacobian-Free Backpropagation for Implicit Networks Fung, Samy Wu; Heaton, Howard; Li, Qiuwei Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36, Issue 6 https://doi.org/10.1609/aaai.v36i6.20619	journal	June 2022

Similar Records

CoIL: Coordinate-based Internal Learning for Imaging Inverse Problems

Journal Article · Sun Nov 07 23:00:00 EST 2021 · IEEE Transactions on Computational Imaging · OSTI ID:1883143

Related Subjects

97 MATHEMATICS AND COMPUTING
computational imaging
deep learning
imaging inverse problems
information science
mathematics
plug-and-play priors

Deep Equilibrium Learning of Explicit Regularization Functionals for Imaging Inverse Problems

Citation Formats

References (29)

Similar Records

Related Subjects