PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstruction

Gan, Weijie; Zhai, Qiuchen; McCann, Michael T.; Cardona, Cristina Garcia; Kamilov, Ulugbek S.; Wohlberg, Brendt

doi:10.1109/OJSP.2024.3375276

Title: PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstruction

Journal Article · 01 January 2024 · IEEE Open Journal of Signal Processing (Online)

DOI: https://doi.org/10.1109/OJSP.2024.3375276 · OSTI ID:2338227

^[1];

^[2];

^[3];

^[1];

^[3]

Department of Computer Science &, Engineering, Washington University, St. Louis, MO, USA
School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA

Not Available

View Journal Article

Cite

Export

Save

Sponsoring Organization:: USDOE

OSTI ID:: 2338227

Journal Information:: IEEE Open Journal of Signal Processing (Online), Journal Name: IEEE Open Journal of Signal Processing (Online) Vol. 5; ISSN 2644-1322

Publisher:: Institute of Electrical and Electronics EngineersCopyright Statement

Country of Publication:: United States

Language:: English

References (36)

Learning a variational network for reconstruction of accelerated MRI data: Learning a Variational Network for Reconstruction of Accelerated MRI Data Hammernik, Kerstin; Klatzer, Teresa; Kobler, Erich Magnetic Resonance in Medicine, Vol. 79, Issue 6 https://doi.org/10.1002/mrm.26977	journal	November 2017
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis Mildenhall, Ben; Srinivasan, Pratul P.; Tancik, Matthew Computer Vision – ECCV 2020 https://doi.org/10.1007/978-3-030-58452-8_24	book	November 2020
LWGNet - Learned Wirtinger Gradients for Fourier Ptychographic Phase Retrieval Saha, Atreyee; Khan, Salman S.; Sehrawat, Sagar European Conference on Computer Vision https://doi.org/10.1007/978-3-031-20071-7_31	book	November 2022
U-Net: Convolutional Networks for Biomedical Image Segmentation Ronneberger, Olaf; Fischer, Philipp; Brox, Thomas Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III https://doi.org/10.1007/978-3-319-24574-4_28	book	November 2015
An improved ptychographical phase retrieval algorithm for diffractive imaging Maiden, Andrew M.; Rodenburg, John M. Ultramicroscopy, Vol. 109, Issue 10 https://doi.org/10.1016/j.ultramic.2009.05.012	journal	September 2009
Image reconstruction by domain-transform manifold learning Zhu, Bo; Liu, Jeremiah Z.; Cauley, Stephen F. Nature, Vol. 555, Issue 7697 https://doi.org/10.1038/nature25988	journal	March 2018
X-ray ptychography Pfeiffer, Franz Nature Photonics, Vol. 12, Issue 1 https://doi.org/10.1038/s41566-017-0072-5	journal	December 2017
A phase retrieval algorithm for shifting illumination Rodenburg, J. M.; Faulkner, H. M. L. Applied Physics Letters, Vol. 85, Issue 20 https://doi.org/10.1063/1.1823034	journal	November 2004
AI-enabled high-resolution scanning coherent diffraction imaging Cherukara, Mathew J.; Zhou, Tao; Nashed, Youssef Applied Physics Letters, Vol. 117, Issue 4 https://doi.org/10.1063/5.0013065	journal	July 2020
SHARP : a distributed GPU-based ptychographic solver Marchesini, Stefano; Krishnan, Hari; Daurer, Benedikt J. Journal of Applied Crystallography, Vol. 49, Issue 4 https://doi.org/10.1107/S1600576716008074	journal	July 2016
Plug-and-Play priors for model based reconstruction Venkatakrishnan, Singanallur V.; Bouman, Charles A.; Wohlberg, Brendt 2013 IEEE Global Conference on Signal and Information Processing (GlobalSIP) https://doi.org/10.1109/GlobalSIP.2013.6737048	conference	December 2013
Deep Iterative Phase Retrieval for Ptychography Welker, Simon; Peer, Tal; Chapman, Henry N. ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) https://doi.org/10.1109/ICASSP43922.2022.9746811	conference	May 2022
Projected Multi-Agent Consensus Equilibrium for Ptychographic Image Reconstruction Zhai, Qiuchen; Wohlberg, Brendt; Buzzard, Gregery T. 2021 55th Asilomar Conference on Signals, Systems, and Computers https://doi.org/10.1109/IEEECONF53345.2021.9723357	conference	October 2021
Deep Learning Techniques for Inverse Problems in Imaging Ongie, Gregory; Jalal, Ajil; Metzler, Christopher A. IEEE Journal on Selected Areas in Information Theory, Vol. 1, Issue 1 https://doi.org/10.1109/JSAIT.2020.2991563	journal	May 2020
Convolutional Neural Networks for Inverse Problems in Imaging: A Review McCann, Michael T.; Jin, Kyong Hwan; Unser, Michael IEEE Signal Processing Magazine, Vol. 34, Issue 6 https://doi.org/10.1109/MSP.2017.2739299	journal	November 2017
Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods Lucas, Alice; Iliadis, Michael; Molina, Rafael IEEE Signal Processing Magazine, Vol. 35, Issue 1 https://doi.org/10.1109/MSP.2017.2760358	journal	January 2018
Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing Monga, Vishal; Li, Yuelong; Eldar, Yonina C. IEEE Signal Processing Magazine, Vol. 38, Issue 2 https://doi.org/10.1109/MSP.2020.3016905	journal	March 2021
Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imaging: Theory, algorithms, and applications Kamilov, Ulugbek S.; Bouman, Charles A.; Buzzard, Gregery T. IEEE Signal Processing Magazine, Vol. 40, Issue 1 https://doi.org/10.1109/MSP.2022.3199595	journal	January 2023
SGD-Net: Efficient Model-Based Deep Learning With Theoretical Guarantees Liu, Jiaming; Sun, Yu; Gan, Weijie IEEE Transactions on Computational Imaging, Vol. 7 https://doi.org/10.1109/TCI.2021.3085534	journal	January 2021
Deep Equilibrium Architectures for Inverse Problems in Imaging Gilton, Davis; Ongie, Gregory; Willett, Rebecca IEEE Transactions on Computational Imaging, Vol. 7 https://doi.org/10.1109/TCI.2021.3118944	journal	January 2021
Unrolled Wirtinger Flow With Deep Decoding Priors for Phaseless Imaging Kazemi, Samia; Yonel, Bariscan; Yazici, Birsen IEEE Transactions on Computational Imaging, Vol. 8 https://doi.org/10.1109/TCI.2022.3189217	journal	January 2022
Self-Supervised Deep Equilibrium Models With Theoretical Guarantees and Applications to MRI Reconstruction Gan, Weijie; Ying, Chunwei; Boroojeni, Parna Eshraghi IEEE Transactions on Computational Imaging, Vol. 9 https://doi.org/10.1109/TCI.2023.3304475	journal	January 2023
Projected Multi-Agent Consensus Equilibrium (PMACE) With Application to Ptychography Zhai, Qiuchen; Buzzard, Gregery T.; Mertes, Kevin IEEE Transactions on Computational Imaging, Vol. 9 https://doi.org/10.1109/TCI.2023.3328288	journal	January 2023
Deep Convolutional Neural Network for Inverse Problems in Imaging Jin, Kyong Hwan; McCann, Michael T.; Froustey, Emmanuel IEEE Transactions on Image Processing, Vol. 26, Issue 9 https://doi.org/10.1109/TIP.2017.2713099	journal	September 2017
Phase Retrieval via Wirtinger Flow: Theory and Algorithms Candes, Emmanuel J.; Li, Xiaodong; Soltanolkotabi, Mahdi IEEE Transactions on Information Theory, Vol. 61, Issue 4 https://doi.org/10.1109/TIT.2015.2399924	journal	April 2015
A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction Schlemper, Jo; Caballero, Jose; Hajnal, Joseph V. IEEE Transactions on Medical Imaging, Vol. 37, Issue 2 https://doi.org/10.1109/TMI.2017.2760978	journal	February 2018
Learned Primal-Dual Reconstruction Adler, Jonas; Oktem, Ozan IEEE Transactions on Medical Imaging, Vol. 37, Issue 6 https://doi.org/10.1109/TMI.2018.2799231	journal	June 2018
MoDL: Model-Based Deep Learning Architecture for Inverse Problems Aggarwal, Hemant K.; Mani, Merry P.; Jacob, Mathews IEEE Transactions on Medical Imaging, Vol. 38, Issue 2 https://doi.org/10.1109/TMI.2018.2865356	journal	February 2019
DRONE: Dual-Domain Residual-based Optimization NEtwork for Sparse-View CT Reconstruction Wu, Weiwen; Hu, Dianlin; Niu, Chuang IEEE Transactions on Medical Imaging, Vol. 40, Issue 11 https://doi.org/10.1109/TMI.2021.3078067	journal	November 2021
A Survey of Visual Transformers Liu, Yang; Zhang, Yao; Wang, Yixin IEEE Transactions on Neural Networks and Learning Systems https://doi.org/10.1109/tnnls.2022.3227717	journal	January 2024
The Little Engine That Could: Regularization by Denoising (RED) Romano, Yaniv; Elad, Michael; Milanfar, Peyman SIAM Journal on Imaging Sciences, Vol. 10, Issue 4 https://doi.org/10.1137/16M1102884	journal	January 2017
Transformers in Vision: A Survey Khan, Salman; Naseer, Muzammal; Hayat, Munawar ACM Computing Surveys, Vol. 54, Issue 10s https://doi.org/10.1145/3505244	journal	January 2022
Three-dimensional reconstruction of integrated circuits by single-angle X-ray ptychography with machine learning Kang, Iksung; Yao, Yudong; Deng, Junjing OSA Imaging and Applied Optics Congress 2021 (3D, COSI, DH, ISA, pcAOP) https://doi.org/10.1364/COSI.2021.CTu6A.4	conference	January 2021
Further improvements to the ptychographical iterative engine Maiden, Andrew; Johnson, Daniel; Li, Peng Optica, Vol. 4, Issue 7 https://doi.org/10.1364/OPTICA.4.000736	journal	January 2017
PtychoNet: Fast and High Quality Phase Retrieval for Ptychography Guan, Ziqiao; Tsai, Esther; Huang, Xiaojing https://doi.org/10.2172/1599580	report	September 2019
A Parameter Refinement Method for Ptychography Based on Deep Learning Concepts Guzzi, Francesco; Kourousias, George; Gianoncelli, Alessandra Condensed Matter, Vol. 6, Issue 4 https://doi.org/10.3390/condmat6040036	journal	October 2021

Similar Records

Real-time sparse-sampled Ptychographic imaging through deep neural networks

Journal Article · 2020 · OSTI ID:1713219

Cherukara, Mathew J; Zhou, Tao; Nashed, Youssef; +4 more

A computational framework for ptychographic reconstructions

Journal Article · 2016 · Proceedings of the Royal Society. A. Mathematical, Physical and Engineering Sciences · OSTI ID:1625594

Enders, B.; Thibault, P.

Parallel ptychographic reconstruction

Journal Article · 2014 · Optics Express · OSTI ID:1201761

Nashed, Youssef S. G.; Vine, David J.; Peterka, Tom; +3 more

Title: PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstruction

Citation Formats

References (36)

Similar Records

Related Subjects