skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Joint ptycho-tomography with deep generative priors

Journal Article · · Machine Learning: Science and Technology

Abstract Joint ptycho-tomography is a powerful computational imaging framework to recover the refractive properties of a 3D object while relaxing the requirements for probe overlap that is common in conventional phase retrieval. We use an augmented Lagrangian scheme for formulating the constrained optimization problem and employ an alternating direction method of multipliers (ADMM) for the joint solution. ADMM allows the problem to be split into smaller and computationally more efficient subproblems: ptychographic phase retrieval, tomographic reconstruction, and regularization of the solution. We extend our ADMM framework with plug-and-play (PnP) denoisers by replacing the regularization subproblem with a general denoising operator based on machine learning. While the PnP framework enables integrating such learned priors as denoising operators, tuning of the denoiser prior remains challenging. To overcome this challenge, we propose a denoiser parameter to control the effect of the denoiser and to accelerate the solution. In our simulations, we demonstrate that our proposed framework with parameter tuning and learned priors generates high-quality reconstructions under limited and noisy measurement data.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
Contract No. DE-AC02-06CH11357; AC02-06CH11357
OSTI ID:
1835497
Alternate ID(s):
OSTI ID: 1817351
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Vol. 2 Journal Issue: 4; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (34)

Optimizing a Parameterized Plug-and-Play ADMM for Iterative Low-Dose CT Reconstruction journal February 2019
Photon-limited ptychography of 3D objects via Bayesian reconstruction journal January 2019
Joint ptycho-tomography reconstruction through alternating direction method of multipliers journal January 2019
The Little Engine That Could: Regularization by Denoising (RED) journal January 2017
Plug-and-Play Unplugged: Optimization-Free Reconstruction Using Consensus Equilibrium journal January 2018
Alternating Direction Method of Multipliers for Separable Convex Optimization of Real Functions in Complex Variables journal January 2015
XDesign : an open-source software package for designing X-ray imaging phantoms and experiments journal February 2017
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries journal January 2006
Distributed Optimization for Nonrigid Nano-Tomography journal January 2021
Computational Methods for Sparse Solution of Linear Inverse Problems journal June 2010
Boosting the Performance of Plug-and-Play Priors via Denoiser Scaling conference November 2020
Direct coupling of tomography and ptychography journal January 2017
TomoGAN: low-dose synchrotron x-ray tomography with generative adversarial networks: discussion journal January 2020
Nonlinear total variation based noise removal algorithms journal November 1992
Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering journal August 2007
Three dimensions, two microscopes, one code: Automatic differentiation for x-ray nanotomography beyond the depth of focus limit journal March 2020
Beugung im inhomogenen Primärstrahlwellenfeld. I. Prinzip einer Phasenmessung von Elektronenbeungungsinterferenzen journal July 1969
Direct three-dimensional tomographic reconstruction and phase retrieval of far-field coherent diffraction patterns journal February 2019
Ptychographic X-ray computed tomography at the nanoscale journal September 2010
Trace: a high-throughput tomographic reconstruction engine for large-scale datasets journal January 2017
A Plug-and-Play Priors Approach for Solving Nonlinear Imaging Inverse Problems journal December 2017
Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications journal March 2017
An Online Plug-and-Play Algorithm for Regularized Image Reconstruction journal September 2019
An annealing algorithm to correct positioning errors in ptychography journal September 2012
Poisson inverse problems by the Plug-and-Play scheme journal November 2016
Deep Convolutional Neural Network for Inverse Problems in Imaging journal September 2017
3-D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning From a 2-D Trained Network journal June 2018
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising journal July 2017
A Nonlinear Conjugate Gradient Method with a Strong Global Convergence Property journal January 1999
Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation journal January 2016
Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers book January 2011
Rapid alignment of nanotomography data using joint iterative reconstruction and reprojection journal September 2017
Coupled ptychography and tomography algorithm improves reconstruction of experimental data journal January 2019
Low-dose x-ray tomography through a deep convolutional neural network journal February 2018