Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Physics-assisted generative adversarial network for X-ray tomography

Journal Article · · Optics Express
DOI:https://doi.org/10.1364/OE.460208· OSTI ID:1871842

X-ray tomography is capable of imaging the interior of objects in three dimensions non-invasively, with applications in biomedical imaging, materials science, electronic inspection, and other fields. The reconstruction process can be an ill-conditioned inverse problem, requiring regularization to obtain satisfactory results. Recently, deep learning has been adopted for tomographic reconstruction. Unlike iterative algorithms which require a distribution that is known a priori , deep reconstruction networks can learn a prior distribution through sampling the training distributions. In this work, we develop a Physics-assisted Generative Adversarial Network (PGAN), a two-step algorithm for tomographic reconstruction. In contrast to previous efforts, our PGAN utilizes maximum-likelihood estimates derived from the measurements to regularize the reconstruction with both known physics and the learned prior. Compared with methods with less physics assisting in training, PGAN can reduce the photon requirement with limited projection angles to achieve a given error rate. The advantages of using a physics-assisted learned prior in X-ray tomography may further enable low-photon nanoscale imaging.

Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
NA0003525
OSTI ID:
1871842
Alternate ID(s):
OSTI ID: 1872055
Journal Information:
Optics Express, Journal Name: Optics Express Journal Issue: 13 Vol. 30; ISSN 1094-4087; ISSN OPEXFF
Publisher:
Optical Society of AmericaCopyright Statement
Country of Publication:
United States
Language:
English

References (49)

On instabilities of deep learning in image reconstruction and the potential costs of AI journal May 2020
Deep Scattering Spectrum journal August 2014
Limited angle tomography for transmission X-ray microscopy using deep learning journal February 2020
High-resolution limited-angle phase tomography of dense layered objects using deep neural networks journal September 2019
Employing temporal self-similarity across the entire time domain in computed tomography reconstruction
  • Kazantsev, D.; Van Eyndhoven, G.; Lionheart, W. R. B.
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 373, Issue 2043 https://doi.org/10.1098/rsta.2014.0389
journal June 2015
Radon Inversion via Deep Learning journal June 2020
Adaptive Batch Normalization for practical domain adaptation journal August 2018
X-Rays Tomographic Reconstruction Images using Proximal Methods based on L 1 Norm and TV Regularization journal January 2018
Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT journal June 2018
Deep-learning tomography journal January 2018
Real-time automated counterfeit integrated circuit detection using x-ray microscopy journal January 2015
Adaptive dynamic range shift (ADRIFT) quantitative phase imaging journal January 2021
X-ray computed tomography using partially coherent Fresnel diffraction with application to an optical fiber journal January 2021
Scatter Corrections in X-Ray Computed Tomography: A Physics-Based Analysis
  • Levine, Zachary H.; Blattner, Timothy J.; Peskin, Adele P.
  • Journal of Research of the National Institute of Standards and Technology, Vol. 124 https://doi.org/10.6028/jres.124.013
journal January 2019
Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network journal December 2017
A local update strategy for iterative reconstruction from projections journal January 1993
TomoGAN: low-dose synchrotron x-ray tomography with generative adversarial networks: discussion journal January 2020
Physics-informed machine learning journal May 2021
Group Invariant Scattering journal July 2012
Prior-based artifact correction (PBAC) in computed tomography: Prior-based artifact correction (PBAC) in computed tomography journal January 2014
Deep learning based image reconstruction algorithm for limited-angle translational computed tomography journal January 2020
Image reconstruction by domain-transform manifold learning journal March 2018
Deep Convolutional Neural Network for Inverse Problems in Imaging journal September 2017
A generalized Gaussian image model for edge-preserving MAP estimation journal July 1993
Low Photon Count Phase Retrieval Using Deep Learning journal December 2018
The Ill-Conditioned Nature of the Limited Angle Tomography Problem journal April 1983
Design of a 3000-Pixel Transition-Edge Sensor X-Ray Spectrometer for Microcircuit Tomography journal August 2021
Generative adversarial network in medical imaging: A review journal December 2019
Data fusion in X-ray computed tomography using a superiorization approach journal May 2014
Multi-energy CT reconstruction using tensor nonlocal similarity and spatial sparsity regularization journal October 2020
3D imaging in material science: Application of X-ray tomography journal November 2010
Impact of X-Ray Tomography on the Reliability of Integrated Circuits journal March 2017
Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss journal June 2018
Phase–contrast X–ray computed tomography for observing biological soft tissues journal April 1996
Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations journal January 2020
Limited-data computed tomography algorithms for the physical sciences journal January 1993
Randomized probe imaging through deep k-learning journal January 2022
X-ray computed tomography journal February 2021
On the interplay between physical and content priors in deep learning for computational imaging journal January 2020
Deep null space learning for inverse problems: convergence analysis and rates journal January 2019
An X-ray tomography facility for I.C. industry at STMicroelectronics Grenoble journal July 2002
Recent Advances of Generative Adversarial Networks in Computer Vision journal January 2019
Prior image constrained compressed sensing (PICCS): A method to accurately reconstruct dynamic CT images from highly undersampled projection data sets: Prior image constrained compressed sensing (PICCS) journal January 2008
Deep Learning Computed Tomography: Learning Projection-Domain Weights From Image Domain in Limited Angle Problems journal June 2018
DeepCGH: 3D computer-generated holography using deep learning journal January 2020
Tikhonov Regularization and Total Least Squares journal January 1999
GAN-Based Priors for Quantifying Uncertainty in Supervised Learning journal January 2021
Learning the invisible: a hybrid deep learning-shearlet framework for limited angle computed tomography journal June 2019
Tomographic image reconstruction from limited projections using iterative revisions in image and transform spaces journal January 1981

Similar Records

Improving field boundary delineation in ResUNets via adversarial deep learning
Journal Article · 2022 · International Journal of Applied Earth Observation and Geoinformation · OSTI ID:1977233

Attentional Ptycho-Tomography (APT) for three-dimensional nanoscale X-ray imaging with minimal data acquisition and computation time
Journal Article · 2023 · Light, Science & Applications · OSTI ID:2229860

Related Subjects