Title: AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging

Journal Article · · npj Computational Materials

Abstract The problem of phase retrieval underlies various imaging methods from astronomy to nanoscale imaging. Traditional phase retrieval methods are iterative and are therefore computationally expensive. Deep learning (DL) models have been developed to either provide learned priors or completely replace phase retrieval. However, such models require vast amounts of labeled data, which can only be obtained through simulation or performing computationally prohibitive phase retrieval on experimental datasets. Using 3D X-ray Bragg coherent diffraction imaging (BCDI) as a representative technique, we demonstrate AutoPhaseNN, a DL-based approach which learns to solve the phase problem without labeled data. By incorporating the imaging physics into the DL model during training, AutoPhaseNN learns to invert 3D BCDI data in a single shot without ever being shown real space images. Once trained, AutoPhaseNN can be effectively used in the 3D BCDI data inversion about 100× faster than iterative phase retrieval methods while providing comparable image quality.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities Division
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
1871070
Journal Information:
npj Computational Materials, Journal Name: npj Computational Materials Journal Issue: 1 Vol. 8; ISSN 2057-3960
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (44)

Recent advances in Lorentz microscopy journal April 2016
Ultrafast Three-Dimensional X-ray Imaging of Deformation Modes in ZnO Nanocrystals journal January 2017
Ultrafast Three-Dimensional Integrated Imaging of Strain in Core/Shell Semiconductor/Metal Nanostructures journal November 2017
Phase recovery and holographic image reconstruction using deep learning in neural networks journal October 2017
Image reconstruction by domain-transform manifold learning journal March 2018
Avalanching strain dynamics during the hydriding phase transformation in individual palladium nanoparticles journal December 2015
High-resolution three-dimensional partially coherent diffraction imaging journal January 2012
Coherent diffraction imaging of nanoscale strain evolution in a single crystal under high pressure journal April 2013
Sparsity-based single-shot subwavelength coherent diffractive imaging journal April 2012
Three-dimensional imaging of dislocation propagation during crystal growth and dissolution journal June 2015
Active site localization of methane oxidation on Pt nanocrystals journal August 2018
Three-dimensional X-ray diffraction imaging of dislocations in polycrystalline metals under tensile loading journal September 2018
Time-resolved in situ visualization of the structural response of zeolites during catalysis journal November 2020
X-ray ptychography journal December 2017
Electron ptychography of 2D materials to deep sub-ångström resolution journal July 2018
Real-time coherent diffraction inversion using deep generative networks journal November 2018
Free log-likelihood as an unbiased metric for coherent diffraction imaging journal February 2020
3D lattice distortions and defect structures in ion-implanted nano-crystals journal April 2017
AI-enabled high-resolution scanning coherent diffraction imaging journal July 2020
Adaptive 3D convolutional neural network-based reconstruction method for 3D coherent diffraction imaging journal November 2020
Rapid 3D nanoscale coherent imaging via physics-aware deep learning journal June 2021
Imaging transient melting of a nanocrystal using an X-ray laser journal June 2015
X-ray image reconstruction from a diffraction pattern alone journal October 2003
Application of optimization technique to noncrystalline x-ray diffraction microscopy: Guided hybrid input-output method journal August 2007
Angle calculations for a six-circle surface X-ray diffractometer journal October 1993
The oversampling phasing method journal October 2000
Dynamic diffraction artefacts in Bragg coherent diffractive imaging journal February 2018
Complex imaging of phase domains by deep neural networks journal January 2021
Deep neural networks in real-time coherent diffraction imaging journal January 2021
Image denoising: Can plain neural networks compete with BM3D? conference June 2012
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network conference July 2017
Enhanced Deep Residual Networks for Single Image Super-Resolution conference July 2017
Image Super-Resolution Using Deep Convolutional Networks journal February 2016
Ultrafast Three-Dimensional Imaging of Lattice Dynamics in Individual Gold Nanocrystals journal May 2013
Topological defect dynamics in operando battery nanoparticles journal June 2015
Beyond crystallography: Diffractive imaging using coherent x-ray light sources journal April 2015
Phase retrieval algorithms: a comparison journal January 1982
Phase retrieval and saddle-point optimization journal January 2007
Deep learning approach for Fourier ptychography microscopy journal January 2018
Deep neural networks in single-shot ptychography journal January 2020
PhaseGAN: a deep-learning phase-retrieval approach for unpaired datasets journal January 2021
Recovering the phase and amplitude of X-ray FEL pulses using neural networks and differentiable models journal January 2021
Lensless computational imaging through deep learning journal January 2017
PtychoNet: Fast and High Quality Phase Retrieval for Ptychography report September 2019

Related Subjects