DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Enabling dynamic 3D coherent diffraction imaging via adaptive latent space tuning of generative autoencoders

Journal Article · · npj Computational Materials

Abstract Coherent diffraction imaging (CDI) is an advanced non-destructive 3D X-ray imaging technique for measuring a sample’s electron density. The main challenge of CDI is loss of phase information in diffraction intensity measurements, resulting in lengthy iterative reconstruction processes that can return non-unique solutions, which pose challenges for experiments attempting to track dynamic sample evolution through multiple states. As the increased brightness of fourth-generation light sources enables faster sample measurements and drives operando experiments with Bragg CDI, there is a growing need for faster reconstruction techniques that can keep pace. We have developed an adaptive generative autoencoder approach for uniquely tracking a sample’s electron density as it dynamically evolves. Our approach adaptively tunes the low-dimensional latent embedding of a generative autoencoder, enabling a computationally efficient manner to account for time-varying shifting distributions in real-time. Analytic proof of convergence is provided as well as numerical demonstration of sample tracking with noisy measurements.

Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA), Office of Defense Programs (DP)
OSTI ID:
2482595
Journal Information:
npj Computational Materials, Journal Name: npj Computational Materials Journal Issue: 1 Vol. 10; ISSN 2057-3960
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (67)

High-resolution X-ray imaging of Plasmodium falciparum -infected red blood cells journal October 2008
Prospects for long-wavelength X-ray microscopy and diffraction book January 2008
U-Net: Convolutional Networks for Biomedical Image Segmentation
  • Ronneberger, Olaf; Fischer, Philipp; Brox, Thomas
  • Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III https://doi.org/10.1007/978-3-319-24574-4_28
book November 2015
Convolutional neural network-based method for real-time orientation indexing of measured electron backscatter diffraction patterns journal May 2019
Bounded extremum seeking with discontinuous dithers journal July 2016
Learning the effective adhesive properties of heterogeneous substrates journal December 2023
A perspective on trends in multiscale plasticity journal September 2010
YOLO2U-Net: Detection-guided 3D instance segmentation for microscopy journal May 2024
Ultrafast Three-Dimensional Integrated Imaging of Strain in Core/Shell Semiconductor/Metal Nanostructures journal November 2017
Unveiling Core–Shell Structure Formation in a Ni3Fe Nanoparticle with In Situ Multi-Bragg Coherent Diffraction Imaging journal May 2024
Extending the methodology of X-ray crystallography to allow imaging of micrometre-sized non-crystalline specimens journal July 1999
Three-dimensional mapping of a deformation field inside a nanocrystal journal July 2006
High-resolution three-dimensional partially coherent diffraction imaging journal January 2012
Coherent X-ray diffraction imaging of strain at the nanoscale journal April 2009
Three-dimensional X-ray diffraction imaging of dislocations in polycrystalline metals under tensile loading journal September 2018
Three-dimensional coherent X-ray diffraction imaging via deep convolutional neural networks journal October 2021
AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging journal June 2022
Enabling rapid X-ray CT characterisation for additive manufacturing using CAD models and deep learning-based reconstruction journal May 2023
Atomic resolution coherent x-ray imaging with physics-based phase retrieval journal August 2024
Bragg Coherent Diffractive Imaging of Zinc Oxide Acoustic Phonons at Picosecond Timescales journal August 2017
Real-time coherent diffraction inversion using deep generative networks journal November 2018
An adaptive approach to machine learning for compact particle accelerators journal September 2021
Facing the phase problem in Coherent Diffractive Imaging via Memetic Algorithms journal February 2017
Invited Article: A unified evaluation of iterative projection algorithms for phase retrieval journal January 2007
Bragg coherent diffractive imaging of strain at the nanoscale journal March 2019
Adaptive 3D convolutional neural network-based reconstruction method for 3D coherent diffraction imaging journal November 2020
Rapid 3D nanoscale coherent imaging via physics-aware deep learning journal June 2021
Imaging transient melting of a nanocrystal using an X-ray laser journal June 2015
Imaging whole Escherichia coli bacteria by using single-particle x-ray diffraction journal December 2002
Relaxed averaged alternating reflections for diffraction imaging journal November 2004
Adaptive machine learning for time-varying systems: low dimensional latent space tuning journal October 2021
Materials science in the time domain using Bragg coherent diffraction imaging journal March 2016
Experimental demonstration of coupled multi-peak Bragg coherent diffraction imaging with genetic algorithms journal June 2021
Modeling and experimental validation of dynamical effects in Bragg coherent x-ray diffractive imaging of finite crystals journal November 2022
Application of optimization technique to noncrystalline x-ray diffraction microscopy: Guided hybrid input-output method journal August 2007
Coherent diffractive imaging of time-evolving samples with improved temporal resolution journal May 2016
Adaptive autoencoder latent space tuning for more robust machine learning beyond the training set for six-dimensional phase space diagnostics of a time-varying ultrafast electron-diffraction compact accelerator journal April 2023
Compressed sensing for phase retrieval journal May 2012
Quantitative Imaging of Single, Unstained Viruses with Coherent X Rays journal October 2008
Three-Dimensional Visualization of a Human Chromosome Using Coherent X-Ray Diffraction journal January 2009
Reconstruction of the Shapes of Gold Nanocrystals Using Coherent X-Ray Diffraction journal October 2001
Quantitative Image Reconstruction of GaN Quantum Dots from Oversampled Diffraction Intensities Alone journal August 2005
Three-dimensional Bragg coherent diffraction imaging of an extended ZnO crystal journal June 2012
Solution of the crystallographic phase problem by iterated projections journal April 2003
Diffraction with wavefront curvature: a path to unique phase recovery journal April 2005
Phase retrieval of coherent diffractive images with global optimization algorithms journal October 2017
A Monte Carlo ray-tracing simulation of coherent X-ray diffractive imaging journal January 2020
Simultaneous stabilization and optimization of unknown, time-varying systems conference June 2013
Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring conference July 2017
Coherent X-Ray Diffraction Imaging journal January 2012
Minimum-Seeking for CLFs: Universal Semiglobally Stabilizing Feedback Under Unknown Control Directions journal May 2013
Extremum Seeking-Based Optimization of High Voltage Converter Modulator Rise-Time journal January 2014
Minimization of Betatron Oscillations of Electron Beam Injected Into a Time-Varying Lattice via Extremum Seeking journal January 2018
Phase Retrieval via Wirtinger Flow: Theory and Algorithms journal April 2015
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation journal December 2017
Denoising Prior Driven Deep Neural Network for Image Restoration journal October 2019
Orthogonal Deep Neural Networks journal April 2021
Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey journal January 2020
Graph Neural Networks in Network Neuroscience journal May 2023
Ultrafast Three-Dimensional Imaging of Lattice Dynamics in Individual Gold Nanocrystals journal May 2013
Topological defect dynamics in operando battery nanoparticles journal June 2015
Phase retrieval algorithms: a comparison journal January 1982
Phase retrieval from the magnitude of the Fourier transforms of nonperiodic objects journal January 1998
Hybrid projection–reflection method for phase retrieval journal January 2003
Reconstruction of an object from the modulus of its Fourier transform journal January 1978
Opportunities for mesoscale science journal November 2012
Accurate Image Super-Resolution Using Very Deep Convolutional Networks preprint January 2015