DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Predicting ptychography probe positions using single-shot phase retrieval neural network

Journal Article · · Optics Express
DOI: https://doi.org/10.1364/OE.524317 · OSTI ID:2448448

Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization approaches. When the error accumulates along the scan path or when the error magnitude is large, these approaches may not converge with satisfactory result. We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors, where a neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point. The pairwise offsets among these images are then found using a robust image registration method, and the results are combined to yield the complete scan path by constructing and solving a linear equation. We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of 10 2 pixels, a magnitude that often makes optimization-based algorithms fail to converge. For ptychography instruments without sophisticated position control equipment such as interferometers, our method is of significant practical potential.

Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
2448448
Journal Information:
Optics Express, Journal Name: Optics Express Journal Issue: 21 Vol. 32; ISSN 1094-4087; ISSN OPEXFF
Publisher:
Optical Society of AmericaCopyright Statement
Country of Publication:
United States
Language:
English

References (31)

On the momentum term in gradient descent learning algorithms journal January 1999
Toward the energy efficiency of resource allocation algorithms for OFDMA downlink MIMO systems journal December 2019
Is your dataset big enough? Sample size requirements when using artificial neural networks for discrete choice analysis journal September 2018
An annealing algorithm to correct positioning errors in ptychography journal September 2012
Drift correction in ptychographic diffractive imaging journal March 2013
Lateral position correction in ptychography using the gradient of intensity patterns journal September 2018
Phase recovery and holographic image reconstruction using deep learning in neural networks journal October 2017
Deep learning at the edge enables real-time streaming ptychographic imaging journal November 2023
AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging journal June 2022
Physics constrained unsupervised deep learning for rapid, high resolution scanning coherent diffraction reconstruction journal December 2023
Evolutionary determination of experimental parameters for ptychographical imaging journal June 2011
AI-enabled high-resolution scanning coherent diffraction imaging journal July 2020
Rapid 3D nanoscale coherent imaging via physics-aware deep learning journal June 2021
PtychoShelves , a versatile high-level framework for high-performance analysis of ptychographic data journal March 2020
PyNX : high-performance computing toolkit for coherent X-ray imaging based on operators journal September 2020
An FFT-based technique for translation, rotation, and scale-invariant image registration journal January 1996
Object recognition from local scale-invariant features conference January 1999
What Size Net Gives Valid Generalization? journal March 1989
Hints journal July 1995
Phase retrieval with transverse translation diversity: a nonlinear optimization approach journal January 2008
Translation position determination in ptychographic coherent diffraction imaging journal January 2013
Ptychographic overlap constraint errors and the limits of their numerical recovery using conjugate gradient descent methods journal January 2014
Optimization of overlap uniformness for ptychography journal January 2014
Parallel ptychographic reconstruction journal January 2014
Iterative least-squares solver for generalized maximum-likelihood ptychography journal January 2018
Adorym: a multi-platform generic X-ray image reconstruction framework based on automatic differentiation journal January 2021
Further improvements to the ptychographical iterative engine journal January 2017
Adam: A Method for Stochastic Optimization preprint January 2014
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift preprint January 2015
Cyclical Learning Rates for Training Neural Networks preprint January 2015
scikit-image: image processing in Python journal January 2014