Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Efficient ptychographic phase retrieval via a matrix-free Levenberg-Marquardt algorithm

Journal Article · · Optics Express
DOI:https://doi.org/10.1364/OE.422768· OSTI ID:1806256

The phase retrieval problem, where one aims to recover a complex-valued image from far-field intensity measurements, is a classic problem encountered in a range of imaging applications. Modern phase retrieval approaches usually rely on gradient descent methods in a nonlinear minimization framework. Calculating closed-form gradients for use in these methods is tedious work, and formulating second order derivatives is even more laborious. Additionally, second order techniques often require the storage and inversion of large matrices of partial derivatives, with memory requirements that can be prohibitive for data-rich imaging modalities. We use a reverse-mode automatic differentiation (AD) framework to implement an efficient matrix-free version of the Levenberg-Marquardt (LM) algorithm, a longstanding method that finds popular use in nonlinear least-square minimization problems but which has seen little use in phase retrieval. Furthermore, we extend the basic LM algorithm so that it can be applied for more general constrained optimization problems (including phase retrieval problems) beyond just the least-square applications. Since we use AD, we only need to specify the physics-based forward model for a specific imaging application; the first and second-order derivative terms are calculated automatically through matrix-vector products, without explicitly forming the large Jacobian or Gauss-Newton matrices typically required for the LM method. We demonstrate that this algorithm can be used to solve both the unconstrained ptychographic object retrieval problem and the constrained “blind” ptychographic object and probe retrieval problems, under the popular Gaussian noise model as well as the Poisson noise model. We compare this algorithm to state-of-the-art first order ptychographic reconstruction methods to demonstrate empirically that this method outperforms best-in-class first-order methods: it provides excellent convergence guarantees with (in many cases) a superlinear rate of convergence, all with a computational cost comparable to, or lower than, the tested first-order algorithms.

Sponsoring Organization:
USDOE
OSTI ID:
1806256
Alternate ID(s):
OSTI ID: 1813106
OSTI ID: 1814924
Journal Information:
Optics Express, Journal Name: Optics Express Journal Issue: 15 Vol. 29; ISSN 1094-4087; ISSN OPEXFF
Publisher:
Optical Society of AmericaCopyright Statement
Country of Publication:
United States
Language:
English

References (60)

Dynamische Theorie der Kristallstrukturanalyse durch Elektronenbeugung im inhomogenen Primärstrahlwellenfeld journal November 1970
Global Complexity Bound of the Inexact Levenberg–Marquardt Method journal December 2017
Use of coherent X-ray diffraction to map strain fields in nanocrystals journal October 2001
A survey of truncated-Newton methods journal December 2000
Ptychography and Related Diffractive Imaging Methods book May 2008
An estimator for the diagonal of a matrix journal November 2007
Levenberg–Marquardt methods with strong local convergence properties for solving nonlinear equations with convex constraints journal December 2004
Phase retrieval via Sparse Wirtinger Flow journal August 2019
Distributed Automatic Differentiation for Ptychography journal January 2017
Probe retrieval in ptychographic coherent diffractive imaging journal March 2009
An improved ptychographical phase retrieval algorithm for diffractive imaging journal September 2009
An inexact Levenberg-Marquardt method for large sparse nonlinear least squres journal April 1985
Quantitative Nanoscale Imaging of Lattice Distortions in Epitaxial Semiconductor Heterostructures Using Nanofocused X-ray Bragg Projection Ptychography journal September 2012
Ptychographic X-ray computed tomography at the nanoscale journal September 2010
Ptychographic electron microscopy using high-angle dark-field scattering for sub-nanometre resolution imaging journal January 2012
Efficient maximum likelihood estimator fitting of histograms journal May 2010
Wide-field, high-resolution Fourier ptychographic microscopy journal July 2013
Fourier ptychographic microscopy with sparse representation journal August 2017
A complex gradient operator and its application in adaptive array theory journal January 1983
A phase retrieval algorithm for shifting illumination journal November 2004
Invited Article: A unified evaluation of iterative projection algorithms for phase retrieval journal January 2007
Convergence Properties of the Inexact Levenberg-Marquardt Method under Local Error Bound Conditions journal January 2002
Relaxed averaged alternating reflections for diffraction imaging journal November 2004
Blind ptychography: uniqueness and ambiguities journal February 2020
Maximum-likelihood refinement for coherent diffractive imaging journal June 2012
Implicit alternating direction methods journal January 1959
A method for the solution of certain non-linear problems in least squares journal January 1944
Direct three-dimensional tomographic reconstruction and phase retrieval of far-field coherent diffraction patterns journal February 2019
Movable Aperture Lensless Transmission Microscopy: A Novel Phase Retrieval Algorithm journal July 2004
Hard-X-Ray Lensless Imaging of Extended Objects journal January 2007
Beugung im inhomogenen Primärstrahlwellenfeld. I. Prinzip einer Phasenmessung von Elektronenbeungungsinterferenzen journal July 1969
Beugung im inhomogenen Primärstrahlwellenfeld. III. Amplituden- und Phasenbestimmung bei unperiodischen Objekten journal July 1969
Phase Retrieval via Wirtinger Flow: Theory and Algorithms journal April 2015
Globally Convergent Levenberg-Marquardt Method for Phase Retrieval journal April 2019
Sparse Phase Retrieval via Truncated Amplitude Flow journal January 2018
On Fienup Methods for Sparse Phase Retrieval journal February 2018
Three dimensions, two microscopes, one code: Automatic differentiation for x-ray nanotomography beyond the depth of focus limit journal March 2020
An Algorithm for Least-Squares Estimation of Nonlinear Parameters journal June 1963
Unconstrained Optimization of Real Functions in Complex Variables journal January 2012
Proximal Heterogeneous Block Implicit-Explicit Method and Application to Blind Ptychographic Diffraction Imaging journal January 2015
Blind Ptychographic Phase Retrieval via Convergent Alternating Direction Method of Multipliers journal January 2019
Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent journal July 2002
Fast Exact Multiplication by the Hessian journal January 1994
Phase retrieval algorithms: a comparison journal January 1982
Phase retrieval by iterated projections journal January 2003
Computation of quasi-discrete Hankel transforms of integer order for propagating optical wave fields journal January 2004
Applications of algorithmic differentiation to phase retrieval algorithms journal January 2014
Conjugate gradient method for phase retrieval based on the Wirtinger derivative journal January 2017
Phase retrieval with transverse translation diversity: a nonlinear optimization approach journal January 2008
Noise models for low counting rate coherent diffraction imaging journal January 2012
Experimental robustness of Fourier ptychography phase retrieval algorithms journal January 2015
Iterative least-squares solver for generalized maximum-likelihood ptychography journal January 2018
Using automatic differentiation as a general framework for ptychographic reconstruction journal January 2019
Adorym: a multi-platform generic X-ray image reconstruction framework based on automatic differentiation journal January 2021
Reconstruction of an object from the modulus of its Fourier transform journal January 1978
Optical ptychography: a practical implementation with useful resolution journal January 2010
Further improvements to the ptychographical iterative engine journal January 2017
Proximal Algorithms journal January 2014
On the Levenberg-Marquardt methods for convex constrained nonlinear equations journal January 2013
Extended Levenberg-Marquardt Method for Composite Function Minimization journal June 2017

Similar Records

Levenberg--Marquardt algorithm: implementation and theory
Conference · Fri Dec 31 23:00:00 EST 1976 · OSTI ID:7256021

Related Subjects