Extending the depth of field for ptychography using complex-valued wavelets

Huang, Xiaojing; Yan, Hanfei; Robinson, Ian K.; Chu, Yong S.

doi:10.1364/OL.44.000503

Title: Extending the depth of field for ptychography using complex-valued wavelets

Abstract

Ptychography is a scanning variation of the coherent diffractive imaging method for providing high-resolution quantitative images from specimen with extended dimensions. Its capability of achieving diffraction-limited spatial resolution can be compromised by the sample thickness, which is generally required to be thinner than the depth of field of the imaging system. In this Letter, we present a method to extend the depth of field for ptychography by numerically generating the focus stack from reconstructions with propagated illumination wavefronts and combining the in-focus features to a single sharp image using an algorithm based on the complex-valued discrete wavelet transform. Furthermore, this approach does not require repeated measurements by translating the sample along the optical axis as in the conventional focus stacking method, and offers a computation-efficient alternative to obtain high-resolution images with extended depth of fields, complementary to the multi-slice ptychography.

Authors:: Huang, Xiaojing; Yan, Hanfei; Robinson, Ian K.; Chu, Yong S.

Publication Date:: Wed Jan 16 00:00:00 EST 2019

Research Org.:: Brookhaven National Lab. (BNL), Upton, NY (United States)

Sponsoring Org.:: USDOE Office of Science (SC), Basic Energy Sciences (BES)

OSTI Identifier:: 1490907

Alternate Identifier(s):: OSTI ID: 1491133

Report Number(s):: BNL-210884-2019-JAAM
Journal ID: ISSN 0146-9592; OPLEDP

Grant/Contract Number:: SC0012704

Resource Type:: Published Article

Journal Name:: Optics Letters

Additional Journal Information:: Journal Name: Optics Letters Journal Volume: 44 Journal Issue: 3; Journal ID: ISSN 0146-9592

Publisher:: Optical Society of America

Country of Publication:: United States

Language:: English

Subject:: 36 MATERIALS SCIENCE

Citation Formats


                    Huang, Xiaojing, Yan, Hanfei, Robinson, Ian K., and Chu, Yong S. Extending the depth of field for ptychography using complex-valued wavelets.  United States: N. p., 2019. 
Web.  doi:10.1364/OL.44.000503.

Copy to clipboard


                    Huang, Xiaojing, Yan, Hanfei, Robinson, Ian K., & Chu, Yong S. Extending the depth of field for ptychography using complex-valued wavelets.  United States.  https://doi.org/10.1364/OL.44.000503

Copy to clipboard


                    Huang, Xiaojing, Yan, Hanfei, Robinson, Ian K., and Chu, Yong S. Wed .  
"Extending the depth of field for ptychography using complex-valued wavelets".  United States.  https://doi.org/10.1364/OL.44.000503.

Copy to clipboard


                    
@article{osti_1490907,

  title        = {Extending the depth of field for ptychography using complex-valued wavelets},

  author       = {Huang, Xiaojing and Yan, Hanfei and Robinson, Ian K. and Chu, Yong S.},

  abstractNote = {Ptychography is a scanning variation of the coherent diffractive imaging method for providing high-resolution quantitative images from specimen with extended dimensions. Its capability of achieving diffraction-limited spatial resolution can be compromised by the sample thickness, which is generally required to be thinner than the depth of field of the imaging system. In this Letter, we present a method to extend the depth of field for ptychography by numerically generating the focus stack from reconstructions with propagated illumination wavefronts and combining the in-focus features to a single sharp image using an algorithm based on the complex-valued discrete wavelet transform. Furthermore, this approach does not require repeated measurements by translating the sample along the optical axis as in the conventional focus stacking method, and offers a computation-efficient alternative to obtain high-resolution images with extended depth of fields, complementary to the multi-slice ptychography.},

  doi          = {10.1364/OL.44.000503},

  journal      = {Optics Letters},

  number       = 3,

  volume       = 44,

  place        = {United States},

  year         = {Wed Jan 16 00:00:00 EST 2019},

  month        = {Wed Jan 16 00:00:00 EST 2019}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Publisher's Version of Record
https://doi.org/10.1364/OL.44.000503

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 2 works

Citation information provided by
Web of Science

Figures / Tables:

Fig. 1: Schematic experimental setup for a ptychography experiment. The depth of field in the reconstructed image is defined by the signal with the maximum scattering angle collected by the detector, which is typically narrower than the depth of focus defined by the focusing optics. The right panel shows amore »

All figures and tables (3 total)

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Phase retrieval with transverse translation diversity: a nonlinear optimization approach
journal, January 2008

Guizar-Sicairos, Manuel; Fienup, James R.
Optics Express, Vol. 16, Issue 10
DOI: 10.1364/OE.16.007264

Three-dimensional iterative multislice reconstruction for ptychographic X-ray computed tomography
journal, January 2018

Shimomura, Kei; Hirose, Makoto; Higashino, Takaya
Optics Express, Vol. 26, Issue 24
DOI: 10.1364/OE.26.031199

Phase recovery and lensless imaging by iterative methods in optical, X-ray and electron diffraction
journal, May 2002

Spence, J. C. H.; Weierstall, U.; Howells, M.
Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, Vol. 360, Issue 1794
DOI: 10.1098/rsta.2001.0972

Multi-slice ptychographic tomography
journal, February 2018

Li, Peng; Maiden, Andrew
Scientific Reports, Vol. 8, Issue 1
DOI: 10.1038/s41598-018-20530-x

Precession x-ray ptychography with multislice approach
journal, June 2015

Shimomura, Kei; Suzuki, Akihiro; Hirose, Makoto
Physical Review B, Vol. 91, Issue 21
DOI: 10.1103/PhysRevB.91.214114

Reaching the third dimension
journal, January 2017

Robinson, Ian; Huang, Xiaojing
Nature Materials, Vol. 16, Issue 2
DOI: 10.1038/nmat4845

Ptychographic transmission microscopy in three dimensions using a multi-slice approach
journal, January 2012

Maiden, A. M.; Humphry, M. J.; Rodenburg, J. M.
Journal of the Optical Society of America A, Vol. 29, Issue 8
DOI: 10.1364/JOSAA.29.001606

Ptychographic microscope for three-dimensional imaging
journal, January 2014

Godden, T. M.; Suman, R.; Humphry, M. J.
Optics Express, Vol. 22, Issue 10
DOI: 10.1364/OE.22.012513

An improved ptychographical phase retrieval algorithm for diffractive imaging
journal, September 2009

Maiden, Andrew M.; Rodenburg, John M.
Ultramicroscopy, Vol. 109, Issue 10
DOI: 10.1016/j.ultramic.2009.05.012

Optimization of overlap uniformness for ptychography
journal, January 2014

Huang, Xiaojing; Yan, Hanfei; Harder, Ross
Optics Express, Vol. 22, Issue 10
DOI: 10.1364/OE.22.012634

The dual-tree complex wavelet transform
journal, November 2005

Selesnick, I. W.; Baraniuk, R. G.; Kingsbury, N. C.
IEEE Signal Processing Magazine, Vol. 22, Issue 6
DOI: 10.1109/MSP.2005.1550194

Influence of the overlap parameter on the convergence of the ptychographical iterative engine
journal, April 2008

Bunk, Oliver; Dierolf, Martin; Kynde, Søren
Ultramicroscopy, Vol. 108, Issue 5
DOI: 10.1016/j.ultramic.2007.08.003

Artifact mitigation of ptychography integrated with on-the-fly scanning probe microscopy
journal, July 2017

Huang, Xiaojing; Yan, Hanfei; Ge, Mingyuan
Applied Physics Letters, Vol. 111, Issue 2
DOI: 10.1063/1.4993744

A theory for multiresolution signal decomposition: the wavelet representation
journal, July 1989

Mallat, S. G.
IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 11, Issue 7
DOI: 10.1109/34.192463

Complex wavelets for extended depth-of-field: A new method for the fusion of multichannel microscopy images
journal, January 2004

Forster, Brigitte; Van De Ville, Dimitri; Berent, Jesse
Microscopy Research and Technique, Vol. 65, Issue 1-2
DOI: 10.1002/jemt.20092

Relaxation of the Crowther criterion in multislice tomography
journal, January 2018

Jacobsen, Chris
Optics Letters, Vol. 43, Issue 19
DOI: 10.1364/OL.43.004811

Efficient subpixel image registration algorithms
journal, January 2008

Guizar-Sicairos, Manuel; Thurman, Samuel T.; Fienup, James R.
Optics Letters, Vol. 33, Issue 2
DOI: 10.1364/OL.33.000156

Orthonormal bases of compactly supported wavelets
journal, October 1988

Daubechies, Ingrid
Communications on Pure and Applied Mathematics, Vol. 41, Issue 7
DOI: 10.1002/cpa.3160410705

Complex Wavelets for Shift Invariant Analysis and Filtering of Signals
journal, May 2001

Kingsbury, Nick
Applied and Computational Harmonic Analysis, Vol. 10, Issue 3
DOI: 10.1006/acha.2000.0343

A review of wavelets in biomedical applications
journal, April 1996

Unser, M.; Aldroubi, A.
Proceedings of the IEEE, Vol. 84, Issue 4
DOI: 10.1109/5.488704

X-ray ptychography with extended depth of field
journal, January 2016

Tsai, Esther H. R.; Usov, Ivan; Diaz, Ana
Optics Express, Vol. 24, Issue 25
DOI: 10.1364/OE.24.029089

Extended depth of focus for transmission x-ray microscope
journal, January 2012

Liu, Yijin; Wang, Junyue; Hong, Youli
Optics Letters, Vol. 37, Issue 17
DOI: 10.1364/OL.37.003708

Sampling in x-ray ptychography
journal, May 2013

Edo, T. B.; Batey, D. J.; Maiden, A. M.
Physical Review A, Vol. 87, Issue 5
DOI: 10.1103/PhysRevA.87.053850

High-Resolution Scanning X-ray Diffraction Microscopy
journal, July 2008

Thibault, P.; Dierolf, M.; Menzel, A.
Science, Vol. 321, Issue 5887
DOI: 10.1126/science.1158573

Simple denoising algorithm using wavelet transform
journal, November 1999

Roy, Manojit; Kumar, V. Ravi; Kulkarni, B. D.
AIChE Journal, Vol. 45, Issue 11
DOI: 10.1002/aic.690451120

Extended Depth of Field for High-Resolution Scanning Transmission Electron Microscopy
journal, December 2010

Hovden, Robert; Xin, Huolin L.; Muller, David A.
Microscopy and Microanalysis, Vol. 17, Issue 1
DOI: 10.1017/S1431927610094171

On the extended depth of focus algorithms for bright field microscopy
journal, August 2001

Valdecasas, A. G.; Marshall, D.; Becerra, J. M.
Micron, Vol. 32, Issue 6
DOI: 10.1016/S0968-4328(00)00061-5

Image processing with complex wavelets
journal, September 1999

Kingsbury, Nick
Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, Vol. 357, Issue 1760
DOI: 10.1098/rsta.1999.0447

The scattering of electrons by atoms and crystals. I. A new theoretical approach
journal, October 1957

Cowley, J. M.; Moodie, A. F.
Acta Crystallographica, Vol. 10, Issue 10, p. 609-619
DOI: 10.1107/S0365110X57002194

Hard-X-Ray Lensless Imaging of Extended Objects
journal, January 2007

Rodenburg, J. M.; Hurst, A. C.; Cullis, A. G.
Physical Review Letters, Vol. 98, Issue 3
DOI: 10.1103/PhysRevLett.98.034801

Merlin: a fast versatile readout system for Medipix3
journal, January 2013

Plackett, R.; Horswell, I.; Gimenez, E. N.
Journal of Instrumentation, Vol. 8, Issue 01
DOI: 10.1088/1748-0221/8/01/C01038

Depth sectioning of individual dopant atoms with aberration-corrected scanning transmission electron microscopy
journal, January 2008

Xin, Huolin L.; Intaraprasonk, Varat; Muller, David A.
Applied Physics Letters, Vol. 92, Issue 1
DOI: 10.1063/1.2828990

Numerical evaluations of N -beam wave functions in electron scattering by the multi-slice method
journal, March 1974

Goodman, P.; Moodie, A. F.
Acta Crystallographica Section A, Vol. 30, Issue 2
DOI: 10.1107/S056773947400057X

Propagation uniqueness in three-dimensional coherent diffractive imaging
journal, June 2011

Huang, Xiaojing; Harder, Ross; Xiong, Gang
Physical Review B, Vol. 83, Issue 22
DOI: 10.1103/PhysRevB.83.224109

High-Resolution Multislice X-Ray Ptychography of Extended Thick Objects
journal, February 2014

Suzuki, Akihiro; Furutaku, Shin; Shimomura, Kei
Physical Review Letters, Vol. 112, Issue 5
DOI: 10.1103/PhysRevLett.112.053903

Reconstruction of a yeast cell from X-ray diffraction data
journal, June 2006

Thibault, Pierre; Elser, Veit; Jacobsen, Chris
Acta Crystallographica Section A Foundations of Crystallography, Vol. 62, Issue 4
DOI: 10.1107/S0108767306016515

Figures / Tables found in this record:

Fig. 1 (p. 4)

Fig. 2 (p. 5)

Fig. 3 (p. 5)

Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.

Similar Records in DOE PAGES and OSTI.GOV collections:

Resolving 500 nm axial separation by multi-slice X-ray ptychography

Journal Article Huang, Xiaojing ; Yan, Hanfei ; He, Yan ; ... - Acta Crystallographica. Section A, Foundations and Advances (Online)

Multi-slice X-ray ptychography offers an approach to achieve images with a nanometre-scale resolution from samples with thicknesses larger than the depth of field of the imaging system by modeling a thick sample as a set of thin slices and accounting for the wavefront propagation effects within the specimen. Here, we present an experimental demonstration that resolves two layers of nanostructures separated by 500 nm along the axial direction, with sub-10 nm and sub-20 nm resolutions on two layers, respectively. Fluorescence maps are simultaneously measured in the multi-modality imaging scheme to assist in decoupling the mixture of low-spatial-frequency features across differentmore »« less
Cited by 7
https://doi.org/10.1107/S2053273318017229
Multi-slice ptychography with large numerical aperture multilayer Laue lenses

Journal Article Öztürk, Hande ; Yan, Hanfei ; He, Yan ; ... - Optica

Here, the highly convergent x-ray beam focused by multilayer Laue lenses with large numerical apertures is used as a three-dimensional (3D) probe to image layered structures with an axial separation larger than the depth of focus. Instead of collecting weakly scattered high-spatial-frequency signals, the depth-resolving power is provided purely by the intense central cone diverged from the focused beam. Using the multi-slice ptychography method combined with the on-the-fly scan scheme, two layers of nanoparticles separated by 10 μm are successfully reconstructed with 8.1 nm lateral resolution and with a dwell time as low as 0.05 s per scan point. Thismore »« less
Cited by 35
https://doi.org/10.1364/OPTICA.5.000601
Multi-beam X-ray ptychography for high-throughput coherent diffraction imaging

Journal Article Yao, Yudong ; Jiang, Yi ; Klug, Jeffrey A. ; ... - Scientific Reports

X-ray ptychography is a rapidly developing coherent diffraction imaging technique that provides nanoscale resolution on extended field-of-view. However, the requirement of coherence and the scanning mechanism limit the throughput of ptychographic imaging. Herein, we propose X-ray ptychography using multiple illuminations instead of single illumination in conventional ptychography. Multiple locations of the sample are simultaneously imaged by spatially separated X-ray beams, therefore, the obtained field-of-view in one scan can be enlarged by a factor equal to the number of illuminations. We have demonstrated this technique experimentally using two X-ray beams focused by a house-made Fresnel zone plate array. Two areas ofmore »« less
https://doi.org/10.1038/s41598-020-76412-8

Full Text Available
3D x-ray imaging of continuous objects beyond the depth of focus limit

Journal Article Gilles, M. A. ; Nashed, Y. S. G. ; Du, M. ; ... - Optica

X-ray ptychography is quickly becoming the standard method for sub-30 nm imaging of thick extended samples. Being a diffraction-based technique, it involves solving an inverse problem to reconstruct the sample structure from a set of measured diffraction patterns. This problem is traditionally solved to recover a 2D representation of a sample, or in some cases a series of 2D slices of the sample; one can then do standard tomography from a set of such images as the specimen is rotated. Here we present a parallelized, optimization-based algorithm to solve the ptychographic phase retrieval problem directly in 3D. Our approach ismore »« less
Cited by 18
https://doi.org/10.1364/OPTICA.5.001078
Continuous motion scan ptychography: characterization for increased speed in coherent x-ray imaging

Journal Article Deng, Junjing ; Nashed, Youssef S. G. ; Chen, Si ; ... - Optics Express

Ptychography is a coherent diffraction imaging (CDI) method for extended objects in which diffraction patterns are acquired sequentially from overlapping coherent illumination spots. The object's complex transmission function can be reconstructed from those diffraction patterns at a spatial resolution limited only by the scattering strength of the object and the detector geometry. Most experiments to date have positioned the illumination spots on the sample using a move-settle-measure sequence in which the move and settle steps can take longer to complete than the measure step. We describe here the use of a continuous "fly-scan" mode for ptychographic data collection in whichmore »« less
https://doi.org/10.1364/OE.23.005438

Similar Records

Title: Extending the depth of field for ptychography using complex-valued wavelets

Abstract

Citation Formats

Figures / Tables:

Phase retrieval with transverse translation diversity: a nonlinear optimization approach journal, January 2008

Three-dimensional iterative multislice reconstruction for ptychographic X-ray computed tomography journal, January 2018

Phase recovery and lensless imaging by iterative methods in optical, X-ray and electron diffraction journal, May 2002

Multi-slice ptychographic tomography journal, February 2018

Precession x-ray ptychography with multislice approach journal, June 2015

Reaching the third dimension journal, January 2017

Ptychographic transmission microscopy in three dimensions using a multi-slice approach journal, January 2012

Ptychographic microscope for three-dimensional imaging journal, January 2014

An improved ptychographical phase retrieval algorithm for diffractive imaging journal, September 2009

Optimization of overlap uniformness for ptychography journal, January 2014

The dual-tree complex wavelet transform journal, November 2005

Influence of the overlap parameter on the convergence of the ptychographical iterative engine journal, April 2008

Artifact mitigation of ptychography integrated with on-the-fly scanning probe microscopy journal, July 2017

A theory for multiresolution signal decomposition: the wavelet representation journal, July 1989

Complex wavelets for extended depth-of-field: A new method for the fusion of multichannel microscopy images journal, January 2004

Relaxation of the Crowther criterion in multislice tomography journal, January 2018

Efficient subpixel image registration algorithms journal, January 2008

Orthonormal bases of compactly supported wavelets journal, October 1988

Complex Wavelets for Shift Invariant Analysis and Filtering of Signals journal, May 2001

A review of wavelets in biomedical applications journal, April 1996

X-ray ptychography with extended depth of field journal, January 2016

Extended depth of focus for transmission x-ray microscope journal, January 2012

Sampling in x-ray ptychography journal, May 2013

High-Resolution Scanning X-ray Diffraction Microscopy journal, July 2008

Simple denoising algorithm using wavelet transform journal, November 1999

Extended Depth of Field for High-Resolution Scanning Transmission Electron Microscopy journal, December 2010

On the extended depth of focus algorithms for bright field microscopy journal, August 2001

Image processing with complex wavelets journal, September 1999

The scattering of electrons by atoms and crystals. I. A new theoretical approach journal, October 1957

Hard-X-Ray Lensless Imaging of Extended Objects journal, January 2007

Merlin: a fast versatile readout system for Medipix3 journal, January 2013

Depth sectioning of individual dopant atoms with aberration-corrected scanning transmission electron microscopy journal, January 2008

Numerical evaluations of N -beam wave functions in electron scattering by the multi-slice method journal, March 1974

Propagation uniqueness in three-dimensional coherent diffractive imaging journal, June 2011

High-Resolution Multislice X-Ray Ptychography of Extended Thick Objects journal, February 2014

Reconstruction of a yeast cell from X-ray diffraction data journal, June 2006

Phase retrieval with transverse translation diversity: a nonlinear optimization approach
journal, January 2008

Three-dimensional iterative multislice reconstruction for ptychographic X-ray computed tomography
journal, January 2018

Phase recovery and lensless imaging by iterative methods in optical, X-ray and electron diffraction
journal, May 2002

Multi-slice ptychographic tomography
journal, February 2018

Precession x-ray ptychography with multislice approach
journal, June 2015

Reaching the third dimension
journal, January 2017

Ptychographic transmission microscopy in three dimensions using a multi-slice approach
journal, January 2012

Ptychographic microscope for three-dimensional imaging
journal, January 2014

An improved ptychographical phase retrieval algorithm for diffractive imaging
journal, September 2009

Optimization of overlap uniformness for ptychography
journal, January 2014

The dual-tree complex wavelet transform
journal, November 2005

Influence of the overlap parameter on the convergence of the ptychographical iterative engine
journal, April 2008

Artifact mitigation of ptychography integrated with on-the-fly scanning probe microscopy
journal, July 2017

A theory for multiresolution signal decomposition: the wavelet representation
journal, July 1989

Complex wavelets for extended depth-of-field: A new method for the fusion of multichannel microscopy images
journal, January 2004

Relaxation of the Crowther criterion in multislice tomography
journal, January 2018

Efficient subpixel image registration algorithms
journal, January 2008

Orthonormal bases of compactly supported wavelets
journal, October 1988

Complex Wavelets for Shift Invariant Analysis and Filtering of Signals
journal, May 2001

A review of wavelets in biomedical applications
journal, April 1996

X-ray ptychography with extended depth of field
journal, January 2016

Extended depth of focus for transmission x-ray microscope
journal, January 2012

Sampling in x-ray ptychography
journal, May 2013

High-Resolution Scanning X-ray Diffraction Microscopy
journal, July 2008

Simple denoising algorithm using wavelet transform
journal, November 1999

Extended Depth of Field for High-Resolution Scanning Transmission Electron Microscopy
journal, December 2010

On the extended depth of focus algorithms for bright field microscopy
journal, August 2001

Image processing with complex wavelets
journal, September 1999

The scattering of electrons by atoms and crystals. I. A new theoretical approach
journal, October 1957

Hard-X-Ray Lensless Imaging of Extended Objects
journal, January 2007

Merlin: a fast versatile readout system for Medipix3
journal, January 2013

Depth sectioning of individual dopant atoms with aberration-corrected scanning transmission electron microscopy
journal, January 2008

Numerical evaluations of N -beam wave functions in electron scattering by the multi-slice method
journal, March 1974

Propagation uniqueness in three-dimensional coherent diffractive imaging
journal, June 2011

High-Resolution Multislice X-Ray Ptychography of Extended Thick Objects
journal, February 2014

Reconstruction of a yeast cell from X-ray diffraction data
journal, June 2006