Complex imaging of phase domains by deep neural networks

Wu, Longlong; Juhas, Pavol; Yoo, Shinjae; Robinson, Ian

doi:10.1107/S2052252520013780

Complex imaging of phase domains by deep neural networks

Journal Article · Fri Jan 01 04:00:00 EST 2021 · IUCrJ

DOI:https://doi.org/10.1107/S2052252520013780· OSTI ID:1712507

; Juhas, Pavol; ;

The reconstruction of a single-particle image from the modulus of its Fourier transform, by phase-retrieval methods, has been extensively applied in X-ray structural science. Particularly for strong-phase objects, such as the phase domains found inside crystals by Bragg coherent diffraction imaging (BCDI), conventional iteration methods are time consuming and sensitive to their initial guess because of their iterative nature. Here, a deep-neural-network model is presented which gives a fast and accurate estimate of the complex single-particle image in the form of a universal approximator learned from synthetic data. A way to combine the deep-neural-network model with conventional iterative methods is then presented to refine the accuracy of the reconstructed results from the proposed deep-neural-network model. Improved convergence is also demonstrated with experimental BCDI data.

View Journal Article

Sponsoring Organization:: USDOE

Grant/Contract Number:: NONE; SC0012704; AC02-06CH11357

OSTI ID:: 1712507

Alternate ID(s):: OSTI ID: 1770409
OSTI ID: 1779029
OSTI ID: 1784505
OSTI ID: 1677665

Journal Information:: IUCrJ, Journal Name: IUCrJ Journal Issue: 1 Vol. 8; ISSN 2052-2525; ISSN IUCRAJ

Publisher:: International Union of Crystallography (IUCr)Copyright Statement

Country of Publication:: United Kingdom

Language:: English

References (34)

Using the T-Matrix Method for Light Scattering Computations by Non-axisymmetric Particles: Superellipsoids and Realistically Shaped Particles Wriedt, Thomas Particle & Particle Systems Characterization, Vol. 19, Issue 4 https://doi.org/10.1002/1521-4117(200208)19:4<256::AID-PPSC256>3.0.CO;2-8	journal	August 2002
Domain Texture of the Orthorhombic Phase of La2−xBaxCuO4 Robinson, Ian; Assefa, Tadesse A.; Cao, Yue Journal of Superconductivity and Novel Magnetism https://doi.org/10.1007/s10948-019-05252-z	journal	August 2019
Extending the methodology of X-ray crystallography to allow imaging of micrometre-sized non-crystalline specimens Miao, Jianwei; Charalambous, Pambos; Kirz, Janos Nature, Vol. 400, Issue 6742 https://doi.org/10.1038/22498	journal	July 1999
Soft X-ray microscopy at a spatial resolution better than 15 nm Chao, Weilun; Harteneck, Bruce D.; Liddle, J. Alexander Nature, Vol. 435, Issue 7046 https://doi.org/10.1038/nature03719	journal	June 2005
Three-dimensional mapping of a deformation field inside a nanocrystal Pfeifer, Mark A.; Williams, Garth J.; Vartanyants, Ivan A. Nature, Vol. 442, Issue 7098 https://doi.org/10.1038/nature04867	journal	July 2006
Strain-relief by single dislocation loops in calcite crystals grown on self-assembled monolayers Ihli, Johannes; Clark, Jesse N.; Côté, Alexander S. Nature Communications, Vol. 7, Issue 1 https://doi.org/10.1038/ncomms11878	journal	June 2016
Single-shot three-dimensional structure determination of nanocrystals with femtosecond X-ray free-electron laser pulses Xu, Rui; Jiang, Huaidong; Song, Changyong Nature Communications, Vol. 5, Issue 1 https://doi.org/10.1038/ncomms5061	journal	June 2014
Coherent X-ray diffraction imaging of strain at the nanoscale Robinson, Ian; Harder, Ross Nature Materials, Vol. 8, Issue 4 https://doi.org/10.1038/nmat2400	journal	April 2009
Three-dimensional imaging of strain in a single ZnO nanorod Newton, Marcus C.; Leake, Steven J.; Harder, Ross Nature Materials, Vol. 9, Issue 2 https://doi.org/10.1038/nmat2607	journal	December 2009
Nanoscale X-ray imaging Sakdinawat, Anne; Attwood, David Nature Photonics, Vol. 4, Issue 12, p. 840-848 https://doi.org/10.1038/nphoton.2010.267	journal	December 2010
Femtosecond diffractive imaging with a soft-X-ray free-electron laser Chapman, Henry N.; Barty, Anton; Bogan, Michael J. Nature Physics, Vol. 2, Issue 12 https://doi.org/10.1038/nphys461	journal	November 2006
Coherent diffractive imaging of single helium nanodroplets with a high harmonic generation source Rupp, Daniela; Monserud, Nils; Langbehn, Bruno Nature Communications, Vol. 8, Issue 1 https://doi.org/10.1038/s41467-017-00287-z	journal	September 2017
Direct observation of picosecond melting and disintegration of metallic nanoparticles Ihm, Yungok; Cho, Do Hyung; Sung, Daeho Nature Communications, Vol. 10, Issue 1 https://doi.org/10.1038/s41467-019-10328-4	journal	June 2019
Ultrafast relaxation of photoexcited superfluid He nanodroplets Mudrich, M.; LaForge, A. C.; Ciavardini, A. Nature Communications, Vol. 11, Issue 1 https://doi.org/10.1038/s41467-019-13681-6	journal	January 2020
Real-time coherent diffraction inversion using deep generative networks Cherukara, Mathew J.; Nashed, Youssef S. G.; Harder, Ross J. Scientific Reports, Vol. 8, Issue 1 https://doi.org/10.1038/s41598-018-34525-1	journal	November 2018
Megahertz single-particle imaging at the European XFEL Sobolev, Egor; Zolotarev, Sergei; Giewekemeyer, Klaus Communications Physics, Vol. 3, Issue 1 https://doi.org/10.1038/s42005-020-0362-y	journal	May 2020
Relaxed averaged alternating reflections for diffraction imaging Luke, D. Russell Inverse Problems, Vol. 21, Issue 1 https://doi.org/10.1088/0266-5611/21/1/004	journal	November 2004
An algorithm for Bragg coherent x-ray diffractive imaging of highly strained nanocrystals Wang, Ziyi; Gorobtsov, Oleg; Singer, Andrej New Journal of Physics, Vol. 22, Issue 1 https://doi.org/10.1088/1367-2630/ab61db	journal	January 2020
X-ray image reconstruction from a diffraction pattern alone Marchesini, S.; He, H.; Chapman, H. N. Physical Review B, Vol. 68, Issue 14 https://doi.org/10.1103/PhysRevB.68.140101	journal	October 2003
Orientation variation of surface strain Harder, R.; Pfeifer, M. A.; Williams, G. J. Physical Review B, Vol. 76, Issue 11 https://doi.org/10.1103/PhysRevB.76.115425	journal	September 2007
Monte Carlo Calculation for Electromagnetic-Wave Scattering from Random Rough Surfaces Garcia, N.; Stoll, E. Physical Review Letters, Vol. 52, Issue 20 https://doi.org/10.1103/PhysRevLett.52.1798	journal	May 1984
Reconstruction of the Shapes of Gold Nanocrystals Using Coherent X-Ray Diffraction Robinson, I. K.; Vartanyants, I. A.; Williams, G. J. Physical Review Letters, Vol. 87, Issue 19 https://doi.org/10.1103/PhysRevLett.87.195505	journal	October 2001
Three-Dimensional Imaging of Microstructure in Au Nanocrystals Williams, G. J.; Pfeifer, M. A.; Vartanyants, I. A. Physical Review Letters, Vol. 90, Issue 17 https://doi.org/10.1103/PhysRevLett.90.175501	journal	April 2003
Single-particle imaging without symmetry constraints at an X-ray free-electron laser Rose, Max; Bobkov, Sergey; Ayyer, Kartik IUCrJ, Vol. 5, Issue 6, p. 727-736 https://doi.org/10.1107/S205225251801120X	journal	September 2018
Ultrafast Three-Dimensional Imaging of Lattice Dynamics in Individual Gold Nanocrystals Clark, J. N.; Beitra, L.; Xiong, G. Science, Vol. 341, Issue 6141 https://doi.org/10.1126/science.1236034	journal	May 2013
Shapes and vorticities of superfluid helium nanodroplets Gomez, L. F.; Ferguson, K. R.; Cryan, J. P. Science, Vol. 345, Issue 6199 https://doi.org/10.1126/science.1252395	journal	August 2014
Time-Resolved X-Ray Microscopy for Materials Science Wen, Haidan; Cherukara, Mathew J.; Holt, Martin V. Annual Review of Materials Research, Vol. 49, Issue 1 https://doi.org/10.1146/annurev-matsci-070616-124014	journal	July 2019
Phase retrieval algorithms: a comparison Fienup, J. R. Applied Optics, Vol. 21, Issue 15 https://doi.org/10.1364/AO.21.002758	journal	January 1982
Fast two-dimensional phase-unwrapping algorithm based on sorting by reliability following a noncontinuous path Herráez, Miguel Arevallilo; Burton, David R.; Lalor, Michael J. Applied Optics, Vol. 41, Issue 35 https://doi.org/10.1364/AO.41.007437	journal	January 2002
Phase retrieval by iterated projections Elser, Veit Journal of the Optical Society of America A, Vol. 20, Issue 1 https://doi.org/10.1364/JOSAA.20.000040	journal	January 2003
Incorrect support and missing center tolerances of phasing algorithms Huang, Xiaojing; Nelson, Johanna; Steinbrener, Jan Optics Express, Vol. 18, Issue 25 https://doi.org/10.1364/OE.18.026441	journal	January 2010
Deep learning approach for Fourier ptychography microscopy Nguyen, Thanh; Xue, Yujia; Li, Yunzhe Optics Express, Vol. 26, Issue 20 https://doi.org/10.1364/OE.26.026470	journal	January 2018
Reconstruction of an object from the modulus of its Fourier transform Fienup, J. R. Optics Letters, Vol. 3, Issue 1, p. 27-29 https://doi.org/10.1364/OL.3.000027	journal	January 1978
Lame Ovals Gridgeman, N. T. The Mathematical Gazette, Vol. 54, Issue 387 https://doi.org/10.2307/3613154	journal	February 1970

Similar Records

AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging

Journal Article · Fri Jun 03 00:00:00 EDT 2022 · npj Computational Materials · OSTI ID:1871070

Complex imaging of phase domains by deep neural networks

Citation Formats

References (34)

Similar Records

Related Subjects