skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Comparison of distributed memory algorithms for X-ray wave propagation in inhomogeneous media

Abstract

Calculations of x-ray wave propagation in large objects are needed for modeling diffractive x-ray optics, and for optimization-based approaches to image reconstruction for objects that extend beyond the depth of focus. We describe three methods for calculating wave propagation with large arrays on parallel computing systems with distributed memory: (1) a full-array Fresnel multislice approach, (2) a tiling-based short-distance Fresnel multislice approach, and (3) a finite difference approach. We find that the first approach suffers from internode communication delays when the transverse array size becomes large, while the second and third approaches have similar scaling to large array size problems (with the second approach offering about three times the compute speed).

Authors:
; ORCiD logo; ; ; ORCiD logo
Publication Date:
Research Org.:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
OSTI Identifier:
1664514
Alternate Identifier(s):
OSTI ID: 1661668
Grant/Contract Number:  
AC02-06CH11357
Resource Type:
Journal Article: Published Article
Journal Name:
Optics Express
Additional Journal Information:
Journal Name: Optics Express Journal Volume: 28 Journal Issue: 20; Journal ID: ISSN 1094-4087
Publisher:
Optical Society of America (OSA)
Country of Publication:
United States
Language:
English
Subject:
Multislice; Wave propagation; X-ray optics

Citation Formats

Ali, Sajid, Du, Ming, Adams, Mark F., Smith, Barry, and Jacobsen, Chris. Comparison of distributed memory algorithms for X-ray wave propagation in inhomogeneous media. United States: N. p., 2020. Web. doi:10.1364/OE.400240.
Ali, Sajid, Du, Ming, Adams, Mark F., Smith, Barry, & Jacobsen, Chris. Comparison of distributed memory algorithms for X-ray wave propagation in inhomogeneous media. United States. doi:10.1364/OE.400240.
Ali, Sajid, Du, Ming, Adams, Mark F., Smith, Barry, and Jacobsen, Chris. Mon . "Comparison of distributed memory algorithms for X-ray wave propagation in inhomogeneous media". United States. doi:10.1364/OE.400240.
@article{osti_1664514,
title = {Comparison of distributed memory algorithms for X-ray wave propagation in inhomogeneous media},
author = {Ali, Sajid and Du, Ming and Adams, Mark F. and Smith, Barry and Jacobsen, Chris},
abstractNote = {Calculations of x-ray wave propagation in large objects are needed for modeling diffractive x-ray optics, and for optimization-based approaches to image reconstruction for objects that extend beyond the depth of focus. We describe three methods for calculating wave propagation with large arrays on parallel computing systems with distributed memory: (1) a full-array Fresnel multislice approach, (2) a tiling-based short-distance Fresnel multislice approach, and (3) a finite difference approach. We find that the first approach suffers from internode communication delays when the transverse array size becomes large, while the second and third approaches have similar scaling to large array size problems (with the second approach offering about three times the compute speed).},
doi = {10.1364/OE.400240},
journal = {Optics Express},
issn = {1094-4087},
number = 20,
volume = 28,
place = {United States},
year = {2020},
month = {9}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record at 10.1364/OE.400240

Save / Share:

Works referenced in this record:

Finite-difference field calculations for two-dimensionally confined x-ray waveguides
journal, January 2006


FFT, FMM, and multigrid on the road to exascale: Performance challenges and opportunities
journal, February 2020

  • Ibeid, Huda; Olson, Luke; Gropp, William
  • Journal of Parallel and Distributed Computing, Vol. 136
  • DOI: 10.1016/j.jpdc.2019.09.014

Tomosaic : efficient acquisition and reconstruction of teravoxel tomography data using limited-size synchrotron X-ray beams
journal, August 2018

  • Vescovi, Rafael; Du, Ming; de Andrade, Vincent
  • Journal of Synchrotron Radiation, Vol. 25, Issue 5
  • DOI: 10.1107/S1600577518010093

Beam-propagation method: analysis and assessment
journal, January 1981

  • Van Roey, J.; van der Donk, J.; Lagasse, P. E.
  • Journal of the Optical Society of America, Vol. 71, Issue 7
  • DOI: 10.1364/JOSA.71.000803

Method for Retrieval of the Three-Dimensional Object Potential by Inversion of Dynamical Electron Scattering
journal, December 2012


More are better, but the details matter: combinations of multiple Fresnel zone plates for improved resolution and efficiency in X-ray microscopy
journal, June 2018


MPI for Python
journal, September 2005

  • Dalcín, Lisandro; Paz, Rodrigo; Storti, Mario
  • Journal of Parallel and Distributed Computing, Vol. 65, Issue 9
  • DOI: 10.1016/j.jpdc.2005.03.010

Finite difference methods for stationary and time-dependent X-ray propagation
journal, January 2017


Near-field Soft X-ray Diffraction Modelled by the Multislice Method
journal, January 1994


3D x-ray imaging of continuous objects beyond the depth of focus limit
journal, January 2018


Application of the parabolic wave equation to X-ray diffraction optics
journal, August 1995


MPI for Python: Performance improvements and MPI-2 extensions
journal, May 2008

  • Dalcín, Lisandro; Paz, Rodrigo; Storti, Mario
  • Journal of Parallel and Distributed Computing, Vol. 68, Issue 5
  • DOI: 10.1016/j.jpdc.2007.09.005

The Velociprobe: An ultrafast hard X-ray nanoprobe for high-resolution ptychographic imaging
journal, August 2019

  • Deng, Junjing; Preissner, Curt; Klug, Jeffrey A.
  • Review of Scientific Instruments, Vol. 90, Issue 8
  • DOI: 10.1063/1.5103173

Unified Approach to Ultrasonic Light Diffraction
journal, July 1967

  • Klein, W. R.; Cook, B. D.
  • IEEE Transactions on Sonics and Ultrasonics, Vol. 14, Issue 3
  • DOI: 10.1109/T-SU.1967.29423

GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
journal, July 1986

  • Saad, Youcef; Schultz, Martin H.
  • SIAM Journal on Scientific and Statistical Computing, Vol. 7, Issue 3
  • DOI: 10.1137/0907058

Diffraction phenomena inside thick Fresnel zone plates
journal, November 1996

  • Kopylov, Yuri V.; Popov, Alexei V.; Vinogradov, Alexander V.
  • Radio Science, Vol. 31, Issue 6
  • DOI: 10.1029/96RS01939

Iterative solution of linear systems in the 20th century
journal, November 2000


A practical method for numerical evaluation of solutions of partial differential equations of the heat-conduction type
journal, January 1947

  • Crank, J.; Nicolson, P.
  • Mathematical Proceedings of the Cambridge Philosophical Society, Vol. 43, Issue 1
  • DOI: 10.1017/S0305004100023197

The effect of aperture errors on the antenna radiation pattern
journal, March 1952


Nanoscale x-ray imaging of circuit features without wafer etching
journal, March 2017


Learning approach to optical tomography
journal, January 2015

  • Kamilov, Ulugbek S.; Papadopoulos, Ioannis N.; Shoreh, Morteza H.
  • Optica, Vol. 2, Issue 6
  • DOI: 10.1364/OPTICA.2.000517

A numerical study of resolution and contrast in soft X‐ray contact microscopy
journal, August 1998


Multi-layer Born multiple-scattering model for 3D phase microscopy
journal, January 2020


The scattering of electrons by atoms and crystals. I. A new theoretical approach
journal, October 1957


Additive Schwarz algorithms for parabolic convection-diffusion equations
journal, December 1991


The xraylib library for X-ray–matter interactions. Recent developments
journal, November 2011

  • Schoonjans, Tom; Brunetti, Antonio; Golosio, Bruno
  • Spectrochimica Acta Part B: Atomic Spectroscopy, Vol. 66, Issue 11-12
  • DOI: 10.1016/j.sab.2011.09.011

Automated Derivation of the Adjoint of High-Level Transient Finite Element Programs
journal, January 2013

  • Farrell, P. E.; Ham, D. A.; Funke, S. W.
  • SIAM Journal on Scientific Computing, Vol. 35, Issue 4
  • DOI: 10.1137/120873558

A new theoretical and practical approach to the multislice method
journal, September 1977


A review of algebraic multigrid
journal, March 2001


High-Resolution Multislice X-Ray Ptychography of Extended Thick Objects
journal, February 2014


Comparison of finite-difference and Fourier-transform solutions of the parabolic wave equation with emphasis on integrated-optics applications
journal, January 1991

  • Scarmozzino, R.; Osgood, R. M.
  • Journal of the Optical Society of America A, Vol. 8, Issue 5
  • DOI: 10.1364/JOSAA.8.000724

Rapid calculation of paraxial wave propagation for cylindrically symmetric optics
journal, January 2015

  • Li, Kenan; Jacobsen, Chris
  • Journal of the Optical Society of America A, Vol. 32, Issue 11
  • DOI: 10.1364/JOSAA.32.002074

Diffraction-limited storage rings – a window to the science of tomorrow
journal, August 2014

  • Eriksson, Mikael; van der Veen, J. Friso; Quitmann, Christoph
  • Journal of Synchrotron Radiation, Vol. 21, Issue 5
  • DOI: 10.1107/S1600577514019286

A multiple scattering algorithm for three dimensional phase contrast atomic electron tomography
journal, January 2020


Ptychographic transmission microscopy in three dimensions using a multi-slice approach
journal, January 2012

  • Maiden, A. M.; Humphry, M. J.; Rodenburg, J. M.
  • Journal of the Optical Society of America A, Vol. 29, Issue 8
  • DOI: 10.1364/JOSAA.29.001606

Fast Computation of Fresnel Holograms Employing Difference
journal, September 2001


The Numerical Solution of Parabolic and Elliptic Differential Equations
journal, March 1955

  • Peaceman, D. W.; Rachford, Jr., H. H.
  • Journal of the Society for Industrial and Applied Mathematics, Vol. 3, Issue 1
  • DOI: 10.1137/0103003

Multislice does it all—calculating the performance of nanofocusing X-ray optics
journal, January 2017

  • Li, Kenan; Wojcik, Michael; Jacobsen, Chris
  • Optics Express, Vol. 25, Issue 3
  • DOI: 10.1364/OE.25.001831

An assessment of finite difference beam propagation method
journal, January 1990

  • Chung, Y.; Dagli, N.
  • IEEE Journal of Quantum Electronics, Vol. 26, Issue 8
  • DOI: 10.1109/3.59679

A survey of MPI usage in the US exascale computing project: A survey of MPI usage in the U. S. exascale computing project
journal, September 2018

  • Bernholdt, David E.; Boehm, Swen; Bosilca, George
  • Concurrency and Computation: Practice and Experience
  • DOI: 10.1002/cpe.4851

Theta: Rapid installation and acceptance of an XC40 KNL system: Theta: Rapid installation and acceptance of an XC40 KNL system
journal, September 2017

  • Harms, Kevin; Leggett, Ti; Allen, Ben
  • Concurrency and Computation: Practice and Experience, Vol. 30, Issue 1
  • DOI: 10.1002/cpe.4336

X-Ray Interactions: Photoabsorption, Scattering, Transmission, and Reflection at E = 50-30,000 eV, Z = 1-92
journal, July 1993

  • Henke, B. L.; Gullikson, E. M.; Davis, J. C.
  • Atomic Data and Nuclear Data Tables, Vol. 54, Issue 2, p. 181-342
  • DOI: 10.1006/adnd.1993.1013

TomoBank: a tomographic data repository for computational x-ray science
journal, February 2018

  • De Carlo, Francesco; Gürsoy, Doğa; Ching, Daniel J.
  • Measurement Science and Technology, Vol. 29, Issue 3
  • DOI: 10.1088/1361-6501/aa9c19

Optical Tomographic Image Reconstruction Based on Beam Propagation and Sparse Regularization
journal, March 2016

  • Kamilov, Ulugbek S.; Papadopoulos, Ioannis N.; Shoreh, Morteza H.
  • IEEE Transactions on Computational Imaging, Vol. 2, Issue 1
  • DOI: 10.1109/TCI.2016.2519261

Algebraic Multigrid Methods for Direct Frequency Response Analyses in Solid Mechanics
journal, March 2006


Three dimensions, two microscopes, one code: Automatic differentiation for x-ray nanotomography beyond the depth of focus limit
journal, March 2020

  • Du, Ming; Nashed, Youssef S. G.; Kandel, Saugat
  • Science Advances, Vol. 6, Issue 13
  • DOI: 10.1126/sciadv.aay3700

X-ray ptychography with extended depth of field
journal, January 2016

  • Tsai, Esther H. R.; Usov, Ivan; Diaz, Ana
  • Optics Express, Vol. 24, Issue 25
  • DOI: 10.1364/OE.24.029089

The parabolic equation in the theory of wave propagation: on the 50th anniversary of its publication
journal, January 1996

  • Vlasov, S. N.; Talanov, V. I.
  • Radiophysics and Quantum Electronics, Vol. 38, Issue 1-2
  • DOI: 10.1007/BF01051853

X-ray nanofocusing by kinoform lenses: A comparative study using different modeling approaches
journal, February 2010


A Flexible Inner-Outer Preconditioned GMRES Algorithm
journal, March 1993

  • Saad, Youcef
  • SIAM Journal on Scientific Computing, Vol. 14, Issue 2
  • DOI: 10.1137/0914028

Efficient algorithms for the accurate propagation of extreme-resolution holograms
journal, January 2019


High-performance parallel computing for next-generation holographic imaging
journal, April 2018

  • Sugie, Takashige; Akamatsu, Takanori; Nishitsuji, Takashi
  • Nature Electronics, Vol. 1, Issue 4
  • DOI: 10.1038/s41928-018-0057-5

Preparing sparse solvers for exascale computing
journal, January 2020

  • Anzt, Hartwig; Boman, Erik; Falgout, Rob
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 378, Issue 2166
  • DOI: 10.1098/rsta.2019.0053

Simple and fast calculation algorithm for computer-generated hologram with wavefront recording plane
journal, January 2009

  • Shimobaba, Tomoyoshi; Masuda, Nobuyuki; Ito, Tomoyoshi
  • Optics Letters, Vol. 34, Issue 20
  • DOI: 10.1364/OL.34.003133

Python for Scientific Computing
journal, January 2007


The Design and Implementation of FFTW3
journal, February 2005