DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: GENFIRE: A generalized Fourier iterative reconstruction algorithm for high-resolution 3D imaging

Abstract

Tomography has made a radical impact on diverse fields ranging from the study of 3D atomic arrangements in matter to the study of human health in medicine. Despite its very diverse applications, the core of tomography remains the same, that is, a mathematical method must be implemented to reconstruct the 3D structure of an object from a number of 2D projections. Here, we present the mathematical implementation of a tomographic algorithm, termed GENeralized Fourier Iterative REconstruction (GENFIRE), for high-resolution 3D reconstruction from a limited number of 2D projections. GENFIRE first assembles a 3D Fourier grid with oversampling and then iterates between real and reciprocal space to search for a global solution that is concurrently consistent with the measured data and general physical constraints. The algorithm requires minimal human intervention and also incorporates angular refinement to reduce the tilt angle error. We demonstrate that GENFIRE can produce superior results relative to several other popular tomographic reconstruction techniques through numerical simulations and by experimentally reconstructing the 3D structure of a porous material and a frozen-hydrated marine cyanobacterium. As a result, equipped with a graphical user interface, GENFIRE is freely available from our website and is expected to find broad applications across differentmore » disciplines.« less

Authors:
 [1]; ORCiD logo [1];  [1];  [2];  [1];  [1];  [3];  [4];  [5];  [1]
  1. Univ. of California, Los Angeles, CA (United States)
  2. Univ. of California, Los Angeles, CA (United States); UCLA-DOE Institute for Genomics and Proteomics, Los Angeles, CA (United States)
  3. Univ. of California, Los Angeles, CA (United States); CNRS-Univ. de Strasbourg, Strasbourg (France)
  4. Stanford Univ., Stanford, CA (United States)
  5. UCLA-DOE Institute for Genomics and Proteomics, Los Angeles, CA (United States)
Publication Date:
Research Org.:
SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1394084
Grant/Contract Number:  
AC02-76SF00515
Resource Type:
Accepted Manuscript
Journal Name:
Scientific Reports
Additional Journal Information:
Journal Volume: 7; Journal Issue: 1; Journal ID: ISSN 2045-2322
Publisher:
Nature Publishing Group
Country of Publication:
United States
Language:
English
Subject:
36 MATERIALS SCIENCE; 97 MATHEMATICS AND COMPUTING; Applied physics; Imaging techniques; Nanoscale materials

Citation Formats

Pryor, Alan, Yang, Yongsoo, Rana, Arjun, Gallagher-Jones, Marcus, Zhou, Jihan, Lo, Yuan Hung, Melinte, Georgian, Chiu, Wah, Rodriguez, Jose A., and Miao, Jianwei. GENFIRE: A generalized Fourier iterative reconstruction algorithm for high-resolution 3D imaging. United States: N. p., 2017. Web. doi:10.1038/s41598-017-09847-1.
Pryor, Alan, Yang, Yongsoo, Rana, Arjun, Gallagher-Jones, Marcus, Zhou, Jihan, Lo, Yuan Hung, Melinte, Georgian, Chiu, Wah, Rodriguez, Jose A., & Miao, Jianwei. GENFIRE: A generalized Fourier iterative reconstruction algorithm for high-resolution 3D imaging. United States. https://doi.org/10.1038/s41598-017-09847-1
Pryor, Alan, Yang, Yongsoo, Rana, Arjun, Gallagher-Jones, Marcus, Zhou, Jihan, Lo, Yuan Hung, Melinte, Georgian, Chiu, Wah, Rodriguez, Jose A., and Miao, Jianwei. Tue . "GENFIRE: A generalized Fourier iterative reconstruction algorithm for high-resolution 3D imaging". United States. https://doi.org/10.1038/s41598-017-09847-1. https://www.osti.gov/servlets/purl/1394084.
@article{osti_1394084,
title = {GENFIRE: A generalized Fourier iterative reconstruction algorithm for high-resolution 3D imaging},
author = {Pryor, Alan and Yang, Yongsoo and Rana, Arjun and Gallagher-Jones, Marcus and Zhou, Jihan and Lo, Yuan Hung and Melinte, Georgian and Chiu, Wah and Rodriguez, Jose A. and Miao, Jianwei},
abstractNote = {Tomography has made a radical impact on diverse fields ranging from the study of 3D atomic arrangements in matter to the study of human health in medicine. Despite its very diverse applications, the core of tomography remains the same, that is, a mathematical method must be implemented to reconstruct the 3D structure of an object from a number of 2D projections. Here, we present the mathematical implementation of a tomographic algorithm, termed GENeralized Fourier Iterative REconstruction (GENFIRE), for high-resolution 3D reconstruction from a limited number of 2D projections. GENFIRE first assembles a 3D Fourier grid with oversampling and then iterates between real and reciprocal space to search for a global solution that is concurrently consistent with the measured data and general physical constraints. The algorithm requires minimal human intervention and also incorporates angular refinement to reduce the tilt angle error. We demonstrate that GENFIRE can produce superior results relative to several other popular tomographic reconstruction techniques through numerical simulations and by experimentally reconstructing the 3D structure of a porous material and a frozen-hydrated marine cyanobacterium. As a result, equipped with a graphical user interface, GENFIRE is freely available from our website and is expected to find broad applications across different disciplines.},
doi = {10.1038/s41598-017-09847-1},
journal = {Scientific Reports},
number = 1,
volume = 7,
place = {United States},
year = {Tue Sep 05 00:00:00 EDT 2017},
month = {Tue Sep 05 00:00:00 EDT 2017}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 57 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Three-dimensional coordinates of individual atoms in materials revealed by electron tomography
journal, September 2015

  • Xu, Rui; Chen, Chien-Chun; Wu, Li
  • Nature Materials, Vol. 14, Issue 11
  • DOI: 10.1038/nmat4426

High-resolution, low-dose phase contrast X-ray tomography for 3D diagnosis of human breast cancers
journal, October 2012

  • Zhao, Y.; Brun, E.; Coan, P.
  • Proceedings of the National Academy of Sciences, Vol. 109, Issue 45
  • DOI: 10.1073/pnas.1204460109

Electron tomography at 2.4-ångström resolution
journal, March 2012

  • Scott, M. C.; Chen, Chien-Chun; Mecklenburg, Matthew
  • Nature, Vol. 483, Issue 7390
  • DOI: 10.1038/nature10934

STRUCTURAL STUDIES BY ELECTRON TOMOGRAPHY: From Cells to Molecules
journal, June 2005


Extending the methodology of X-ray crystallography to allow imaging of micrometre-sized non-crystalline specimens
journal, July 1999

  • Miao, Jianwei; Charalambous, Pambos; Kirz, Janos
  • Nature, Vol. 400, Issue 6742
  • DOI: 10.1038/22498

Phase retrieval and differential phase-contrast imaging with low-brilliance X-ray sources
journal, March 2006

  • Pfeiffer, Franz; Weitkamp, Timm; Bunk, Oliver
  • Nature Physics, Vol. 2, Issue 4, p. 258-261
  • DOI: 10.1038/nphys265

The Three-Dimensional Morphology of Growing Dendrites
journal, July 2015

  • Gibbs, J. W.; Mohan, K. A.; Gulsoy, E. B.
  • Scientific Reports, Vol. 5, Issue 1
  • DOI: 10.1038/srep11824

Beyond crystallography: Diffractive imaging using coherent x-ray light sources
journal, April 2015


Unravelling biological macromolecules with cryo-electron microscopy
journal, September 2016

  • Fernandez-Leiro, Rafael; Scheres, Sjors H. W.
  • Nature, Vol. 537, Issue 7620
  • DOI: 10.1038/nature19948

Nonlinear total variation based noise removal algorithms
journal, November 1992


Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering
journal, August 2007

  • Dabov, Kostadin; Foi, Alessandro; Katkovnik, Vladimir
  • IEEE Transactions on Image Processing, Vol. 16, Issue 8
  • DOI: 10.1109/TIP.2007.901238

Compressed sensing
journal, April 2006


Deciphering chemical order/disorder and material properties at the single-atom level
journal, February 2017

  • Yang, Yongsoo; Chen, Chien-Chun; Scott, M. C.
  • Nature, Vol. 542, Issue 7639
  • DOI: 10.1038/nature21042

Three-dimensional imaging of dislocations in a nanoparticle at atomic resolution
journal, March 2013

  • Chen, Chien-Chun; Zhu, Chun; White, Edward R.
  • Nature, Vol. 496, Issue 7443
  • DOI: 10.1038/nature12009

Three-dimensional structure determination from a single view
journal, December 2009

  • Raines, Kevin S.; Salha, Sara; Sandberg, Richard L.
  • Nature, Vol. 463, Issue 7278
  • DOI: 10.1038/nature08705

Visualizing virus assembly intermediates inside marine cyanobacteria
journal, October 2013

  • Dai, Wei; Fu, Caroline; Raytcheva, Desislava
  • Nature, Vol. 502, Issue 7473
  • DOI: 10.1038/nature12604

A two-dimensional interpolation function for irregularly-spaced data
conference, January 1968


Atomic electron tomography: 3D structures without crystals
journal, September 2016


Phase–contrast X–ray computed tomography for observing biological soft tissues
journal, April 1996

  • Momose, Atsushi; Takeda, Tohoru; Itai, Yuji
  • Nature Medicine, Vol. 2, Issue 4
  • DOI: 10.1038/nm0496-473

Single-Particle Cryo-EM at Crystallographic Resolution
journal, April 2015


The development of cryo-EM into a mainstream structural biology technique
journal, December 2015


Low-dose x-ray phase-contrast and absorption CT using equally sloped tomography
journal, August 2010


Quantitative 3D imaging of whole, unstained cells by using X-ray diffraction microscopy
journal, June 2010

  • Jiang, H.; Song, C.; Chen, C. -C.
  • Proceedings of the National Academy of Sciences, Vol. 107, Issue 25
  • DOI: 10.1073/pnas.1000156107

Measuring Lattice Strain in Three Dimensions through Electron Microscopy
journal, September 2015


On possible extensions of X-ray crystallography through diffraction-pattern oversampling
journal, November 2000

  • Miao, J.; Sayre, D.
  • Acta Crystallographica Section A Foundations of Crystallography, Vol. 56, Issue 6
  • DOI: 10.1107/S010876730001031X

Dual-Axis Tomography: An Approach with Alignment Methods That Preserve Resolution
journal, December 1997


Three-dimensional imaging of chemical phase transformations at the nanoscale with full-field transmission X-ray microscopy
journal, July 2011

  • Meirer, Florian; Cabana, Jordi; Liu, Yijin
  • Journal of Synchrotron Radiation, Vol. 18, Issue 5
  • DOI: 10.1107/S0909049511019364

Algebraic Reconstruction Techniques (ART) for three-dimensional electron microscopy and X-ray photography
journal, December 1970


Mo-Si-B Alloys for Ultrahigh-Temperature Structural Applications
journal, June 2012


Phase retrieval from the magnitude of the Fourier transforms of nonperiodic objects
journal, January 1998

  • Miao, J.; Sayre, D.; Chapman, H. N.
  • Journal of the Optical Society of America A, Vol. 15, Issue 6
  • DOI: 10.1364/JOSAA.15.001662

Metrics for 3D Rotations: Comparison and Analysis
journal, June 2009


Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
journal, February 2006

  • Candes, E.J.; Romberg, J.; Tao, T.
  • IEEE Transactions on Information Theory, Vol. 52, Issue 2, p. 489-509
  • DOI: 10.1109/TIT.2005.862083

Advanced Computing in Electron Microscopy
book, January 2010


Phase-contrast zoom tomography reveals precise locations of macrophages in mouse lungs
journal, May 2015

  • Krenkel, Martin; Markus, Andrea; Bartels, Matthias
  • Scientific Reports, Vol. 5, Issue 1
  • DOI: 10.1038/srep09973

Structure of  -galactosidase at 3.2-A resolution obtained by cryo-electron microscopy
journal, July 2014

  • Bartesaghi, A.; Matthies, D.; Banerjee, S.
  • Proceedings of the National Academy of Sciences, Vol. 111, Issue 32
  • DOI: 10.1073/pnas.1402809111

Iterative methods for the three-dimensional reconstruction of an object from projections
journal, July 1972


Radiation dose reduction and image enhancement in biological imaging through equally-sloped tomography
journal, November 2008

  • Lee, Edwin; Fahimian, Benjamin P.; Iancu, Cristina V.
  • Journal of Structural Biology, Vol. 164, Issue 2
  • DOI: 10.1016/j.jsb.2008.07.011

Ptychographic X-ray computed tomography at the nanoscale
journal, September 2010

  • Dierolf, Martin; Menzel, Andreas; Thibault, Pierre
  • Nature, Vol. 467, Issue 7314
  • DOI: 10.1038/nature09419

Three-Dimensional GaN Ga 2 O 3 Core Shell Structure Revealed by X-Ray Diffraction Microscopy
journal, November 2006


Tomo3D 2.0 – Exploitation of Advanced Vector eXtensions (AVX) for 3D reconstruction
journal, February 2015

  • Agulleiro, Jose-Ignacio; Fernandez, Jose-Jesus
  • Journal of Structural Biology, Vol. 189, Issue 2
  • DOI: 10.1016/j.jsb.2014.11.009

Formation of bimetallic clusters in superfluid helium nanodroplets analysed by atomic resolution electron tomography
journal, October 2015

  • Haberfehlner, Georg; Thaler, Philipp; Knez, Daniel
  • Nature Communications, Vol. 6, Issue 1
  • DOI: 10.1038/ncomms9779

Imaging cellular architecture with X-rays
journal, October 2010

  • Larabell, Carolyn A.; Nugent, Keith A.
  • Current Opinion in Structural Biology, Vol. 20, Issue 5
  • DOI: 10.1016/j.sbi.2010.08.008

Transient oxidation of Mo–Si–B alloys: Effect of the microstructure size scale
journal, September 2009


Compressed sensing electron tomography
journal, August 2013


A new view into prokaryotic cell biology from electron cryotomography
journal, February 2016

  • Oikonomou, Catherine M.; Chang, Yi-Wei; Jensen, Grant J.
  • Nature Reviews Microbiology, Vol. 14, Issue 4
  • DOI: 10.1038/nrmicro.2016.7

Simultaneous Algebraic Reconstruction Technique (SART): A Superior Implementation of the Art Algorithm
journal, January 1984


Fundamentals of Computerized Tomography
book, January 2009


High-resolution non-destructive three-dimensional imaging of integrated circuits
journal, March 2017

  • Holler, Mirko; Guizar-Sicairos, Manuel; Tsai, Esther H. R.
  • Nature, Vol. 543, Issue 7645
  • DOI: 10.1038/nature21698

Principles of Computerized Tomographic Imaging
book, January 2001


Three-Dimensional Visualization of a Human Chromosome Using Coherent X-Ray Diffraction
journal, January 2009


Three-Dimensional Coherent X-Ray Diffraction Imaging of Molten Iron in Mantle Olivine at Nanoscale Resolution
journal, May 2013


Equally sloped tomography with oversampling reconstruction
journal, August 2005


Radiation dose reduction in medical x-ray CT via Fourier-based iterative reconstruction: Dose reduction in CT via Fourier-Based Iterative Reconstruction
journal, February 2013

  • Fahimian, Benjamin P.; Zhao, Yunzhe; Huang, Zhifeng
  • Medical Physics, Vol. 40, Issue 3
  • DOI: 10.1118/1.4791644

Advanced Computing in Electron Microscopy
book, January 1998


Experimental demonstration of novel beam characterization using a polarizable X-band transverse deflection structure
journal, February 2021


Advanced Computing in Electron Microscopy
book, January 2020


Three-dimensional structure determination from a single view
text, January 2009


Algebraic Reconstruction Techniques (ART) for three-dimensional electron microscopy and X-ray photography
journal, December 1970


Iterative methods for the three-dimensional reconstruction of an object from projections
journal, July 1972


An overview of convex projections theory and its application to image recovery problems
journal, January 1992


Ab initio phase determination and phase extension using non-crystallographic symmetry
journal, October 1995


Transient oxidation of Mo–Si–B alloys: Effect of the microstructure size scale
journal, September 2009


Single-Particle Cryo-EM at Crystallographic Resolution
journal, April 2015


Radiation dose reduction and image enhancement in biological imaging through equally-sloped tomography
journal, November 2008

  • Lee, Edwin; Fahimian, Benjamin P.; Iancu, Cristina V.
  • Journal of Structural Biology, Vol. 164, Issue 2
  • DOI: 10.1016/j.jsb.2008.07.011

Imaging cellular architecture with X-rays
journal, October 2010

  • Larabell, Carolyn A.; Nugent, Keith A.
  • Current Opinion in Structural Biology, Vol. 20, Issue 5
  • DOI: 10.1016/j.sbi.2010.08.008

Compressed sensing electron tomography
journal, August 2013


Extending the methodology of X-ray crystallography to allow imaging of micrometre-sized non-crystalline specimens
journal, July 1999

  • Miao, Jianwei; Charalambous, Pambos; Kirz, Janos
  • Nature, Vol. 400, Issue 6742
  • DOI: 10.1038/22498

Three-dimensional structure determination from a single view
journal, December 2009

  • Raines, Kevin S.; Salha, Sara; Sandberg, Richard L.
  • Nature, Vol. 463, Issue 7278
  • DOI: 10.1038/nature08705

Ptychographic X-ray computed tomography at the nanoscale
journal, September 2010

  • Dierolf, Martin; Menzel, Andreas; Thibault, Pierre
  • Nature, Vol. 467, Issue 7314
  • DOI: 10.1038/nature09419

Electron tomography at 2.4-ångström resolution
journal, March 2012

  • Scott, M. C.; Chen, Chien-Chun; Mecklenburg, Matthew
  • Nature, Vol. 483, Issue 7390
  • DOI: 10.1038/nature10934

Three-dimensional imaging of dislocations in a nanoparticle at atomic resolution
journal, March 2013

  • Chen, Chien-Chun; Zhu, Chun; White, Edward R.
  • Nature, Vol. 496, Issue 7443
  • DOI: 10.1038/nature12009

Visualizing virus assembly intermediates inside marine cyanobacteria
journal, October 2013

  • Dai, Wei; Fu, Caroline; Raytcheva, Desislava
  • Nature, Vol. 502, Issue 7473
  • DOI: 10.1038/nature12604

Deciphering chemical order/disorder and material properties at the single-atom level
journal, February 2017

  • Yang, Yongsoo; Chen, Chien-Chun; Scott, M. C.
  • Nature, Vol. 542, Issue 7639
  • DOI: 10.1038/nature21042

Formation of bimetallic clusters in superfluid helium nanodroplets analysed by atomic resolution electron tomography
journal, October 2015

  • Haberfehlner, Georg; Thaler, Philipp; Knez, Daniel
  • Nature Communications, Vol. 6, Issue 1
  • DOI: 10.1038/ncomms9779

Phase–contrast X–ray computed tomography for observing biological soft tissues
journal, April 1996

  • Momose, Atsushi; Takeda, Tohoru; Itai, Yuji
  • Nature Medicine, Vol. 2, Issue 4
  • DOI: 10.1038/nm0496-473

Phase retrieval and differential phase-contrast imaging with low-brilliance X-ray sources
journal, March 2006

  • Pfeiffer, Franz; Weitkamp, Timm; Bunk, Oliver
  • Nature Physics, Vol. 2, Issue 4, p. 258-261
  • DOI: 10.1038/nphys265

Quantitative 3D imaging of whole, unstained cells by using X-ray diffraction microscopy
journal, June 2010

  • Jiang, H.; Song, C.; Chen, C. -C.
  • Proceedings of the National Academy of Sciences, Vol. 107, Issue 25
  • DOI: 10.1073/pnas.1000156107

High-resolution, low-dose phase contrast X-ray tomography for 3D diagnosis of human breast cancers
journal, October 2012

  • Zhao, Y.; Brun, E.; Coan, P.
  • Proceedings of the National Academy of Sciences, Vol. 109, Issue 45
  • DOI: 10.1073/pnas.1204460109

Structure of  -galactosidase at 3.2-A resolution obtained by cryo-electron microscopy
journal, July 2014

  • Bartesaghi, A.; Matthies, D.; Banerjee, S.
  • Proceedings of the National Academy of Sciences, Vol. 111, Issue 32
  • DOI: 10.1073/pnas.1402809111

Comments on "Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering
journal, January 2011


Image Restoration by the Method of Convex Projections: Part 1ߞTheory
journal, October 1982


Fourier-based forward and back-projectors in iterative fan-beam tomographic image reconstruction
journal, May 2006

  • O'Connor, Y. Z.; Fessler, J. A.
  • IEEE Transactions on Medical Imaging, Vol. 25, Issue 5
  • DOI: 10.1109/tmi.2006.872139

Radiation dose reduction in medical x-ray CT via Fourier-based iterative reconstruction: Dose reduction in CT via Fourier-Based Iterative Reconstruction
journal, February 2013

  • Fahimian, Benjamin P.; Zhao, Yunzhe; Huang, Zhifeng
  • Medical Physics, Vol. 40, Issue 3
  • DOI: 10.1118/1.4791644

Beyond crystallography: Diffractive imaging using coherent x-ray light sources
journal, April 2015


STRUCTURAL STUDIES BY ELECTRON TOMOGRAPHY: From Cells to Molecules
journal, June 2005


Simultaneous Algebraic Reconstruction Technique (SART): A Superior Implementation of the Art Algorithm
journal, January 1984


On some common compressive sensing recovery algorithms and applications - Review paper
preprint, January 2017


Works referencing / citing this record:

Three-dimensional structural dynamics of DNA origami Bennett linkages using individual-particle electron tomography
journal, February 2018


A molecular cross-linking approach for hybrid metal oxides
journal, March 2018


Correlating the three-dimensional atomic defects and electronic properties of two-dimensional transition metal dichalcogenides
journal, March 2020


Observing crystal nucleation in four dimensions using atomic electron tomography
journal, June 2019


Quantitative characterization of high temperature oxidation using electron tomography and energy-dispersive X-ray spectroscopy
journal, July 2018


Single-Molecule 3D Images of “Hole-Hole” IgG1 Homodimers by Individual-Particle Electron Tomography
journal, June 2019


Multimodal x-ray and electron microscopy of the Allende meteorite
journal, September 2019


A streaming multi-GPU implementation of image simulation algorithms for scanning transmission electron microscopy
journal, October 2017

  • Pryor, Alan; Ophus, Colin; Miao, Jianwei
  • Advanced Structural and Chemical Imaging, Vol. 3, Issue 1
  • DOI: 10.1186/s40679-017-0048-z

Electron tomography for functional nanomaterials
journal, April 2020


Atomic electron tomography in three and four dimensions
journal, April 2020

  • Zhou, Jihan; Yang, Yongsoo; Ercius, Peter
  • MRS Bulletin, Vol. 45, Issue 4
  • DOI: 10.1557/mrs.2020.88

Quantitative characterization of high temperature oxidation using electron tomography and energy-dispersive X-ray spectroscopy
journal, July 2018


Single-Molecule 3D Images of “Hole-Hole” IgG1 Homodimers by Individual-Particle Electron Tomography
journal, June 2019


Correlative 3D x-ray fluorescence and ptychographic tomography of frozen-hydrated green algae
journal, November 2018

  • Deng, Junjing; Lo, Yuan Hung; Gallagher-Jones, Marcus
  • Science Advances, Vol. 4, Issue 11
  • DOI: 10.1126/sciadv.aau4548

Multimodal x-ray and electron microscopy of the Allende meteorite
journal, September 2019