DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Computational multifocal microscopy

Abstract

Despite recent advances, high performance single-shot 3D microscopy remains an elusive task. By introducing designed diffractive optical elements (DOEs), one is capable of converting a microscope into a 3D "kaleidoscope", in which case the snapshot image consists of an array of tiles and each tile focuses on different depths. However, the acquired multifocal microscopic (MFM) image suffers from multiple sources of degradation, which prevents MFM from further applications. We propose a unifying computational framework which simplifies the imaging system and achieves 3D reconstruction via computation. Our optical configuration omits chromatic correction grating and redesigns the multifocal grating to enlarge the tracking area. Our proposed setup features only one single grating in addition to a regular microscope.The aberration correction, along with Poisson and background denoising, are incorporated in our deconvolution-based fully-automated algorithm, which requires no empirical parameter-tuning. In experiments, we achieve the spatial resolutions of 0:35um (lateral) and 0:5um (axial), which are comparable to the resolution that can be achieved with confocal deconvolution microscopy. We demonstrate a 3D video of moving bacteria recorded at 25 frames per second using our proposed computational multifocal microscopy technique.

Authors:
; ORCiD logo; ; ; ; ; ORCiD logo; ; ; ; ORCiD logo; ;
Publication Date:
Research Org.:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Biological and Environmental Research (BER); National Science Foundation (NSF)
OSTI Identifier:
1483720
Alternate Identifier(s):
OSTI ID: 1493888
Grant/Contract Number:  
AC02-06CH11357
Resource Type:
Published Article
Journal Name:
Biomedical Optics Express
Additional Journal Information:
Journal Name: Biomedical Optics Express Journal Volume: 9 Journal Issue: 12; Journal ID: ISSN 2156-7085
Publisher:
Optical Society of America
Country of Publication:
United States
Language:
English
Subject:
36 MATERIALS SCIENCE; 97 MATHEMATICS AND COMPUTING

Citation Formats

He, Kuan, Wang, Zihao, Huang, Xiang, Wang, Xiaolei, Yoo, Seunghwan, Ruiz, Pablo, Gdor, Itay, Selewa, Alan, Ferrier, Nicola J., Scherer, Norbert, Hereld, Mark, Katsaggelos, Aggelos K., and Cossairt, Oliver. Computational multifocal microscopy. United States: N. p., 2018. Web. doi:10.1364/BOE.9.006477.
He, Kuan, Wang, Zihao, Huang, Xiang, Wang, Xiaolei, Yoo, Seunghwan, Ruiz, Pablo, Gdor, Itay, Selewa, Alan, Ferrier, Nicola J., Scherer, Norbert, Hereld, Mark, Katsaggelos, Aggelos K., & Cossairt, Oliver. Computational multifocal microscopy. United States. https://doi.org/10.1364/BOE.9.006477
He, Kuan, Wang, Zihao, Huang, Xiang, Wang, Xiaolei, Yoo, Seunghwan, Ruiz, Pablo, Gdor, Itay, Selewa, Alan, Ferrier, Nicola J., Scherer, Norbert, Hereld, Mark, Katsaggelos, Aggelos K., and Cossairt, Oliver. Wed . "Computational multifocal microscopy". United States. https://doi.org/10.1364/BOE.9.006477.
@article{osti_1483720,
title = {Computational multifocal microscopy},
author = {He, Kuan and Wang, Zihao and Huang, Xiang and Wang, Xiaolei and Yoo, Seunghwan and Ruiz, Pablo and Gdor, Itay and Selewa, Alan and Ferrier, Nicola J. and Scherer, Norbert and Hereld, Mark and Katsaggelos, Aggelos K. and Cossairt, Oliver},
abstractNote = {Despite recent advances, high performance single-shot 3D microscopy remains an elusive task. By introducing designed diffractive optical elements (DOEs), one is capable of converting a microscope into a 3D "kaleidoscope", in which case the snapshot image consists of an array of tiles and each tile focuses on different depths. However, the acquired multifocal microscopic (MFM) image suffers from multiple sources of degradation, which prevents MFM from further applications. We propose a unifying computational framework which simplifies the imaging system and achieves 3D reconstruction via computation. Our optical configuration omits chromatic correction grating and redesigns the multifocal grating to enlarge the tracking area. Our proposed setup features only one single grating in addition to a regular microscope.The aberration correction, along with Poisson and background denoising, are incorporated in our deconvolution-based fully-automated algorithm, which requires no empirical parameter-tuning. In experiments, we achieve the spatial resolutions of 0:35um (lateral) and 0:5um (axial), which are comparable to the resolution that can be achieved with confocal deconvolution microscopy. We demonstrate a 3D video of moving bacteria recorded at 25 frames per second using our proposed computational multifocal microscopy technique.},
doi = {10.1364/BOE.9.006477},
journal = {Biomedical Optics Express},
number = 12,
volume = 9,
place = {United States},
year = {Wed Nov 28 00:00:00 EST 2018},
month = {Wed Nov 28 00:00:00 EST 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1364/BOE.9.006477

Citation Metrics:
Cited by: 10 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Improved superresolution microscopy imaging by sparse deconvolution with an interframe penalty: HUGELIER
journal, October 2016

  • Hugelier, S.; Eilers, P. H. C.; Devos, O.
  • Journal of Chemometrics, Vol. 31, Issue 4
  • DOI: 10.1002/cem.2847

Short coherence digital holography for 3D microscopy
journal, January 2001


Sparse deconvolution of high-density super-resolution images
journal, February 2016

  • Hugelier, Siewert; de Rooi, Johan J.; Bernex, Romain
  • Scientific Reports, Vol. 6, Issue 1
  • DOI: 10.1038/srep21413

Lensless wide-field fluorescent imaging on a chip using compressive decoding of sparse objects
journal, January 2010

  • Coskun, Ahmet F.; Sencan, Ikbal; Su, Ting-Wei
  • Optics Express, Vol. 18, Issue 10
  • DOI: 10.1364/OE.18.010510

Understanding diffractive optic design in the scalar domain
journal, January 1995


Structured illumination microscopy for dual-modality 3D sub-diffraction resolution fluorescence and refractive-index reconstruction
journal, January 2017

  • Chowdhury, Shwetadwip; Eldridge, Will J.; Wax, Adam
  • Biomedical Optics Express, Vol. 8, Issue 12
  • DOI: 10.1364/BOE.8.005776

Simultaneous multiplane imaging with a distorted diffraction grating
journal, January 1999

  • Blanchard, Paul M.; Greenaway, Alan H.
  • Applied Optics, Vol. 38, Issue 32
  • DOI: 10.1364/AO.38.006692

Richardson–Lucy algorithm with total variation regularization for 3D confocal microscope deconvolution
journal, January 2006

  • Dey, Nicolas; Blanc-Feraud, Laure; Zimmer, Christophe
  • Microscopy Research and Technique, Vol. 69, Issue 4
  • DOI: 10.1002/jemt.20294

Sparsity-based super-resolution microscopy from correlation information
journal, January 2018

  • Solomon, Oren; Mutzafi, Maor; Segev, Mordechai
  • Optics Express, Vol. 26, Issue 14
  • DOI: 10.1364/OE.26.018238

Fast multicolor 3D imaging using aberration-corrected multifocus microscopy
journal, December 2012

  • Abrahamsson, Sara; Chen, Jiji; Hajj, Bassam
  • Nature Methods, Vol. 10, Issue 1
  • DOI: 10.1038/nmeth.2277

Non-scanning motionless fluorescence three-dimensional holographic microscopy
journal, February 2008


3D intensity and phase imaging from light field measurements in an LED array microscope
journal, January 2015


3D differential phase-contrast microscopy with computational illumination using an LED array
journal, January 2014

  • Tian, Lei; Wang, Jingyan; Waller, Laura
  • Optics Letters, Vol. 39, Issue 5
  • DOI: 10.1364/OL.39.001326

DiffuserCam: lensless single-exposure 3D imaging
journal, December 2017


Three-dimensional holographic fluorescence microscopy
journal, January 1997

  • Schilling, Bradley W.; Poon, Ting-Chung; Indebetouw, Guy
  • Optics Letters, Vol. 22, Issue 19
  • DOI: 10.1364/OL.22.001506

Design and simulation of a snapshot multi-focal interferometric microscope
journal, January 2018


Digital spatially incoherent Fresnel holography
journal, January 2007


Wave optics theory and 3-D deconvolution for the light field microscope
journal, January 2013

  • Broxton, Michael; Grosenick, Logan; Yang, Samuel
  • Optics Express, Vol. 21, Issue 21
  • DOI: 10.1364/OE.21.025418

Sparsity-based single-shot subwavelength coherent diffractive imaging
journal, April 2012

  • Szameit, A.; Shechtman, Y.; Osherovich, E.
  • Nature Materials, Vol. 11, Issue 5
  • DOI: 10.1038/nmat3289

Multiplexed phase-space imaging for 3D fluorescence microscopy
journal, January 2017

  • Liu, Hsiou-Yuan; Zhong, Jingshan; Waller, Laura
  • Optics Express, Vol. 25, Issue 13
  • DOI: 10.1364/OE.25.014986

Compressive light-field microscopy for 3D neural activity recording
journal, January 2016


Single-frame 3D fluorescence microscopy with ultraminiature lensless FlatScope
journal, December 2017

  • Adams, Jesse K.; Boominathan, Vivek; Avants, Benjamin W.
  • Science Advances, Vol. 3, Issue 12
  • DOI: 10.1126/sciadv.1701548

Astigmatic multifocus microscopy enables deep 3D super-resolved imaging
journal, January 2016

  • Oudjedi, Laura; Fiche, Jean-Bernard; Abrahamsson, Sara
  • Biomedical Optics Express, Vol. 7, Issue 6
  • DOI: 10.1364/BOE.7.002163

Subsampled phase retrieval for temporal resolution enhancement in lensless on-chip holographic video
journal, January 2017

  • Ryu, Donghun; Wang, Zihao; He, Kuan
  • Biomedical Optics Express, Vol. 8, Issue 3
  • DOI: 10.1364/BOE.8.001981

Multifocus microscopy with precise color multi-phase diffractive optics applied in functional neuronal imaging
journal, January 2016

  • Abrahamsson, Sara; Ilic, Rob; Wisniewski, Jan
  • Biomedical Optics Express, Vol. 7, Issue 3
  • DOI: 10.1364/BOE.7.000855

Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy
journal, May 2014

  • Prevedel, Robert; Yoon, Young-Gyu; Hoffmann, Maximilian
  • Nature Methods, Vol. 11, Issue 7
  • DOI: 10.1038/nmeth.2964

Compressive holographic video
journal, January 2017

  • Wang, Zihao; Spinoulas, Leonidas; He, Kuan
  • Optics Express, Vol. 25, Issue 1
  • DOI: 10.1364/OE.25.000250

Works referencing / citing this record:

Advances in 3D single particle localization microscopy
journal, June 2019

  • Zhou, Yongzhuang; Handley, Michael; Carles, Guillem
  • APL Photonics, Vol. 4, Issue 6
  • DOI: 10.1063/1.5093310