Computational microscopy for fast widefield deep-tissue fluorescence imaging using a commercial dual-cannula probe

Mitra, Ekata; Guo, Ruipeng; Nelson, Soren; Nagarajan, Naveen; Menon, Rajesh

doi:10.1364/OPTCON.469219

Title: Computational microscopy for fast widefield deep-tissue fluorescence imaging using a commercial dual-cannula probe

Journal Article · Thu Sep 15 00:00:00 EDT 2022 · Optics Continuum

DOI:https://doi.org/10.1364/OPTCON.469219· OSTI ID:1887618

Mitra, Ekata; Guo, Ruipeng; Nelson, Soren; Nagarajan, Naveen;

A solid-glass cannula serves as a micro-endoscope that can deliver excitation light deep inside tissue while also collecting emitted fluorescence. Then, we utilize deep neural networks to reconstruct images from the collected intensity distributions. By using a commercially available dual-cannula probe, and training a separate deep neural network for each cannula, we effectively double the field of view compared to prior work. We demonstrated ex vivo imaging of fluorescent beads and brain slices and in vivo imaging from whole brains. We clearly resolved 4 µm beads, with FOV from each cannula of 0.2 mm (diameter), and produced images from a depth of ∼1.2 mm in the whole brain, currently limited primarily by the labeling. Since no scanning is required, fast widefield fluorescence imaging limited primarily by the brightness of the fluorophores, collection efficiency of our system, and the frame rate of the camera becomes possible.

View Journal Article

Cite

Export

Save

Research Organization:: Univ. of Utah, Salt Lake City, UT (United States)

Sponsoring Organization:: USDOE Office of Science (SC); National Institutes of Health (NIH)

Grant/Contract Number:: 55801063; SC0021996; 1R21EY030717-01

OSTI ID:: 1887618

Alternate ID(s):: OSTI ID: 1884321

Journal Information:: Optics Continuum, Journal Name: Optics Continuum Vol. 1 Journal Issue: 9; ISSN 2770-0208

Publisher:: Optical Society of AmericaCopyright Statement

Country of Publication:: United States

Language:: English

References (41)

High-resolution in vivo optical-sectioning widefield microendoscopy Zhang, Qinrong; Pan, Daisong; Ji, Na Optica, Vol. 7, Issue 10 https://doi.org/10.1364/OPTICA.397788	journal	September 2020
Super-resolution two-photon microscopy via scanning patterned illumination Urban, Ben E.; Yi, Ji; Chen, Siyu Physical Review E, Vol. 91, Issue 4 https://doi.org/10.1103/PhysRevE.91.042703	journal	April 2015
Needle-based deep-neural-network imaging method Guo, Ruipeng; Nelson, Soren; Mitra, Ekata OSA Imaging and Applied Optics Congress 2021 (3D, COSI, DH, ISA, pcAOP) https://doi.org/10.1364/ISA.2021.ITh5D.3	conference	January 2021
Utah optrode array customization using stereotactic brain atlases and 3-D CAD modeling for optogenetic neocortical interrogation in small rodents and nonhuman primates Boutte, Ronald W.; Merlin, Sam; Yona, Guy Neurophotonics, Vol. 4, Issue 4 https://doi.org/10.1117/1.NPh.4.4.041502	journal	July 2017
Toward implantable devices for angle-sensitive, lens-less, multifluorescent, single-photon lifetime imaging in the brain using Fabry–Perot and absorptive color filters Taal, Adriaan J.; Lee, Changhyuk; Choi, Jaebin Light: Science & Applications, Vol. 11, Issue 1 https://doi.org/10.1038/s41377-022-00708-9	journal	January 2022
Computational cannula microscopy of neurons using neural networks Guo, Ruipeng; Pan, Zhimeng; Taibi, Andrew Optics Letters, Vol. 45, Issue 7 https://doi.org/10.1364/OL.387496	journal	April 2020
Three-photon neuronal imaging in deep mouse brain Wang, Tianyu; Xu, Chris Optica, Vol. 7, Issue 8 https://doi.org/10.1364/OPTICA.395825	journal	August 2020
Model ensemble for an effective on-line reconstruction of missing data in sensor networks Alippi, Cesare; Ntalampiras, Stavros; Roveri, Manuel The 2013 International Joint Conference on Neural Networks (IJCNN) https://doi.org/10.1109/IJCNN.2013.6706761	conference	August 2013
In vivo three-photon imaging of activity of GCaMP6-labeled neurons deep in intact mouse brain Ouzounov, Dimitre G.; Wang, Tianyu; Wang, Mengran Nature Methods, Vol. 14, Issue 4 https://doi.org/10.1038/nmeth.4183	journal	February 2017
Bijective-constrained cycle-consistent deep learning for optics-free imaging and classification Nelson, Soren; Menon, Rajesh Optica, Vol. 9, Issue 1 https://doi.org/10.1364/OPTICA.440575	journal	January 2022
Leptin receptor-expressing pericytes mediate access of hypothalamic feeding centers to circulating leptin Butiaeva, Liliia I.; Slutzki, Tal; Swick, Hannah E. Cell Metabolism, Vol. 33, Issue 7 https://doi.org/10.1016/j.cmet.2021.05.017	journal	July 2021
Deep learning microscopy Rivenson, Yair; Göröcs, Zoltán; Günaydin, Harun Optica, Vol. 4, Issue 11 https://doi.org/10.1364/OPTICA.4.001437	journal	January 2017
Statistical mechanics of ensemble learning Krogh, Anders; Sollich, Peter Physical Review E, Vol. 55, Issue 1 https://doi.org/10.1103/PhysRevE.55.811	journal	January 1997
Tortuous Microvessels Contribute to Wound Healing via Sprouting Angiogenesis Chong, Diana C.; Yu, Zhixian; Brighton, Hailey E. Arteriosclerosis, Thrombosis, and Vascular Biology, Vol. 37, Issue 10 https://doi.org/10.1161/ATVBAHA.117.309993	journal	October 2017
Minimally invasive microendoscopy system for in vivo functional imaging of deep nuclei in the mouse brain Bocarsly, Miriam E.; Jiang, Wan-chen; Wang, Chen Biomedical Optics Express, Vol. 6, Issue 11 https://doi.org/10.1364/BOE.6.004546	journal	October 2015
In vivo two-photon fluorescence lifetime imaging microendoscopy based on fiber-bundle Lin, Fangrui; Zhang, Chenshuang; Zhao, Yihua Optics Letters, Vol. 47, Issue 9 https://doi.org/10.1364/OL.453102	journal	April 2022
Three-photon imaging of mouse brain structure and function through the intact skull Wang, Tianyu; Ouzounov, Dimitre G.; Wu, Chunyan Nature Methods, Vol. 15, Issue 10 https://doi.org/10.1038/s41592-018-0115-y	journal	September 2018
High-resolution intravital imaging of the murine hypothalamus using GRIN lenses and confocal microscopy Butiaeva, Liliia I.; Kokoeva, Maia V. STAR Protocols, Vol. 3, Issue 1 https://doi.org/10.1016/j.xpro.2022.101193	journal	March 2022
Image-to-Image Translation with Conditional Adversarial Networks Isola, Phillip; Zhu, Jun-Yan; Zhou, Tinghui 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2017.632	conference	July 2017
High-throughput synapse-resolving two-photon fluorescence microendoscopy for deep-brain volumetric imaging in vivo Meng, Guanghan; Liang, Yajie; Sarsfield, Sarah eLife, Vol. 8 https://doi.org/10.7554/eLife.40805	journal	January 2019
Scan-less machine-learning-enabled incoherent microscopy for minimally-invasive deep-brain imaging Guo, Ruipeng; Nelson, Soren; Regier, Matthew Optics Express, Vol. 30, Issue 2 https://doi.org/10.1364/OE.446241	journal	January 2022
Optics-Free Imaging Using A Self-Consistent Supervised Deep Neural Network Nelson, Soren; Menon, Rajesh OSA Optical Sensors and Sensing Congress 2021 (AIS, FTS, HISE, SENSORS, ES) https://doi.org/10.1364/AIS.2021.JTu5A.3	conference	January 2021
In vivo three-photon microscopy of subcortical structures within an intact mouse brain Horton, Nicholas G.; Wang, Ke; Kobat, Demirhan Nature Photonics, Vol. 7, Issue 3 https://doi.org/10.1038/nphoton.2012.336	journal	January 2013
Large-scale two-photon calcium imaging in freely moving mice Zong, Weijian; Obenhaus, Horst A.; Skytøen, Emilie R. Cell, Vol. 185, Issue 7 https://doi.org/10.1016/j.cell.2022.02.017	journal	March 2022
A High Dynamic Range 128 × 120 3-D Stacked CMOS SPAD Image Sensor SoC for Fluorescence Microendoscopy Erdogan, Ahmet T.; Al Abbas, Tarek; Finlayson, Neil IEEE Journal of Solid-State Circuits, Vol. 57, Issue 6 https://doi.org/10.1109/JSSC.2022.3150721	journal	June 2022
Cannula-based computational fluorescence microscopy Kim, Ganghun; Nagarajan, Naveen; Capecchi, Mario R. Applied Physics Letters, Vol. 106, Issue 26 https://doi.org/10.1063/1.4923402	journal	June 2015
Three-dimensional light-field microendoscopy with a GRIN lens array Urner, Tara M.; Inman, Andrew; Lapid, Benjamin Biomedical Optics Express, Vol. 13, Issue 2 https://doi.org/10.1364/BOE.447578	journal	January 2022
A flexible two-photon endoscope for fast functional imaging and cell-precise optogenetic photo-stimulation of neurons in freely moving animals Accanto, Nicolò; Blot, François; Zampini, Valeria Biomedical Spectroscopy, Microscopy, and Imaging II https://doi.org/10.1117/12.2624381	conference	May 2022
Two-Photon Fluorescence Microscopy and Applications in Angiogenesis and Related Molecular Events Lee, Marcus; Kannan, Sathya; Muniraj, Giridharan Tissue Engineering Part B: Reviews, Vol. 28, Issue 4 https://doi.org/10.1089/ten.teb.2021.0140	journal	August 2022
In Vivo Microendoscopy of the Hippocampus Barretto, Robert P. J.; Schnitzer, Mark J. Cold Spring Harbor Protocols, Vol. 2012, Issue 10 https://doi.org/10.1101/pdb.prot071472	journal	October 2012
Numerical analysis of computational-cannula microscopy Kim, Ganghun; Menon, Rajesh Applied Optics, Vol. 56, Issue 9 https://doi.org/10.1364/AO.56.0000D1	journal	January 2017
The Role of Three-Dimensional Endoscopy in Pituitary Adenoma Surgery Vasudevan, Kumar; Saad, Hassan; Oyesiku, Nelson M. Neurosurgery Clinics of North America, Vol. 30, Issue 4 https://doi.org/10.1016/j.nec.2019.05.012	journal	October 2019
Non-invasive imaging through opaque scattering layers Bertolotti, Jacopo; van Putten, Elbert G.; Blum, Christian Nature, Vol. 491, Issue 7423 https://doi.org/10.1038/nature11578	journal	November 2012
3D computational cannula fluorescence microscopy enabled by artificial neural networks Guo, Ruipeng; Pan, Zhimeng; Taibi, Andrew Optics Express, Vol. 28, Issue 22 https://doi.org/10.1364/OE.403238	journal	October 2020
Needle-based deep-neural-network camera Guo, Ruipeng; Nelson, Soren; Menon, Rajesh Applied Optics, Vol. 60, Issue 10 https://doi.org/10.1364/AO.415059	journal	March 2021
Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations Katz, Ori; Heidmann, Pierre; Fink, Mathias Nature Photonics, Vol. 8, Issue 10 https://doi.org/10.1038/nphoton.2014.189	journal	August 2014
Deep-brain imaging via epi-fluorescence Computational Cannula Microscopy Kim, Ganghun; Nagarajan, Naveen; Pastuzyn, Elissa Scientific Reports, Vol. 7, Issue 1 https://doi.org/10.1038/srep44791	journal	March 2017
First intraoperative experience with three-dimensional (3D) high-definition (HD) nasal endoscopy for lacrimal surgeries Ali, Mohammad Javed; Naik, Milind N. European Archives of Oto-Rhino-Laryngology, Vol. 274, Issue 5 https://doi.org/10.1007/s00405-017-4466-2	journal	February 2017
Comparison of 3D endoscopy and conventional 2D endoscopy in gastric endoscopic submucosal dissection: an ex vivo animal study Nomura, Kosuke; Kikuchi, Daisuke; Kaise, Mitsuru Surgical Endoscopy, Vol. 33, Issue 12 https://doi.org/10.1007/s00464-019-06726-w	journal	March 2019
Singlet gradient index lens for deep in vivo multiphoton microscopy Murray, Teresa A.; Levene, Michael J. Journal of Biomedical Optics, Vol. 17, Issue 2 https://doi.org/10.1117/1.JBO.17.2.021106	journal	January 2012
Deep-tissue light delivery via optrode arrays Abaya, Tanya V. F.; Diwekar, Mohit; Blair, Steve Journal of Biomedical Optics, Vol. 19, Issue 1 https://doi.org/10.1117/1.JBO.19.1.015006	journal	January 2014

Similar Records

A widefield fluorescence microscope with a linear image sensor for image cytometry of biospecimens: Considerations for image quality optimization

Journal Article · Tue Sep 15 00:00:00 EDT 2015 · Review of Scientific Instruments · OSTI ID:1887618

Hutcheson, Joshua A.; Majid, Aneeka A.; Powless, Amy J.

Fast widefield imaging of neuronal structure and function with optical sectioning in vivo

Journal Article · Fri May 08 00:00:00 EDT 2020 · Science Advances · OSTI ID:1887618

Li, Ziwei; Zhang, Qinrong; Chou, Shih-Wei; +6 more

PROSPECTS FOR THE DETECTION OF FAST RADIO BURSTS WITH THE MURCHISON WIDEFIELD ARRAY

Journal Article · Thu Oct 10 00:00:00 EDT 2013 · Astrophysical Journal Letters · OSTI ID:1887618

Trott, Cathryn M.; Tingay, Steven J.

Related Subjects

42 ENGINEERING

Title: Computational microscopy for fast widefield deep-tissue fluorescence imaging using a commercial dual-cannula probe

Citation Formats

References (41)

Similar Records

Related Subjects