skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ

Journal Article · · Optica

Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance ( > <#comment/> 8 d B ) denoising in less time than other fluorescence microscopy denoising methods.

Research Organization:
Univ. of Notre Dame, IN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER)
Grant/Contract Number:
0019312; SC0019312
OSTI ID:
1880378
Alternate ID(s):
OSTI ID: 1856215
Journal Information:
Optica, Journal Name: Optica Vol. 9 Journal Issue: 4; ISSN 2334-2536
Publisher:
Optical Society of AmericaCopyright Statement
Country of Publication:
United States
Language:
English

References (28)

A comparison of image restoration approaches applied to three-dimensional confocal and wide-field fluorescence microscopy journal January 1999
Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data journal October 2008
Fluorescence microscopy journal November 2005
Potential dependent spectroelectrochemistry of electrofluorogenic dyes on indium‐tin oxide journal July 2021
Minimization of fixed pattern noise in photon event counting imaging journal August 2002
Fast and accurate sCMOS noise correction for fluorescence microscopy journal January 2020
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation journal November 2006
Machine learning for faster and smarter fluorescence lifetime imaging microscopy journal September 2020
Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering journal August 2007
Cell Division Resets Polarity and Motility for the Bacterium Myxococcus xanthus journal November 2014
Patch-Based Nonlocal Functional for Denoising Fluorescence Microscopy Image Sequences journal February 2010
Optimal Inversion of the Generalized Anscombe Transformation for Poisson-Gaussian Noise journal January 2013
Probabilistic Noise2Void: Unsupervised Content-Aware Denoising journal February 2020
Democratising deep learning for microscopy with ZeroCostDL4Mic journal April 2021
Image Quality Assessment: From Error Visibility to Structural Similarity journal April 2004
Content-aware image restoration: pushing the limits of fluorescence microscopy journal November 2018
Three-dimensional residual channel attention networks denoise and sharpen fluorescence microscopy image volumes journal May 2021
The ImageJ ecosystem: An open platform for biomedical image analysis: T journal July 2015
Fluorescence microscopy datasets for training deep neural networks journal May 2021
Investigation of signal-to-noise ratio in frequency-domain multiphoton fluorescence lifetime imaging microscopy journal January 2016
Deep learning enables cross-modality super-resolution in fluorescence microscopy journal December 2018
Deep learning massively accelerates super-resolution localization microscopy journal April 2018
Instant super-resolution imaging in live cells and embryos via analog image processing journal October 2013
Poisson Noise Reduction with Non-local PCA journal April 2013
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising journal July 2017
Image Denoising in Mixed Poisson–Gaussian Noise journal March 2011
DeepImageJ: A user-friendly environment to run deep learning models in ImageJ journal September 2021
Two-photon laser scanning fluorescence microscopy journal April 1990