skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Deep learning classification of lipid droplets in quantitative phase images

Journal Article · · PLoS ONE

We report the application of supervised machine learning to the automated classification of lipid droplets in label-free, quantitative-phase images. By comparing various machine learning methods commonly used in biomedical imaging and remote sensing, we found convolutional neural networks to outperform others, both quantitatively and qualitatively. We describe our imaging approach, all implemented machine learning methods, and their performance with respect to computational efficiency, required training resources, and relative method performance measured across multiple metrics. Overall, our results indicate that quantitative-phase imaging coupled to machine learning enables accurate lipid droplet classification in single living cells. As such, the present paradigm presents an excellent alternative of the more common fluorescent and Raman imaging modalities by enabling label-free, ultra-low phototoxicity, and deeper insight into the thermodynamics of metabolism of single cells.

Research Organization:
Univ. of Idaho, Moscow, ID (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER)
Grant/Contract Number:
SC0019249
OSTI ID:
1773959
Alternate ID(s):
OSTI ID: 1773779
Journal Information:
PLoS ONE, Journal Name: PLoS ONE Vol. 16 Journal Issue: 4; ISSN 1932-6203
Publisher:
Public Library of Science (PLoS)Copyright Statement
Country of Publication:
United States
Language:
English

References (110)

Very High Resolution Object-Based Land Use–Land Cover Urban Classification Using Extreme Gradient Boosting journal April 2018
High-fidelity optical diffraction tomography of multiple scattering samples journal September 2019
Machine learning-based screening of red blood cells using quantitative phase imaging with micro-spectrocolorimetry journal April 2020
3D structure tensor analysis of light microscopy data for validating diffusion MRI journal May 2015
Dengue Virus Capsid Protein Usurps Lipid Droplets for Viral Particle Formation journal October 2009
Live-cell mass profiling: an emerging approach in quantitative biophysics journal November 2014
The use of receiver operating characteristic curves in biomedical informatics journal October 2005
A survey of the recent architectures of deep convolutional neural networks journal April 2020
Permutation importance: a corrected feature importance measure journal April 2010
Quantitative Phase Imaging Flow Cytometry for Ultra‐Large‐Scale Single‐Cell Biophysical Phenotyping journal April 2019
Multilayer perceptrons for classification and regression journal July 1991
Functional genomics of lipid metabolism in the oleaginous yeast Rhodosporidium toruloides journal March 2018
A lipid-based model for the creation of an escape hatch from the endoplasmic reticulum journal July 2007
Triacylglycerol Synthesis Enzymes Mediate Lipid Droplet Growth by Relocalizing from the ER to Lipid Droplets journal February 2013
Biological imaging of chemical bonds by stimulated Raman scattering microscopy journal August 2019
Predicting tree species presence and basal area in Utah: A comparison of stochastic gradient boosting, generalized additive models, and tree-based methods journal November 2006
Similarity measures in scientometric research: The Jaccard index versus Salton's cosine formula journal January 1989
Stacking-based ensemble learning of decision trees for interpretable prostate cancer detection journal April 2019
Random forest regression for magnetic resonance image synthesis journal January 2017
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review journal September 2017
Receiver Operating Characteristic (ROC) Curve: Practical Review for Radiologists journal January 2004
Random forest classifier for remote sensing classification journal January 2005
Lipid droplets: a unified view of a dynamic organelle journal March 2006
machine. journal October 2001
Deep Learning With TensorFlow: A Review journal September 2019
Lipid droplets and liver disease: from basic biology to clinical implications journal April 2017
What is a support vector machine? journal December 2006
Transfer Learning with Deep Convolutional Neural Networks for Classifying Cellular Morphological Changes journal January 2019
Tomographic phase microscopy journal August 2007
Deep learning in holography and coherent imaging journal September 2019
Quantitative Phase Imaging and Artificial Intelligence: A Review journal January 2019
Estimation of feature importance for food intake detection based on Random Forests classification conference July 2013
Three-dimensional structure determination of semi-transparent objects from holographic data journal September 1969
The Balanced Accuracy and Its Posterior Distribution conference August 2010
Interference Microscopy and Mass Determination journal March 1952
Lipid droplets: platforms with multiple functions in cancer hallmarks journal February 2020
Learning to synthesize: robust phase retrieval at low photon counts journal March 2020
Linear Discriminant Analysis book November 2012
Quantitative phase-contrast imaging-A potential tool for future cancer diagnostics: Quantitative Phase-Contrast Imaging journal April 2017
Material classification and semantic segmentation of railway track images with deep convolutional neural networks conference September 2015
PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning journal February 2019
Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection journal December 2017
UAV Remote Sensing for Urban Vegetation Mapping Using Random Forest and Texture Analysis journal January 2015
Automated epileptic seizure detection using improved correlation-based feature selection with random forest classifier journal June 2017
Origins of Cell-to-Cell Bioprocessing Diversity and Implications of the Extracellular Environment Revealed at the Single-Cell Level journal December 2015
A classification algorithm with Linear Discriminant Analysis and Axiomatic Fuzzy Sets journal January 2019
Gradient-based learning applied to document recognition journal January 1998
Feature selection based on artificial bee colony and gradient boosting decision tree journal January 2019
Lipid Droplets Control the Maternal Histone Supply of Drosophila Embryos journal November 2012
Label-free non-invasive quantitative measurement of lipid contents in individual microalgal cells using refractive index tomography journal April 2018
Automated classification of neonatal amplitude-integrated EEG based on gradient boosting method journal July 2016
Random Forests for land cover classification journal March 2006
Biodiesel from algae: challenges and prospects journal June 2010
Fat-specific protein 27 modulates nuclear factor of activated T cells 5 and the cellular response to stress journal December 2012
Using and understanding cross-validation strategies. Perspectives on Saeb et al. journal March 2017
Hyperspectral Image Classification with Convolutional Neural Networks
  • Slavkovikj, Viktor; Verstockt, Steven; De Neve, Wesley
  • MM '15: ACM Multimedia Conference, Proceedings of the 23rd ACM international conference on Multimedia https://doi.org/10.1145/2733373.2806306
conference October 2015
Vibrational imaging of lipid droplets in live fibroblast cells with coherent anti-Stokes Raman scattering microscopy journal August 2003
Microscopy tools for the investigation of intracellular lipid storage and dynamics journal March 2016
Stochastic gradient boosting journal February 2002
Image segmentation and discriminant analysis for the identification of land cover units in ecology journal January 1997
Lipid droplets, lipophagy, and beyond journal August 2016
Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position journal April 1980
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation journal December 2017
Nile red: a selective fluorescent stain for intracellular lipid droplets journal March 1985
XGBoost: A Scalable Tree Boosting System conference January 2016
Random forest in remote sensing: A review of applications and future directions journal April 2016
Emerging Roles for Lipid Droplets in Immunity and Host-Pathogen Interactions journal November 2012
Learning approach to optical tomography journal January 2015
Lipid droplet autophagy during energy mobilization lipid homeostasis and protein quality control journal January 2018
The lipid droplet is an important organelle for hepatitis C virus production journal August 2007
Engineering the push and pull of lipid biosynthesis in oleaginous yeast Yarrowia lipolytica for biofuel production journal January 2013
The Lipid-Droplet Proteome Reveals that Droplets Are a Protein-Storage Depot journal September 2006
Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] journal September 2009
A critical investigation of recall and precision as measures of retrieval system performance journal July 1989
ilastik: interactive machine learning for (bio)image analysis journal September 2019
Stable Isotope-Labeled Raman Imaging Reveals Dynamic Proteome Localization to Lipid Droplets in Single Fission Yeast Cells journal November 2012
Learning-based screening of hematologic disorders using quantitative phase imaging of individual red blood cells journal January 2019
Cell-to-Cell Heterogeneity in Lipid Droplets Suggests a Mechanism to Reduce Lipotoxicity journal August 2013
Color image segmentation using pixel wise support vector machine classification journal April 2011
The biophysics and cell biology of lipid droplets journal November 2013
Eliciting the impacts of cellular noise on metabolic trade-offs by quantitative mass imaging journal February 2019
Receiver Operating Characteristic Curves and Their Use in Radiology journal October 2003
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
Efficient and accurate inversion of multiple scattering with deep learning journal January 2018
Time Complexity Analysis of Support Vector Machines (SVM) in LibSVM journal October 2015
Expanding Roles for Lipid Droplets journal June 2015
Convolutional Neural Networks for Document Image Classification conference August 2014
Application of multi-layer perceptron neural networks to vision problems journal September 1998
A review of semantic segmentation using deep neural networks journal November 2017
Tomographic phase microscopy: principles and applications in bioimaging [Invited] journal January 2017
Random Forest Based Classification of Medical X-Ray Images Using a Genetic Algorithm for Feature Selection journal April 2015
Measures of the Amount of Ecologic Association Between Species journal July 1945
Design of an image edge detection filter using the Sobel operator journal April 1988
The life cycle of lipid droplets journal April 2015
Jaccard index based similarity measure to compare transcription factor binding site models journal January 2013
Challenges in Engineering Microbes for Biofuels Production journal February 2007
Attitudes on Autonomous Vehicle Adoption using Interpretable Gradient Boosting Machine journal June 2019
Quantitative phase imaging in biomedicine journal September 2018
Label-free colorectal cancer screening using deep learning and spatial light interference microscopy (SLIM) journal April 2020
Biodiesel fuel production by transesterification of oils journal January 2001
Feature selection for ranking using boosted trees conference January 2009
A boosting approach for prostate cancer detection using multi-parametric MRI
  • Lemaitre, Guillaume; Massich, Joan; Martí, Robert
  • The International Conference on Quality Control by Artificial Vision 2015, SPIE Proceedings https://doi.org/10.1117/12.2182772
conference April 2015
Lipid droplet hijacking by intracellular pathogens: Lipid droplet hijacking by intracellular pathogens journal November 2016
Random Forests journal January 2001
Quantitative phase imaging for medical diagnosis journal August 2016
Robust microbial cell segmentation by optical-phase thresholding with minimal processing requirements: Robust Microbial Cell Segmentation journal March 2017
Harnessing Yarrowia lipolytica lipogenesis to create a platform for lipid and biofuel production journal January 2014
Control of Lipid Accumulation in the Yeast Yarrowia lipolytica journal October 2008
Halo-free Phase Contrast Microscopy journal March 2017
Image segmentation evaluation: a survey of methods journal April 2020