skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Deep Learning in Label-free Cell Classification

Journal Article · · Scientific Reports
DOI:https://doi.org/10.1038/srep21471· OSTI ID:1310540

Label-free cell analysis is essential to personalized genomics, cancer diagnostics, and drug development as it avoids adverse effects of staining reagents on cellular viability and cell signaling. However, currently available label-free cell assays mostly rely only on a single feature and lack sufficient differentiation. Also, the sample size analyzed by these assays is limited due to their low throughput. Here, we integrate feature extraction and deep learning with high-throughput quantitative imaging enabled by photonic time stretch, achieving record high accuracy in label-free cell classification. Our system captures quantitative optical phase and intensity images and extracts multiple biophysical features of individual cells. These biophysical measurements form a hyperdimensional feature space in which supervised learning is performed for cell classification. We compare various learning algorithms including artificial neural network, support vector machine, logistic regression, and a novel deep learning pipeline, which adopts global optimization of receiver operating characteristics. As a validation of the enhanced sensitivity and specificity of our system, we show classification of white blood T-cells against colon cancer cells, as well as lipid accumulating algal strains for biofuel production. In conclusion, this system opens up a new path to data-driven phenotypic diagnosis and better understanding of the heterogeneous gene expressions in cells.

Research Organization:
Univ. of California, Los Angeles, CA (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
FC02-02ER63421
OSTI ID:
1310540
Journal Information:
Scientific Reports, Vol. 6; ISSN 2045-2322
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 216 works
Citation information provided by
Web of Science

References (64)

Deep learning journal May 2015
Chlamydomonas starchless mutant defective in ADP-glucose pyrophosphorylase hyper-accumulates triacylglycerol journal July 2010
CellProfiler: image analysis software for identifying and quantifying cell phenotypes journal October 2006
Labeling Human Mesenchymal Stem Cells with Fluorescent Contrast Agents: the Biological Impact journal April 2010
Using AUC and accuracy in evaluating learning algorithms journal March 2005
Deep Learning text January 2018
Hydrodynamic Focusing on a Silicon Chip: Mixing Nanoliters in Microseconds journal April 1998
High-throughput single-microparticle imaging flow analyzer journal July 2012
Optical phase recovery in the dispersive Fourier transform journal December 2009
Variability and memory of protein levels in human cells journal November 2006
Effect of focus on cell detection and recognition by the cell analyzer journal January 1990
Starchless Mutants of Chlamydomonas reinhardtii Lack the Small Subunit of a Heterotetrameric ADP-Glucose Pyrophosphorylase journal February 2001
Beyond counting tumor cells journal July 2012
Stochasticity in gene expression: from theories to phenotypes journal May 2005
Design of Warped Stretch Transform journal November 2015
Random forest-based prediction of stroke outcome journal May 2021
Coherent time-stretch transformation for real-time capture of wideband signals journal January 2013
Isolation by Size of Epithelial Tumor Cells journal January 2000
Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomena journal April 2009
Future possibilities for artificial intelligence in the practical management of hypertension journal July 2020
On the abundance of EpCAM on cancer stem cells journal January 2009
Increased Lipid Accumulation in the Chlamydomonas reinhardtii sta7-10 Starchless Isoamylase Mutant and Increased Carbohydrate Synthesis in Complemented Strains journal June 2010
Real time blood testing using quantitative phase imaging conference January 2013
Cellular Image Analysis and Imaging by Flow Cytometry journal September 2007
Dispersive Fourier transformation for fast continuous single-shot measurements journal January 2013
TAG, You’re it! Chlamydomonas as a reference organism for understanding algal triacylglycerol accumulation journal June 2012
Label-free high-throughput imaging flow cytometry conference March 2014
Hilbert phase microscopy for investigating fast dynamics in transparent systems journal January 2005
The hydrodynamic focusing effect inside rectangular microchannels journal April 2006
Neural network analysis of flow cytometric data for 40 marine phytoplankton species journal April 1994
Living with Noisy Genes: How Cells Function Reliably with Inherent Variability in Gene Expression journal June 2007
Non-genetic origins of cell-to-cell variability in TRAIL-induced apoptosis journal April 2009
The Path to Triacylglyceride Obesity in the sta6 Strain of Chlamydomonas reinhardtii journal February 2014
Seventeen-colour flow cytometry: unravelling the immune system journal August 2004
Hilbert transforms book January 2009
Deep Learning in Neural Networks: An Overview text January 2014
Adhesion of culture cells to their substratum journal March 1974
Refractometry of Living Cells journal April 1953
The meaning and use of the area under a receiver operating characteristic (ROC) curve. journal April 1982
Live Cell Interferometry Quantifies Dynamics of Biomass Partitioning during Cytokinesis journal December 2014
Optical Properties of Circulating Human Blood in the Wavelength Range 400–2500 nm journal January 1999
Mitochondrial Variability as a Source of Extrinsic Cellular Noise journal March 2012
Optically amplified detection for biomedical sensing and imaging journal January 2013
Variability and Robustness in T Cell Activation from Regulated Heterogeneity in Protein Levels journal August 2008
Automated image analysis of nuclear shape: What can we learn from a prematurely aged cell? journal February 2012
High content screening: seeing is believing journal May 2010
Ultrafast Three-Dimensional Surface Imaging Based on Short-Time Fourier Transform journal November 2015
Systems-Level Analysis of Nitrogen Starvation-Induced Modifications of Carbon Metabolism in a Chlamydomonas reinhardtii Starchless Mutant journal November 2013
ROC-Based Utility Function Maximization for Feature Selection and Classification with Applications to High-Dimensional Protease Data journal March 2008
28 MHz swept source at 10 μm for ultrafast quantitative phase imaging journal January 2015
Highly Efficient Circulating Tumor Cell Isolation from Whole Blood and Label-Free Enumeration Using Polymer-Based Microfluidics with an Integrated Conductivity Sensor journal July 2008
Isolation of rare circulating tumour cells in cancer patients by microchip technology journal December 2007
Coherent Time-Stretch Transform for Near-Field Spectroscopy journal April 2014
Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software journal February 2011
Optical Data Compression in Time Stretch Imaging journal April 2015
The use of the area under the ROC curve in the evaluation of machine learning algorithms journal July 1997
Real Time Blood Testing Using Quantitative Phase Imaging journal February 2013
Label-free cell separation and sorting in microfluidic systems journal April 2010
Theory of amplified dispersive Fourier transformation journal October 2009
Deep learning in neural networks: An overview journal January 2015
Hilbert transforms journal January 2009
Substrate retention of fractured retraction fibres during detachment of trypsinized BHK21 fibroblasts journal April 1977
Tailoring Wideband Signals With a Photonic Hardware Accelerator journal July 2015
Label-free high-throughput cell screening in flow journal January 2013

Cited By (92)

Rogue waves and analogies in optics and oceanography journal September 2019
Classifying T cell activity in autofluorescence intensity images with convolutional neural networks journal December 2019
Comparison and optimization of machine learning methods for automated classification of circulating tumor cells: Automated Circulating Tumor Cell Image Classifiers journal October 2016
Quadriwave lateral shearing interferometric microscopy with wideband sensitivity enhancement for quantitative phase imaging in real time journal January 2017
Combining high-throughput imaging flow cytometry and deep learning for efficient species and life-cycle stage identification of phytoplankton journal December 2018
Reconstructing cell cycle and disease progression using deep learning journal September 2017
Quantitative assessment of cancer cell morphology and motility using telecentric digital holographic microscopy and machine learning: Holography of Cancer Cell Motile Phenotypes journal December 2017
Identification of non-activated lymphocytes using three-dimensional refractive index tomography and machine learning journal July 2017
Performance of convolutional neural networks for identification of bacteria in 3D microscopy datasets journal December 2018
Sensitivity and specificity evaluation of multiple neurodegenerative proteins for Creutzfeldt-Jakob disease diagnosis using a deep-learning approach text January 2019
Time stretch and its applications journal June 2017
High accuracy detection for T-cells and B-cells using deep convolutional neural networks journal December 2018
High-throughput imaging flow cytometry by optofluidic time-stretch microscopy journal July 2018
Automated assessment of breast cancer margin in optical coherence tomography images via pretrained convolutional neural network journal November 2018
Label-free biomarkers of human embryonic stem cell differentiation to hepatocytes: Label-Free Biomarkers journal May 2016
Sensitivity and specificity evaluation of multiple neurodegenerative proteins for Creutzfeldt-Jakob disease diagnosis using a deep-learning approach text January 2019
Applications of Deep-Learning in Exploiting Large-Scale and Heterogeneous Compound Data in Industrial Pharmaceutical Research journal November 2019
Deep learning in bioinformatics journal July 2016
Cervical cell recognition based on AGVF-Snake algorithm journal April 2019
Graphene-Based Materials for Biosensors: A Review journal September 2017
PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning journal February 2019
Label-free imaging flow cytometer for analyzing large cell populations by line-field quantitative phase microscopy with digital refocusing journal January 2020
Deep Cytometry: Deep learning with Real-time Inference in Cell Sorting and Flow Cytometry text January 2019
Deep-Learning-Based Label-Free Segmentation of Cell Nuclei in Time-Lapse Refractive Index Tomograms journal January 2019
Development of full-field optical spatial coherence tomography system for automated identification of malaria using the multilevel ensemble classifier journal February 2018
A Transfer Learning Approach for Microstructure Reconstruction and Structure-property Predictions journal September 2018
Quantitative scoring of epithelial and mesenchymal qualities of cancer cells using machine learning and quantitative phase imaging journal February 2020
Antimicrobial peptide identification using multi-scale convolutional network journal December 2019
Leveraging uncertainty information from deep neural networks for disease detection journal December 2017
Artificial intelligence for microscopy: what you should know journal July 2019
A novel machine learning based approach for iPS progenitor cell identification posted_content August 2019
Plasmonic nanostructure design and characterization via Deep Learning journal September 2018
Quantitative Phase Imaging for Label-Free Analysis of Cancer Cells—Focus on Digital Holographic Microscopy journal June 2018
Automatic white blood cell classification using pre-trained deep learning models: ResNet and Inception conference April 2018
Tera-sample-per-second single-shot device analyzer journal January 2019
Immune cell type, cell activation, and single cell heterogeneity revealed by label-free optical methods journal November 2019
Fibre-optic based particle sensing via deep learning journal September 2019
Artificial Intelligence for Microscopy: What You Should Know posted_content February 2019
Artificial Intelligence for Microscopy: What You Should Know posted_content February 2019
A transparent cancer classifier journal December 2018
High-throughput, label-free, single-cell, microalgal lipid screening by machine-learning-equipped optofluidic time-stretch quantitative phase microscopy: Characterization of Heterogeneous Populations of E. gracilis journal April 2017
Physics-Based Feature Engineering book May 2019
Classifying optical microscope images of exfoliated graphene flakes by data-driven machine learning journal January 2019
Portable Multiplex Optical Assays journal December 2018
Optofluidic time-stretch imaging – an emerging tool for high-throughput imaging flow cytometry journal January 2016
Real-time Image Processing for Microscopy-based Label-free Imaging Flow Cytometry in a Microfluidic Chip journal September 2017
Predicting cancer cell invasion by single-cell physical phenotyping journal March 2018
Quantitative Phase Imaging Flow Cytometry for Ultra‐Large‐Scale Single‐Cell Biophysical Phenotyping journal April 2019
Machine Learning Based Real‐Time Image‐Guided Cell Sorting and Classification journal April 2019
The Next Era: Deep Learning in Pharmaceutical Research journal September 2016
Intelligent control of mode-locked femtosecond pulses by time-stretch-assisted real-time spectral analysis journal January 2020
Cell migration in microengineered tumor environments journal January 2017
A neural lens for super-resolution biological imaging journal June 2019
Microplastic Identification via Holographic Imaging and Machine Learning journal January 2020
Noninvasive detection of macrophage activation with single-cell resolution through machine learning journal March 2018
Machine learning analysis of extreme events in optical fibre modulation instability journal November 2018
Using Flow Cytometry and Multistage Machine Learning to Discover Label-Free Signatures of Algal Lipid Accumulation posted_content June 2019
Cell dynamic morphology classification using deep convolutional neural networks: Cell Dynamic Morphology journal May 2018
Machine Learning with Optical Phase Signatures for Phenotypic Profiling of Cell Lines journal April 2019
Optical inspection of nanoscale structures using a novel machine learning based synthetic image generation algorithm journal January 2019
Sensitivity and specificity evaluation of multiple neurodegenerative proteins for Creutzfeldt-Jakob disease diagnosis using a deep-learning approach journal January 2019
A novel machine learning based approach for iPS progenitor cell identification journal December 2019
Time-stretch LiDAR as a spectrally scanned time-of-flight ranging camera journal December 2019
PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning text January 2018
Direct Observation of Spatiotemporal Dynamics of Short Electron Bunches in Storage Rings journal February 2017
Holographic deep learning for rapid optical screening of anthrax spores journal August 2017
Deep Cytometry: Deep learning with Real-time Inference in Cell Sorting and Flow Cytometry journal July 2019
Intelligent frequency-shifted optofluidic time-stretch quantitative phase imaging journal January 2020
Automatic label‐free detection of breast cancer using nonlinear multimodal imaging and the convolutional neural network ResNet50 journal December 2019
Applications of Deep-Learning in Exploiting Large-Scale and Heterogeneous Compound Data in Industrial Pharmaceutical Research text January 2019
Deep learning of diffraction image patterns for accurate classification of five cell types journal December 2019
Learning from droplet flows in microfluidic channels using deep neural networks text January 2019
In vitro monitoring of photoinduced necrosis in HeLa cells using digital holographic microscopy and machine learning journal January 2020
Learning from droplet flows in microfluidic channels using deep neural networks journal May 2019
A Transfer Learning Approach for Microstructure Reconstruction and Structure-property Predictions preprint January 2018
Quantitative imaging of lipid droplets in single cells journal January 2019
Intelligent whole-blood imaging flow cytometry for simple, rapid, and cost-effective drug-susceptibility testing of leukemia journal January 2019
Applications of Deep-Learning in Exploiting Large-Scale and Heterogeneous Compound Data in Industrial Pharmaceutical Research text January 2019
Label-free classification of cells based on supervised machine learning of subcellular structures journal January 2019
Using flow cytometry and multistage machine learning to discover label-free signatures of algal lipid accumulation journal July 2019
Net-FLICS: fast quantitative wide-field fluorescence lifetime imaging with compressed sensing – a deep learning approach journal March 2019
Matrix Analysis of Warped Stretch Imaging journal September 2017
Label-free detection of cellular drug responses by high-throughput bright-field imaging and machine learning journal September 2017
A Machine Learning Assisted, Label-free, Non-invasive Approach for Somatic Reprogramming in Induced Pluripotent Stem Cell Colony Formation Detection and Prediction journal October 2017
Machine Learning for Nuclear Mechano-Morphometric Biomarkers in Cancer Diagnosis journal December 2017
All-passive pixel super-resolution of time-stretch imaging journal March 2017
Computational Analysis of Cell Dynamics in Videos with Hierarchical-Pooled Deep-Convolutional Features journal August 2018
Assessing microscope image focus quality with deep learning journal March 2018
Context-Aware Image Compression journal July 2016
The Temporal Gearbox preprint January 2016
Time Stretch Inspired Computational Imaging preprint January 2017
ParasNet: Fast Parasites Detection with Neural Networks preprint January 2020

Similar Records

SU-E-J-107: Supervised Learning Model of Aligned Collagen for Human Breast Carcinoma Prognosis
Journal Article · Sun Jun 01 00:00:00 EDT 2014 · Medical Physics · OSTI ID:1310540

Protein subcellular location pattern classification in cellular images using latent discriminative models
Journal Article · Mon Jun 11 00:00:00 EDT 2012 · Bioinformatics · OSTI ID:1310540

Deep learning classification of lipid droplets in quantitative phase images
Journal Article · Mon Apr 05 00:00:00 EDT 2021 · PLoS ONE · OSTI ID:1310540

Related Subjects