skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Deep Learning in Label-free Cell Classification

Abstract

Label-free cell analysis is essential to personalized genomics, cancer diagnostics, and drug development as it avoids adverse effects of staining reagents on cellular viability and cell signaling. However, currently available label-free cell assays mostly rely only on a single feature and lack sufficient differentiation. Also, the sample size analyzed by these assays is limited due to their low throughput. Here, we integrate feature extraction and deep learning with high-throughput quantitative imaging enabled by photonic time stretch, achieving record high accuracy in label-free cell classification. Our system captures quantitative optical phase and intensity images and extracts multiple biophysical features of individual cells. These biophysical measurements form a hyperdimensional feature space in which supervised learning is performed for cell classification. We compare various learning algorithms including artificial neural network, support vector machine, logistic regression, and a novel deep learning pipeline, which adopts global optimization of receiver operating characteristics. As a validation of the enhanced sensitivity and specificity of our system, we show classification of white blood T-cells against colon cancer cells, as well as lipid accumulating algal strains for biofuel production. In conclusion, this system opens up a new path to data-driven phenotypic diagnosis and better understanding of the heterogeneous gene expressionsmore » in cells.« less

Authors:
; ; ; ; ; ;
Publication Date:
Research Org.:
Univ. of California, Los Angeles, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1310540
Grant/Contract Number:  
FC02-02ER63421
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Scientific Reports
Additional Journal Information:
Journal Volume: 6; Journal ID: ISSN 2045-2322
Publisher:
Nature Publishing Group
Country of Publication:
United States
Language:
English
Subject:
60 APPLIED LIFE SCIENCES

Citation Formats

Chen, Claire Lifan, Mahjoubfar, Ata, Tai, Li-Chia, Blaby, Ian K., Huang, Allen, Niazi, Kayvan Reza, and Jalali, Bahram. Deep Learning in Label-free Cell Classification. United States: N. p., 2016. Web. doi:10.1038/srep21471.
Chen, Claire Lifan, Mahjoubfar, Ata, Tai, Li-Chia, Blaby, Ian K., Huang, Allen, Niazi, Kayvan Reza, & Jalali, Bahram. Deep Learning in Label-free Cell Classification. United States. https://doi.org/10.1038/srep21471
Chen, Claire Lifan, Mahjoubfar, Ata, Tai, Li-Chia, Blaby, Ian K., Huang, Allen, Niazi, Kayvan Reza, and Jalali, Bahram. 2016. "Deep Learning in Label-free Cell Classification". United States. https://doi.org/10.1038/srep21471. https://www.osti.gov/servlets/purl/1310540.
@article{osti_1310540,
title = {Deep Learning in Label-free Cell Classification},
author = {Chen, Claire Lifan and Mahjoubfar, Ata and Tai, Li-Chia and Blaby, Ian K. and Huang, Allen and Niazi, Kayvan Reza and Jalali, Bahram},
abstractNote = {Label-free cell analysis is essential to personalized genomics, cancer diagnostics, and drug development as it avoids adverse effects of staining reagents on cellular viability and cell signaling. However, currently available label-free cell assays mostly rely only on a single feature and lack sufficient differentiation. Also, the sample size analyzed by these assays is limited due to their low throughput. Here, we integrate feature extraction and deep learning with high-throughput quantitative imaging enabled by photonic time stretch, achieving record high accuracy in label-free cell classification. Our system captures quantitative optical phase and intensity images and extracts multiple biophysical features of individual cells. These biophysical measurements form a hyperdimensional feature space in which supervised learning is performed for cell classification. We compare various learning algorithms including artificial neural network, support vector machine, logistic regression, and a novel deep learning pipeline, which adopts global optimization of receiver operating characteristics. As a validation of the enhanced sensitivity and specificity of our system, we show classification of white blood T-cells against colon cancer cells, as well as lipid accumulating algal strains for biofuel production. In conclusion, this system opens up a new path to data-driven phenotypic diagnosis and better understanding of the heterogeneous gene expressions in cells.},
doi = {10.1038/srep21471},
url = {https://www.osti.gov/biblio/1310540}, journal = {Scientific Reports},
issn = {2045-2322},
number = ,
volume = 6,
place = {United States},
year = {Tue Mar 15 00:00:00 EDT 2016},
month = {Tue Mar 15 00:00:00 EDT 2016}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 216 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Deep learning
journal, May 2015


Chlamydomonas starchless mutant defective in ADP-glucose pyrophosphorylase hyper-accumulates triacylglycerol
journal, July 2010


Labeling Human Mesenchymal Stem Cells with Fluorescent Contrast Agents: the Biological Impact
journal, April 2010


Using AUC and accuracy in evaluating learning algorithms
journal, March 2005


Deep Learning
text, January 2018


Hydrodynamic Focusing on a Silicon Chip: Mixing Nanoliters in Microseconds
journal, April 1998


High-throughput single-microparticle imaging flow analyzer
journal, July 2012


Optical phase recovery in the dispersive Fourier transform
journal, December 2009


Variability and memory of protein levels in human cells
journal, November 2006


Effect of focus on cell detection and recognition by the cell analyzer
journal, January 1990


Starchless Mutants of Chlamydomonas reinhardtii Lack the Small Subunit of a Heterotetrameric ADP-Glucose Pyrophosphorylase
journal, February 2001


Beyond counting tumor cells
journal, July 2012


Stochasticity in gene expression: from theories to phenotypes
journal, May 2005


Design of Warped Stretch Transform
journal, November 2015


Random forest-based prediction of stroke outcome
journal, May 2021


Coherent time-stretch transformation for real-time capture of wideband signals
journal, January 2013


Isolation by Size of Epithelial Tumor Cells
journal, January 2000


Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomena
journal, April 2009


Future possibilities for artificial intelligence in the practical management of hypertension
journal, July 2020


On the abundance of EpCAM on cancer stem cells
journal, January 2009


Real time blood testing using quantitative phase imaging
conference, January 2013


Cellular Image Analysis and Imaging by Flow Cytometry
journal, September 2007


Dispersive Fourier transformation for fast continuous single-shot measurements
journal, January 2013


TAG, You’re it! Chlamydomonas as a reference organism for understanding algal triacylglycerol accumulation
journal, June 2012


Label-free high-throughput imaging flow cytometry
conference, March 2014


Hilbert phase microscopy for investigating fast dynamics in transparent systems
journal, January 2005


The hydrodynamic focusing effect inside rectangular microchannels
journal, April 2006


Neural network analysis of flow cytometric data for 40 marine phytoplankton species
journal, April 1994


Living with Noisy Genes: How Cells Function Reliably with Inherent Variability in Gene Expression
journal, June 2007


Non-genetic origins of cell-to-cell variability in TRAIL-induced apoptosis
journal, April 2009


The Path to Triacylglyceride Obesity in the sta6 Strain of Chlamydomonas reinhardtii
journal, February 2014


Seventeen-colour flow cytometry: unravelling the immune system
journal, August 2004


Hilbert transforms
book, January 2009


Adhesion of culture cells to their substratum
journal, March 1974


Refractometry of Living Cells
journal, April 1953


Live Cell Interferometry Quantifies Dynamics of Biomass Partitioning during Cytokinesis
journal, December 2014


Optical Properties of Circulating Human Blood in the Wavelength Range 400–2500 nm
journal, January 1999


Mitochondrial Variability as a Source of Extrinsic Cellular Noise
journal, March 2012


Optically amplified detection for biomedical sensing and imaging
journal, January 2013


Variability and Robustness in T Cell Activation from Regulated Heterogeneity in Protein Levels
journal, August 2008


Automated image analysis of nuclear shape: What can we learn from a prematurely aged cell?
journal, February 2012


High content screening: seeing is believing
journal, May 2010


Ultrafast Three-Dimensional Surface Imaging Based on Short-Time Fourier Transform
journal, November 2015


28 MHz swept source at 10 μm for ultrafast quantitative phase imaging
journal, January 2015


Highly Efficient Circulating Tumor Cell Isolation from Whole Blood and Label-Free Enumeration Using Polymer-Based Microfluidics with an Integrated Conductivity Sensor
journal, July 2008


Isolation of rare circulating tumour cells in cancer patients by microchip technology
journal, December 2007


Coherent Time-Stretch Transform for Near-Field Spectroscopy
journal, April 2014


Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software
journal, February 2011


Optical Data Compression in Time Stretch Imaging
journal, April 2015


The use of the area under the ROC curve in the evaluation of machine learning algorithms
journal, July 1997


Real Time Blood Testing Using Quantitative Phase Imaging
journal, February 2013


Label-free cell separation and sorting in microfluidic systems
journal, April 2010


Theory of amplified dispersive Fourier transformation
journal, October 2009


Deep learning in neural networks: An overview
journal, January 2015


Hilbert transforms
journal, January 2009


Substrate retention of fractured retraction fibres during detachment of trypsinized BHK21 fibroblasts
journal, April 1977


Effect of focus on cell detection and recognition by the cell analyzer
journal, January 1990


Neural network analysis of flow cytometric data for 40 marine phytoplankton species
journal, April 1994


Labeling Human Mesenchymal Stem Cells with Fluorescent Contrast Agents: the Biological Impact
journal, April 2010


Cellular Image Analysis and Imaging by Flow Cytometry
journal, September 2007


TAG, You’re it! Chlamydomonas as a reference organism for understanding algal triacylglycerol accumulation
journal, June 2012


High content screening: seeing is believing
journal, May 2010


Highly Efficient Circulating Tumor Cell Isolation from Whole Blood and Label-Free Enumeration Using Polymer-Based Microfluidics with an Integrated Conductivity Sensor
journal, July 2008


Refractometry of Living Cells
journal, April 1953


Isolation of rare circulating tumour cells in cancer patients by microchip technology
journal, December 2007


Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomena
journal, April 2009


Non-genetic origins of cell-to-cell variability in TRAIL-induced apoptosis
journal, April 2009


Deep learning
journal, May 2015


Design of Warped Stretch Transform
journal, November 2015


Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software
journal, February 2011


Tailoring Wideband Signals With a Photonic Hardware Accelerator
journal, July 2015


Optical Properties of Circulating Human Blood in the Wavelength Range 400–2500 nm
journal, January 1999


Variability and Robustness in T Cell Activation from Regulated Heterogeneity in Protein Levels
journal, August 2008


Living with Noisy Genes: How Cells Function Reliably with Inherent Variability in Gene Expression
journal, June 2007


Substrate retention of fractured retraction fibres during detachment of trypsinized BHK21 fibroblasts
journal, April 1977


Label-free high-throughput cell screening in flow
journal, January 2013


Mitochondrial Variability as a Source of Extrinsic Cellular Noise
journal, March 2012


Real Time Blood Testing Using Quantitative Phase Imaging
journal, February 2013


Optical Data Compression in Time Stretch Imaging
journal, April 2015


Works referencing / citing this record:

Rogue waves and analogies in optics and oceanography
journal, September 2019


Classifying T cell activity in autofluorescence intensity images with convolutional neural networks
journal, December 2019


Reconstructing cell cycle and disease progression using deep learning
journal, September 2017


Performance of convolutional neural networks for identification of bacteria in 3D microscopy datasets
journal, December 2018


Time stretch and its applications
journal, June 2017


High accuracy detection for T-cells and B-cells using deep convolutional neural networks
journal, December 2018


High-throughput imaging flow cytometry by optofluidic time-stretch microscopy
journal, July 2018


Automated assessment of breast cancer margin in optical coherence tomography images via pretrained convolutional neural network
journal, November 2018


Label-free biomarkers of human embryonic stem cell differentiation to hepatocytes: Label-Free Biomarkers
journal, May 2016


Applications of Deep-Learning in Exploiting Large-Scale and Heterogeneous Compound Data in Industrial Pharmaceutical Research
journal, November 2019


Deep learning in bioinformatics
journal, July 2016


Cervical cell recognition based on AGVF-Snake algorithm
journal, April 2019


Graphene-Based Materials for Biosensors: A Review
journal, September 2017


PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning
journal, February 2019


Label-free imaging flow cytometer for analyzing large cell populations by line-field quantitative phase microscopy with digital refocusing
journal, January 2020


A Transfer Learning Approach for Microstructure Reconstruction and Structure-property Predictions
journal, September 2018


Quantitative scoring of epithelial and mesenchymal qualities of cancer cells using machine learning and quantitative phase imaging
journal, February 2020


Antimicrobial peptide identification using multi-scale convolutional network
journal, December 2019


Leveraging uncertainty information from deep neural networks for disease detection
journal, December 2017


Artificial intelligence for microscopy: what you should know
journal, July 2019


A novel machine learning based approach for iPS progenitor cell identification
posted_content, August 2019


Plasmonic nanostructure design and characterization via Deep Learning
journal, September 2018


Quantitative Phase Imaging for Label-Free Analysis of Cancer Cells—Focus on Digital Holographic Microscopy
journal, June 2018


Automatic white blood cell classification using pre-trained deep learning models: ResNet and Inception
conference, April 2018


Tera-sample-per-second single-shot device analyzer
journal, January 2019


Immune cell type, cell activation, and single cell heterogeneity revealed by label-free optical methods
journal, November 2019


Fibre-optic based particle sensing via deep learning
journal, September 2019


Artificial Intelligence for Microscopy: What You Should Know
posted_content, February 2019


Artificial Intelligence for Microscopy: What You Should Know
posted_content, February 2019


A transparent cancer classifier
journal, December 2018


Physics-Based Feature Engineering
book, May 2019


Classifying optical microscope images of exfoliated graphene flakes by data-driven machine learning
journal, January 2019


Portable Multiplex Optical Assays
journal, December 2018


Optofluidic time-stretch imaging – an emerging tool for high-throughput imaging flow cytometry
journal, January 2016


Real-time Image Processing for Microscopy-based Label-free Imaging Flow Cytometry in a Microfluidic Chip
journal, September 2017


Predicting cancer cell invasion by single-cell physical phenotyping
journal, March 2018


Quantitative Phase Imaging Flow Cytometry for Ultra‐Large‐Scale Single‐Cell Biophysical Phenotyping
journal, April 2019


Machine Learning Based Real‐Time Image‐Guided Cell Sorting and Classification
journal, April 2019


The Next Era: Deep Learning in Pharmaceutical Research
journal, September 2016


Intelligent control of mode-locked femtosecond pulses by time-stretch-assisted real-time spectral analysis
journal, January 2020


Cell migration in microengineered tumor environments
journal, January 2017


A neural lens for super-resolution biological imaging
journal, June 2019


Microplastic Identification via Holographic Imaging and Machine Learning
journal, January 2020


Noninvasive detection of macrophage activation with single-cell resolution through machine learning
journal, March 2018


Machine learning analysis of extreme events in optical fibre modulation instability
journal, November 2018


Cell dynamic morphology classification using deep convolutional neural networks: Cell Dynamic Morphology
journal, May 2018


Machine Learning with Optical Phase Signatures for Phenotypic Profiling of Cell Lines
journal, April 2019


Optical inspection of nanoscale structures using a novel machine learning based synthetic image generation algorithm
journal, January 2019


A novel machine learning based approach for iPS progenitor cell identification
journal, December 2019


Time-stretch LiDAR as a spectrally scanned time-of-flight ranging camera
journal, December 2019


Direct Observation of Spatiotemporal Dynamics of Short Electron Bunches in Storage Rings
journal, February 2017


Holographic deep learning for rapid optical screening of anthrax spores
journal, August 2017


Deep Cytometry: Deep learning with Real-time Inference in Cell Sorting and Flow Cytometry
journal, July 2019


Intelligent frequency-shifted optofluidic time-stretch quantitative phase imaging
journal, January 2020


Automatic label‐free detection of breast cancer using nonlinear multimodal imaging and the convolutional neural network ResNet50
journal, December 2019


Deep learning of diffraction image patterns for accurate classification of five cell types
journal, December 2019


Learning from droplet flows in microfluidic channels using deep neural networks
text, January 2019


In vitro monitoring of photoinduced necrosis in HeLa cells using digital holographic microscopy and machine learning
journal, January 2020


Learning from droplet flows in microfluidic channels using deep neural networks
journal, May 2019


Quantitative imaging of lipid droplets in single cells
journal, January 2019


Label-free classification of cells based on supervised machine learning of subcellular structures
journal, January 2019


Using flow cytometry and multistage machine learning to discover label-free signatures of algal lipid accumulation
journal, July 2019


Net-FLICS: fast quantitative wide-field fluorescence lifetime imaging with compressed sensing – a deep learning approach
journal, March 2019


Plasmonic nanostructure design and characterization via Deep Learning
journal, September 2018


PhaseStain: the digital staining of label-free quantitative phase microscopy images using deep learning
journal, February 2019


Intelligent control of mode-locked femtosecond pulses by time-stretch-assisted real-time spectral analysis
journal, January 2020


Reconstructing cell cycle and disease progression using deep learning
journal, September 2017


Machine learning analysis of extreme events in optical fibre modulation instability
journal, November 2018


Matrix Analysis of Warped Stretch Imaging
journal, September 2017


Label-free detection of cellular drug responses by high-throughput bright-field imaging and machine learning
journal, September 2017


Machine Learning for Nuclear Mechano-Morphometric Biomarkers in Cancer Diagnosis
journal, December 2017


Deep Cytometry: Deep learning with Real-time Inference in Cell Sorting and Flow Cytometry
journal, July 2019


All-passive pixel super-resolution of time-stretch imaging
journal, March 2017


Computational Analysis of Cell Dynamics in Videos with Hierarchical-Pooled Deep-Convolutional Features
journal, August 2018


Quantitative scoring of epithelial and mesenchymal qualities of cancer cells using machine learning and quantitative phase imaging
journal, February 2020


Assessing microscope image focus quality with deep learning
journal, March 2018


A novel machine learning based approach for iPS progenitor cell identification
journal, December 2019


Context-Aware Image Compression
journal, July 2016


Label-free classification of cells based on supervised machine learning of subcellular structures
journal, January 2019


The Temporal Gearbox
preprint, January 2016


Time Stretch Inspired Computational Imaging
preprint, January 2017


ParasNet: Fast Parasites Detection with Neural Networks
preprint, January 2020