Title: Robust, automated sleep scoring by a compact neural network with distributional shift correction

Journal Article · · PLoS ONE
ORCiD logo [1];  [1];  [1];  [1];  [2]
  1. Univ. of California, Berkeley, CA (United States)
  2. Univ. of California, Berkeley, CA (United States); Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

Studying the biology of sleep requires the accurate assessment of the state of experimental subjects, and manual analysis of relevant data is a major bottleneck. Recently, deep learning applied to electroencephalogram and electromyogram data has shown great promise as a sleep scoring method, approaching the limits of inter-rater reliability. As with any machine learning algorithm, the inputs to a sleep scoring classifier are typically standardized in order to remove distributional shift caused by variability in the signal collection process. However, in scientific data, experimental manipulations introduce variability that should not be removed. For example, in sleep scoring, the fraction of time spent in each arousal state can vary between control and experimental subjects. We introduce a standardization method, mixture z-scoring, that preserves this crucial form of distributional shift. Using both a simulated experiment and mouse in vivo data, we demonstrate that a common standardization method used by state-of-the-art sleep scoring algorithms introduces systematic bias, but that mixture z-scoring does not. We present a free, open-source user interface that uses a compact neural network and mixture z-scoring to allow for rapid sleep scoring with accuracy that compares well to contemporary methods. This work provides a set of computational tools for the robust automation of sleep scoring.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
National Science Foundation (NSF); USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE Office of Science (SC)
Grant/Contract Number:
AC02-05CH11231
OSTI ID:
1713216
Journal Information:
PLoS ONE, Journal Name: PLoS ONE Journal Issue: 12 Vol. 14; ISSN 1932-6203
Publisher:
Public Library of ScienceCopyright Statement
Country of Publication:
United States
Language:
English

References (34)

Sleep-stage scoring in the rat using a support vector machine journal March 2008
Open-source logic-based automated sleep scoring software using electrophysiological recordings in rats journal October 2009
SCOPRISM: A new algorithm for automatic sleep scoring in mice journal September 2014
Sleep scoring made easy—Semi-automated sleep analysis software and manual rescoring tools for basic sleep research in mice journal January 2015
Functional organization of human sensorimotor cortex for speech articulation journal February 2013
Deep convolutional neural networks for interpretable analysis of EEG sleep stage scoring conference September 2017
DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG journal November 2017
Unsupervised Estimation of Mouse Sleep Scores and Dynamics Using a Graphical Model of Electrophysiological Measurements journal April 2016
An automated sleep-state classification algorithm for quantifying sleep timing and sleep-dependent dynamics of electroencephalographic and cerebral metabolic parameters journal September 2015
SPINDLE: End-to-end learning from EEG/EMG to extrapolate animal sleep scoring across experimental settings, labs and species text January 2019
Automated Classification of Sleep Stages and EEG Artifacts in Mice with Deep Learning preprint January 2018
Efficient BackProp book January 1998
Efficient BackProp book January 2012
Sleep-stage scoring in the rat using a support vector machine journal March 2008
Open-source logic-based automated sleep scoring software using electrophysiological recordings in rats journal October 2009
Automated analysis of sleep–wake state in rats journal November 2009
Chronux: A platform for analyzing neural signals journal September 2010
SCOPRISM: A new algorithm for automatic sleep scoring in mice journal September 2014
Sleep scoring made easy—Semi-automated sleep analysis software and manual rescoring tools for basic sleep research in mice journal January 2015
Functional organization of human sensorimotor cortex for speech articulation journal February 2013
Sleep-stage scoring in mice: The influence of data pre-processing on a system's performance
  • Katsageorgiou, Vasiliki-Maria; Lassi, Glenda; Tucci, Valter
  • 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) https://doi.org/10.1109/EMBC.2015.7318433
conference August 2015
Deep convolutional neural networks for interpretable analysis of EEG sleep stage scoring conference September 2017
DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG journal November 2017
Dataset Shift in Machine Learning: Book Reviews journal January 2010
Algorithm for sleep scoring in experimental animals based on fast Fourier transform power spectrum analysis of the electroencephalogram journal July 2008
Unsupervised Estimation of Mouse Sleep Scores and Dynamics Using a Graphical Model of Electrophysiological Measurements journal April 2016
A population genetic interpretation of GWAS findings for human quantitative traits journal March 2018
Harnessing olfactory bulb oscillations to perform fully brain-based sleep-scoring and real-time monitoring of anaesthesia depth journal November 2018
SPINDLE: End-to-end learning from EEG/EMG to extrapolate animal sleep scoring across experimental settings, labs and species journal April 2019
An automated sleep-state classification algorithm for quantifying sleep timing and sleep-dependent dynamics of electroencephalographic and cerebral metabolic parameters journal September 2015
SPINDLE: End-to-end learning from EEG/EMG to extrapolate animal sleep scoring across experimental settings, labs and species text January 2019
SPINDLE: End-to-end learning from EEG/EMG to extrapolate animal sleep scoring across experimental settings, labs and species text January 2019
Dataset Shift in Machine Learning book January 2008
A population genetic interpretation of GWAS findings for human quantitative traits text January 2018