Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Deep learning approaches for neural decoding across architectures and recording modalities

Journal Article · · Briefings in Bioinformatics
DOI:https://doi.org/10.1093/bib/bbaa355· OSTI ID:1826323
 [1];  [2]
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Univ. of California, Berkeley, CA (United States)
  2. Columbia Univ., New York, NY (United States)

Decoding behavior, perception or cognitive state directly from neural signals is critical for brain–computer interface research and an important tool for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. Here, we describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to functional magnetic resonance imaging. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25); USDOE Laboratory Directed Research and Development (LDRD) Program; National Science Foundation (NSF); Gatsby Foundation
Grant/Contract Number:
AC02-05CH11231
OSTI ID:
1826323
Journal Information:
Briefings in Bioinformatics, Journal Name: Briefings in Bioinformatics Journal Issue: 2 Vol. 22; ISSN 1467-5463
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United States
Language:
English

References (117)

Human ECoG speaking consonant-vowel syllables collection January 2020
Deep learning with convolutional neural networks for EEG decoding and visualization: Convolutional Neural Networks in EEG Analysis journal August 2017
Towards a brain‐based predictome of mental illness journal May 2020
Brain–computer interfaces for communication and control journal June 2002
Interpreting encoding and decoding models journal April 2019
Resting state functional magnetic resonance imaging and neural network classified autism and control journal February 2015
Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies journal October 2011
A Spatial Map of Onset and Sustained Responses to Speech in the Human Superior Temporal Gyrus journal June 2018
LFP-Net: A deep learning framework to recognize human behavioral activities using brain STN-LFP signals journal April 2020
Decoding word and category-specific spatiotemporal representations from MEG and EEG journal February 2011
fMRI pattern recognition in obsessive–compulsive disorder journal April 2012
Deep neural network with weight sparsity control and pre-training extracts hierarchical features and enhances classification performance: Evidence from whole-brain resting-state functional connectivity patterns of schizophrenia journal January 2016
Task-specific feature extraction and classification of fMRI volumes using a deep neural network initialized with a deep belief network: Evaluation using sensorimotor tasks journal January 2017
Generative adversarial networks for reconstructing natural images from brain activity journal November 2018
Interpretable, highly accurate brain decoding of subtly distinct brain states from functional MRI using intrinsic functional networks and long short-term memory recurrent neural networks journal November 2019
Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders journal December 2008
Closed-Loop Decoder Adaptation Shapes Neural Plasticity for Skillful Neuroprosthetic Control journal June 2014
Neurodata Without Borders: Creating a Common Data Format for Neurophysiology journal November 2015
A Task-Optimized Neural Network Replicates Human Auditory Behavior, Predicts Brain Responses, and Reveals a Cortical Processing Hierarchy journal May 2018
A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons journal February 1988
Instant neural control of a movement signal journal March 2002
Decoding reveals the contents of visual working memory in early visual areas journal February 2009
Restoration of grasp following paralysis through brain-controlled stimulation of muscles journal April 2012
Functional organization of human sensorimotor cortex for speech articulation journal February 2013
Ultrasensitive fluorescent proteins for imaging neuronal activity journal July 2013
Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning journal July 2015
Making brain–machine interfaces robust to future neural variability journal December 2016
A high-performance neural prosthesis enabled by control algorithm design journal November 2012
A neural network that finds a naturalistic solution for the production of muscle activity journal June 2015
Using goal-driven deep learning models to understand sensory cortex journal February 2016
Decoding subjective decisions from orbitofrontal cortex journal June 2016
The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes journal May 2012
Population coding of conditional probability distributions in dorsal premotor cortex journal May 2018
Real-time decoding of question-and-answer speech dialogue using human cortical activity journal July 2019
Speech synthesis from neural decoding of spoken sentences journal April 2019
Meeting brain–computer interface user performance expectations using a deep neural network decoding framework journal September 2018
Inferring single-trial neural population dynamics using sequential auto-encoders journal September 2018
A deep learning framework for neuroscience journal October 2019
Machine translation of cortical activity to text with an encoder–decoder framework journal March 2020
Towards reconstructing intelligible speech from the human auditory cortex journal January 2019
Comparison of Two-Talker Attention Decoding from EEG with Nonlinear Neural Networks and Linear Methods journal August 2019
An empirical comparison of neural networks and machine learning algorithms for EEG gait decoding journal March 2020
Reconstructing faces from fMRI patterns using deep generative neural networks journal May 2019
Decoding speech from spike-based neural population recordings in secondary auditory cortex of non-human primates journal December 2019
SchNet – A deep learning architecture for molecules and materials journal June 2018
Fast and robust active neuron segmentation in two-photon calcium imaging using spatiotemporal deep learning journal April 2019
Neural networks and physical systems with emergent collective computational abilities. journal April 1982
Decoding of finger trajectory from ECoG using deep learning journal February 2018
Superior arm-movement decoding from cortex with a new, unsupervised-learning algorithm journal January 2018
EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces journal July 2018
Speech synthesis from ECoG using densely connected 3D convolutional neural networks journal April 2019
Spike detection and sorting with deep learning journal January 2020
Direct classification of all American English phonemes using signals from functional speech motor cortex journal May 2014
Gait adaptation to visual kinematic perturbations using a real-time closed-loop brain–computer interface to a virtual reality avatar journal April 2016
Prediction of upper limb muscle activity from motor cortical discharge during reaching journal November 2007
Electrocorticographic amplitude predicts finger positions during slow grasping motions of the hand journal May 2010
Decoding spoken words using local field potentials recorded from the cortical surface journal September 2010
A recurrent neural network for closed-loop intracortical brain–machine interface decoders journal March 2012
Fast inference of deep neural networks in FPGAs for particle physics journal July 2018
Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision journal October 2017
CaloGAN: Simulating 3D high energy particle showers in multilayer electromagnetic calorimeters with generative adversarial networks journal January 2018
3D CNN Based Automatic Diagnosis of Attention Deficit Hyperactivity Disorder Using Functional and Structural MRI journal January 2017
Decoding Subjective Emotional Arousal during a Naturalistic VR Experience from EEG Using LSTMs conference December 2018
End-to-End Hand Kinematic Decoding from LFPs Using Temporal Convolutional Network conference October 2019
Neural decoding of spoken vowels from human sensory-motor cortex with high-density electrocorticography conference August 2014
Investigating deep learning for fNIRS based BCI conference August 2015
Decoding hindlimb kinematics from primate motor cortex using long short-term memory recurrent neural networks conference July 2018
A Comparison Study of Point-Process Filter and Deep Learning Performance in Estimating Rat Position Using an Ensemble of Place Cells
  • Rezaei, Mohammad R.; Gillespie, Anna K.; Guidera, Jennifer A.
  • 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) https://doi.org/10.1109/EMBC.2018.8513154
conference July 2018
Towards decoding speech production from single-trial magnetoencephalography (MEG) signals conference March 2017
Merged LSTM Model for emotion classification using EEG signals conference September 2019
Decoding Hand Kinematics from Local Field Potentials Using Long Short-Term Memory (LSTM) Network conference March 2019
Exascale Deep Learning for Climate Analytics conference November 2018
Generative Adversarial Networks Conditioned on Brain Activity Reconstruct Seen Images conference October 2018
Biosignal-Based Spoken Communication: A Survey journal December 2017
EEG Classification of Covert Speech Using Regularized Neural Networks journal December 2017
Modeling Event Propagation via Graph Biased Temporal Point Process journal January 2020
DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG journal November 2017
Machine learning for decoding listeners’ attention from electroencephalography evoked by continuous speech journal March 2020
Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks conference January 2006
Decoding EEG and LFP signals using deep learning: heading TrueNorth
  • Nurse, Ewan; Mashford, Benjamin S.; Yepes, Antonio Jimeno
  • CF'16: Computing Frontiers Conference, Proceedings of the ACM International Conference on Computing Frontiers https://doi.org/10.1145/2903150.2903159
conference May 2016
Cortical Control of Arm Movements: A Dynamical Systems Perspective journal July 2013
A muscle-activity-dependent gain between motor cortex and EMG journal January 2019
Local field potentials allow accurate decoding of muscle activity journal July 2012
Fast Nonnegative Deconvolution for Spike Train Inference From Population Calcium Imaging journal December 2010
Long Short-Term Memory journal November 1997
Decoding Movements from Cortical Ensemble Activity Using a Long Short-Term Memory Recurrent Network journal June 2019
Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates journal October 2003
Robust Brain-Machine Interface Design Using Optimal Feedback Control Modeling and Adaptive Point Process Filtering journal April 2016
Deep image reconstruction from human brain activity journal January 2019
Efficient neural decoding of self-location with a deep recurrent network journal February 2019
Deep learning as a tool for neural data analysis: Speech classification and cross-frequency coupling in human sensorimotor cortex journal September 2019
A Wireless Brain-Machine Interface for Real-Time Speech Synthesis journal December 2009
The Database for Reaching Experiments and Models journal November 2013
Comparison of Classifiers for Decoding Sensory and Cognitive Information from Prefrontal Neuronal Populations journal January 2014
Spontaneous low frequency BOLD signal variations from resting-state fMRI are decreased in Alzheimer disease journal June 2017
Robust, automated sleep scoring by a compact neural network with distributional shift correction journal December 2019
Machine Learning for Neural Decoding journal July 2020
Human Sensorimotor Cortex Control of Directly Measured Vocal Tract Movements during Vowel Production journal February 2018
Movement Intention Is Better Predicted than Attention in the Posterior Parietal Cortex journal March 2006
Speech reconstruction from human auditory cortex with deep neural networks conference September 2015
The Building Blocks of Interpretability journal March 2018
Latency-driven design for FPGA-based convolutional neural networks conference September 2017
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
  • Cho, Kyunghyun; van Merrienboer, Bart; Bahdanau, Dzmitry
  • Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation https://doi.org/10.3115/v1/W14-4012
conference January 2014
Prediction of Forelimb Reach Results From Motor Cortex Activities Based on Calcium Imaging and Deep Learning journal March 2019
A Comparison of Neural Decoding Methods and Population Coding Across Thalamo-Cortical Head Direction Cells journal December 2019
End-to-End Deep Image Reconstruction From Human Brain Activity journal April 2019
Toward open sharing of task-based fMRI data: the OpenfMRI project journal January 2013
Deep learning for neuroimaging: a validation study journal August 2014
Brain-to-text: decoding spoken phrases from phone representations in the brain journal June 2015
Automatic Speech Recognition from Neural Signals: A Focused Review journal September 2016
Rapid Decoding of Hand Gestures in Electrocorticography Using Recurrent Neural Networks journal August 2018
A Characterization of Brain-Computer Interface Performance Trade-Offs Using Support Vector Machines and Deep Neural Networks to Decode Movement Intent journal October 2018
Category Decoding of Visual Stimuli From Human Brain Activity Using a Bidirectional Recurrent Neural Network to Simulate Bidirectional Information Flows in Human Visual Cortices journal July 2019
Decoding Imagined and Spoken Phrases From Non-invasive Neural (MEG) Signals journal April 2020
Classifying Autism Spectrum Disorder Using the Temporal Statistics of Resting-State Functional MRI Data With 3D Convolutional Neural Networks journal May 2020
Automated long-term recording and analysis of neural activity in behaving animals journal September 2017
CaImAn an open source tool for scalable calcium imaging data analysis journal January 2019

Similar Records

Deep learning as a tool for neural data analysis: Speech classification and cross-frequency coupling in human sensorimotor cortex
Journal Article · Mon Sep 16 00:00:00 EDT 2019 · PLoS Computational Biology (Online) · OSTI ID:1572056

Remote Sensor Design for Visual Recognition with Convolutional Neural Networks
Software · Mon Apr 08 20:00:00 EDT 2019 · OSTI ID:code-25129

Related Subjects