skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Mutual Information and Information Gating in Synfire Chains

Abstract

Here, coherent neuronal activity is believed to underlie the transfer and processing of information in the brain. Coherent activity in the form of synchronous firing and oscillations has been measured in many brain regions and has been correlated with enhanced feature processing and other sensory and cognitive functions. In the theoretical context, synfire chains and the transfer of transient activity packets in feedforward networks have been appealed to in order to describe coherent spiking and information transfer. Recently, it has been demonstrated that the classical synfire chain architecture, with the addition of suitably timed gating currents, can support the graded transfer of mean firing rates in feedforward networks (called synfire-gated synfire chains—SGSCs). Here we study information propagation in SGSCs by examining mutual information as a function of layer number in a feedforward network. We explore the effects of gating and noise on information transfer in synfire chains and demonstrate that asymptotically, two main regions exist in parameter space where information may be propagated and its propagation is controlled by pulse-gating: a large region where binary codes may be propagated, and a smaller region near a cusp in parameter space that supports graded propagation across many layers.

Authors:
 [1];  [2]; ORCiD logo [3];  [2]
  1. Univ. of Arizona, Tucson, AZ (United States)
  2. Peking Univ., Beijing (China)
  3. Los Alamos National Lab. (LANL), Los Alamos, NM (United States); Univ. of California, Davis, CA (United States)
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1419762
Report Number(s):
LA-UR-17-31404
Journal ID: ISSN 1099-4300; ENTRFG
Grant/Contract Number:  
AC52-06NA25396
Resource Type:
Accepted Manuscript
Journal Name:
Entropy
Additional Journal Information:
Journal Volume: 20; Journal Issue: 2; Journal ID: ISSN 1099-4300
Publisher:
MDPI
Country of Publication:
United States
Language:
English
Subject:
59 BASIC BIOLOGICAL SCIENCES; Biological Science; Computer Science; Mathematics; Pulse gating, channel capacity, neural coding, feedforward networks, neural information 16 propagation

Citation Formats

Xiao, Zhuocheng, Wang, Binxu, Sornborger, Andrew Tyler, and Tao, Louis. Mutual Information and Information Gating in Synfire Chains. United States: N. p., 2018. Web. doi:10.3390/e20020102.
Xiao, Zhuocheng, Wang, Binxu, Sornborger, Andrew Tyler, & Tao, Louis. Mutual Information and Information Gating in Synfire Chains. United States. doi:10.3390/e20020102.
Xiao, Zhuocheng, Wang, Binxu, Sornborger, Andrew Tyler, and Tao, Louis. Thu . "Mutual Information and Information Gating in Synfire Chains". United States. doi:10.3390/e20020102. https://www.osti.gov/servlets/purl/1419762.
@article{osti_1419762,
title = {Mutual Information and Information Gating in Synfire Chains},
author = {Xiao, Zhuocheng and Wang, Binxu and Sornborger, Andrew Tyler and Tao, Louis},
abstractNote = {Here, coherent neuronal activity is believed to underlie the transfer and processing of information in the brain. Coherent activity in the form of synchronous firing and oscillations has been measured in many brain regions and has been correlated with enhanced feature processing and other sensory and cognitive functions. In the theoretical context, synfire chains and the transfer of transient activity packets in feedforward networks have been appealed to in order to describe coherent spiking and information transfer. Recently, it has been demonstrated that the classical synfire chain architecture, with the addition of suitably timed gating currents, can support the graded transfer of mean firing rates in feedforward networks (called synfire-gated synfire chains—SGSCs). Here we study information propagation in SGSCs by examining mutual information as a function of layer number in a feedforward network. We explore the effects of gating and noise on information transfer in synfire chains and demonstrate that asymptotically, two main regions exist in parameter space where information may be propagated and its propagation is controlled by pulse-gating: a large region where binary codes may be propagated, and a smaller region near a cusp in parameter space that supports graded propagation across many layers.},
doi = {10.3390/e20020102},
journal = {Entropy},
number = 2,
volume = 20,
place = {United States},
year = {2018},
month = {2}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties
journal, March 1989

  • Gray, Charles M.; König, Peter; Engel, Andreas K.
  • Nature, Vol. 338, Issue 6213
  • DOI: 10.1038/338334a0

Oscillatory firing and interneuronal correlations in squirrel monkey striate cortex
journal, June 1996


Stimulus-Related Gamma Oscillations in Primate Auditory Cortex
journal, June 2002

  • Brosch, Michael; Budinger, Eike; Scheich, Henning
  • Journal of Neurophysiology, Vol. 87, Issue 6
  • DOI: 10.1152/jn.2002.87.6.2715

Temporal structure in neuronal activity during working memory in macaque parietal cortex
journal, July 2002

  • Pesaran, Bijan; Pezaris, John S.; Sahani, Maneesh
  • Nature Neuroscience, Vol. 5, Issue 8
  • DOI: 10.1038/nn890

Parvalbumin neurons and gamma rhythms enhance cortical circuit performance
journal, April 2009

  • Sohal, Vikaas S.; Zhang, Feng; Yizhar, Ofer
  • Nature, Vol. 459, Issue 7247
  • DOI: 10.1038/nature07991

Coherent gamma oscillations couple the amygdala and striatum during learning
journal, May 2009

  • Popescu, Andrei T.; Popa, Daniela; Paré, Denis
  • Nature Neuroscience, Vol. 12, Issue 6
  • DOI: 10.1038/nn.2305

Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey
journal, August 1996


Temporal precision in the neural code and the timescales of natural vision
journal, September 2007

  • Butts, Daniel A.; Weng, Chong; Jin, Jianzhong
  • Nature, Vol. 449, Issue 7158
  • DOI: 10.1038/nature06105

Frequency-invariant temporal ordering of interneuronal discharges during hippocampal oscillations in awake mice
journal, September 2012

  • Varga, C.; Golshani, P.; Soltesz, I.
  • Proceedings of the National Academy of Sciences, Vol. 109, Issue 40
  • DOI: 10.1073/pnas.1210929109

Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro
journal, May 2003

  • Reyes, Alex D.
  • Nature Neuroscience, Vol. 6, Issue 6
  • DOI: 10.1038/nn1056

Synchrony of Thalamocortical Inputs Maximizes Cortical Reliability
journal, April 2010


A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding
journal, August 2015

  • Sornborger, Andrew T.; Wang, Zhuo; Tao, Louis
  • Journal of Computational Neuroscience, Vol. 39, Issue 2
  • DOI: 10.1007/s10827-015-0570-8

Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains
journal, June 2016


Cusps enable line attractors for neural computation
journal, November 2017


Integrator or coincidence detector? The role of the cortical neuron revisited
journal, April 1996


A mechanism for cognitive dynamics: neuronal communication through neuronal coherence
journal, October 2005


Stable propagation of synchronous spiking in cortical neural networks
journal, December 1999

  • Diesmann, Markus; Gewaltig, Marc-Oliver; Aertsen, Ad
  • Nature, Vol. 402, Issue 6761
  • DOI: 10.1038/990101

High Frequency Stimulation of the Subthalamic Nucleus Eliminates Pathological Thalamic Rhythmicity in a Computational Model
journal, May 2004


Stable Propagation of Activity Pulses in Populations of Spiking Neurons
journal, May 2002


Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model
journal, May 2008


Neural Coding of Natural Stimuli: Information at Sub-Millisecond Resolution
journal, March 2008


Feedback stabilizes propagation of synchronous spiking in cortical neural networks
journal, February 2015

  • Moldakarimov, Samat; Bazhenov, Maxim; Sejnowski, Terrence J.
  • Proceedings of the National Academy of Sciences, Vol. 112, Issue 8
  • DOI: 10.1073/pnas.1500643112

Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding
journal, September 2010

  • Kumar, Arvind; Rotter, Stefan; Aertsen, Ad
  • Nature Reviews Neuroscience, Vol. 11, Issue 9
  • DOI: 10.1038/nrn2886

A Mathematical Theory of Communication
journal, July 1948


Estimation of Entropy and Mutual Information
journal, June 2003


Binless strategies for estimation of information from neural data
journal, November 2002


Entropy and information in neural spike trains: Progress on the sampling problem
journal, May 2004

  • Nemenman, Ilya; Bialek, William; de Ruyter van Steveninck, Rob
  • Physical Review E, Vol. 69, Issue 5
  • DOI: 10.1103/PhysRevE.69.056111

Extracting information in spike time patterns with wavelets and information theory
journal, February 2015

  • Lopes-dos-Santos, Vítor; Panzeri, Stefano; Kayser, Christoph
  • Journal of Neurophysiology, Vol. 113, Issue 3
  • DOI: 10.1152/jn.00380.2014

The Functional Benefits of Criticality in the Cortex
journal, May 2012


Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches
journal, January 2011


An Information-Maximization Approach to Blind Separation and Blind Deconvolution
journal, November 1995


The “independent components” of natural scenes are edge filters
journal, December 1997


Fisher and Shannon Information in Finite Neural Populations
journal, July 2012

  • Yarrow, Stuart; Challis, Edward; Seriès, Peggy
  • Neural Computation, Vol. 24, Issue 7
  • DOI: 10.1162/NECO_a_00292

Extracting information from neuronal populations: information theory and decoding approaches
journal, March 2009

  • Quian Quiroga, Rodrigo; Panzeri, Stefano
  • Nature Reviews Neuroscience, Vol. 10, Issue 3
  • DOI: 10.1038/nrn2578

Complex brain networks: graph theoretical analysis of structural and functional systems
journal, February 2009

  • Bullmore, Ed; Sporns, Olaf
  • Nature Reviews Neuroscience, Vol. 10, Issue 3
  • DOI: 10.1038/nrn2575

Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention
journal, February 2001


Correlated neuronal activity and the flow of neural information
journal, August 2001

  • Salinas, Emilio; Sejnowski, Terrence J.
  • Nature Reviews Neuroscience, Vol. 2, Issue 8
  • DOI: 10.1038/35086012

Mechanisms of Gamma Oscillations in the Hippocampus of the Behaving Rat
journal, January 2003


Modulation of Neuronal Interactions Through Neuronal Synchronization
journal, June 2007


Frequency of gamma oscillations routes flow of information in the hippocampus
journal, November 2009

  • Colgin, Laura Lee; Denninger, Tobias; Fyhn, Marianne
  • Nature, Vol. 462, Issue 7271
  • DOI: 10.1038/nature08573

Packet-based communication in the cortex
journal, October 2015

  • Luczak, Artur; McNaughton, Bruce L.; Harris, Kenneth D.
  • Nature Reviews Neuroscience, Vol. 16, Issue 12
  • DOI: 10.1038/nrn4026

The cortex as a central pattern generator
journal, June 2005

  • Yuste, Rafael; MacLean, Jason N.; Smith, Jeffrey
  • Nature Reviews Neuroscience, Vol. 6, Issue 6
  • DOI: 10.1038/nrn1686

Receptive Fields and Functional Architecture in two Nonstriate Visual Areas (18 and 19) of the cat
journal, March 1965


Sparse coding of sensory inputs
journal, August 2004


Sparse Representation of Sounds in the Unanesthetized Auditory Cortex
journal, January 2008


Rat Prefrontal Cortex Inactivations during Decision Making Are Explained by Bistable Attractor Dynamics
journal, November 2017

  • Piet, Alex T.; Erlich, Jeffrey C.; Kopec, Charles D.
  • Neural Computation, Vol. 29, Issue 11
  • DOI: 10.1162/neco_a_01005

Timing and Neural Encoding of Somatosensory Parametric Working Memory in Macaque Prefrontal Cortex
journal, November 2003


How the brain keeps the eyes still
journal, November 1996


Model for a robust neural integrator
journal, July 2002

  • Koulakov, Alexei A.; Raghavachari, Sridhar; Kepecs, Adam
  • Nature Neuroscience, Vol. 5, Issue 8
  • DOI: 10.1038/nn893

Memory without Feedback in a Neural Network
journal, February 2009


Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations
journal, April 2003


Persistent neural activity: prevalence and mechanisms
journal, December 2004


Functional dissection of circuitry in a neural integrator
journal, March 2007

  • Aksay, Emre; Olasagasti, Itsaso; Mensh, Brett D.
  • Nature Neuroscience, Vol. 10, Issue 4
  • DOI: 10.1038/nn1877

Context-dependent computation by recurrent dynamics in prefrontal cortex
journal, November 2013

  • Mante, Valerio; Sussillo, David; Shenoy, Krishna V.
  • Nature, Vol. 503, Issue 7474
  • DOI: 10.1038/nature12742

A mathematical theory of communication
journal, January 2001

  • Shannon, C. E.
  • ACM SIGMOBILE Mobile Computing and Communications Review, Vol. 5, Issue 1
  • DOI: 10.1145/584091.584093

    Works referencing / citing this record:

    A mechanism for cognitive dynamics: neuronal communication through neuronal coherence
    journal, October 2005


    An Information-Maximization Approach to Blind Separation and Blind Deconvolution
    journal, November 1995


    Oscillatory firing and interneuronal correlations in squirrel monkey striate cortex
    journal, June 1996


    The cortex as a central pattern generator
    journal, June 2005

    • Yuste, Rafael; MacLean, Jason N.; Smith, Jeffrey
    • Nature Reviews Neuroscience, Vol. 6, Issue 6
    • DOI: 10.1038/nrn1686

    Extracting information from neuronal populations: information theory and decoding approaches
    journal, March 2009

    • Quian Quiroga, Rodrigo; Panzeri, Stefano
    • Nature Reviews Neuroscience, Vol. 10, Issue 3
    • DOI: 10.1038/nrn2578

    Complex brain networks: graph theoretical analysis of structural and functional systems
    journal, February 2009

    • Bullmore, Ed; Sporns, Olaf
    • Nature Reviews Neuroscience, Vol. 10, Issue 3
    • DOI: 10.1038/nrn2575

    Persistent neural activity: prevalence and mechanisms
    journal, December 2004


    Receptive Fields and Functional Architecture in two Nonstriate Visual Areas (18 and 19) of the cat
    journal, March 1965


    Timing and Neural Encoding of Somatosensory Parametric Working Memory in Macaque Prefrontal Cortex
    journal, November 2003


    Temporal structure in neuronal activity during working memory in macaque parietal cortex
    journal, July 2002

    • Pesaran, Bijan; Pezaris, John S.; Sahani, Maneesh
    • Nature Neuroscience, Vol. 5, Issue 8
    • DOI: 10.1038/nn890

    Model for a robust neural integrator
    journal, July 2002

    • Koulakov, Alexei A.; Raghavachari, Sridhar; Kepecs, Adam
    • Nature Neuroscience, Vol. 5, Issue 8
    • DOI: 10.1038/nn893

    Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains
    journal, June 2016


    Extracting information in spike time patterns with wavelets and information theory
    journal, February 2015

    • Lopes-dos-Santos, Vítor; Panzeri, Stefano; Kayser, Christoph
    • Journal of Neurophysiology, Vol. 113, Issue 3
    • DOI: 10.1152/jn.00380.2014

    A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding
    journal, August 2015

    • Sornborger, Andrew T.; Wang, Zhuo; Tao, Louis
    • Journal of Computational Neuroscience, Vol. 39, Issue 2
    • DOI: 10.1007/s10827-015-0570-8

    Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties
    journal, March 1989

    • Gray, Charles M.; König, Peter; Engel, Andreas K.
    • Nature, Vol. 338, Issue 6213
    • DOI: 10.1038/338334a0

    Memory without Feedback in a Neural Network
    journal, February 2009


    Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention
    journal, February 2001


    Sparse Representation of Sounds in the Unanesthetized Auditory Cortex
    journal, January 2008


    Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey
    journal, August 1996


    Fast Propagation of Firing Rates through Layered Networks of Noisy Neurons
    journal, March 2002


    Frequency-invariant temporal ordering of interneuronal discharges during hippocampal oscillations in awake mice
    journal, September 2012

    • Varga, C.; Golshani, P.; Soltesz, I.
    • Proceedings of the National Academy of Sciences, Vol. 109, Issue 40
    • DOI: 10.1073/pnas.1210929109

    Stable propagation of synchronous spiking in cortical neural networks
    journal, December 1999

    • Diesmann, Markus; Gewaltig, Marc-Oliver; Aertsen, Ad
    • Nature, Vol. 402, Issue 6761
    • DOI: 10.1038/990101

    Stable Propagation of Activity Pulses in Populations of Spiking Neurons
    journal, May 2002


    How the brain keeps the eyes still
    journal, November 1996


    Functional dissection of circuitry in a neural integrator
    journal, March 2007

    • Aksay, Emre; Olasagasti, Itsaso; Mensh, Brett D.
    • Nature Neuroscience, Vol. 10, Issue 4
    • DOI: 10.1038/nn1877

    Neural Coding of Natural Stimuli: Information at Sub-Millisecond Resolution
    journal, March 2008


    Feedback stabilizes propagation of synchronous spiking in cortical neural networks
    journal, February 2015

    • Moldakarimov, Samat; Bazhenov, Maxim; Sejnowski, Terrence J.
    • Proceedings of the National Academy of Sciences, Vol. 112, Issue 8
    • DOI: 10.1073/pnas.1500643112

    Temporal precision in the neural code and the timescales of natural vision
    journal, September 2007

    • Butts, Daniel A.; Weng, Chong; Jin, Jianzhong
    • Nature, Vol. 449, Issue 7158
    • DOI: 10.1038/nature06105

    Coherent gamma oscillations couple the amygdala and striatum during learning
    journal, May 2009

    • Popescu, Andrei T.; Popa, Daniela; Paré, Denis
    • Nature Neuroscience, Vol. 12, Issue 6
    • DOI: 10.1038/nn.2305

    Correlated neuronal activity and the flow of neural information
    journal, August 2001

    • Salinas, Emilio; Sejnowski, Terrence J.
    • Nature Reviews Neuroscience, Vol. 2, Issue 8
    • DOI: 10.1038/35086012

    Frequency of gamma oscillations routes flow of information in the hippocampus
    journal, November 2009

    • Colgin, Laura Lee; Denninger, Tobias; Fyhn, Marianne
    • Nature, Vol. 462, Issue 7271
    • DOI: 10.1038/nature08573

    Sparse coding of sensory inputs
    journal, August 2004


    Context-dependent computation by recurrent dynamics in prefrontal cortex
    journal, November 2013

    • Mante, Valerio; Sussillo, David; Shenoy, Krishna V.
    • Nature, Vol. 503, Issue 7474
    • DOI: 10.1038/nature12742

    Binary Spiking in Auditory Cortex
    journal, August 2003


    Synchrony of Thalamocortical Inputs Maximizes Cortical Reliability
    journal, April 2010


    The Functional Benefits of Criticality in the Cortex
    journal, May 2012


    A Mathematical Theory of Communication
    journal, July 1948


    Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding
    journal, September 2010

    • Kumar, Arvind; Rotter, Stefan; Aertsen, Ad
    • Nature Reviews Neuroscience, Vol. 11, Issue 9
    • DOI: 10.1038/nrn2886

    Parvalbumin neurons and gamma rhythms enhance cortical circuit performance
    journal, April 2009

    • Sohal, Vikaas S.; Zhang, Feng; Yizhar, Ofer
    • Nature, Vol. 459, Issue 7247
    • DOI: 10.1038/nature07991

    Gamma (40-100 Hz) oscillation in the hippocampus of the behaving rat
    journal, January 1995


    Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro
    journal, May 2003

    • Reyes, Alex D.
    • Nature Neuroscience, Vol. 6, Issue 6
    • DOI: 10.1038/nn1056

    Modulation of Neuronal Interactions Through Neuronal Synchronization
    journal, June 2007


    Stimulus-Related Gamma Oscillations in Primate Auditory Cortex
    journal, June 2002

    • Brosch, Michael; Budinger, Eike; Scheich, Henning
    • Journal of Neurophysiology, Vol. 87, Issue 6
    • DOI: 10.1152/jn.2002.87.6.2715

    Packet-based communication in the cortex
    journal, October 2015

    • Luczak, Artur; McNaughton, Bruce L.; Harris, Kenneth D.
    • Nature Reviews Neuroscience, Vol. 16, Issue 12
    • DOI: 10.1038/nrn4026

    Rat Prefrontal Cortex Inactivations during Decision Making Are Explained by Bistable Attractor Dynamics
    journal, November 2017

    • Piet, Alex T.; Erlich, Jeffrey C.; Kopec, Charles D.
    • Neural Computation, Vol. 29, Issue 11
    • DOI: 10.1162/neco_a_01005

    On the Transmission of Rate Code in Long Feedforward Networks with Excitatory–Inhibitory Balance
    journal, April 2003


    Estimation of Entropy and Mutual Information
    journal, June 2003