Mutual Information and Information Gating in Synfire Chains

Xiao, Zhuocheng; Wang, Binxu; Sornborger, Andrew Tyler; Tao, Louis

doi:10.3390/e20020102

Title: Mutual Information and Information Gating in Synfire Chains

Journal Article · Thu Feb 01 00:00:00 EST 2018 · Entropy

DOI:https://doi.org/10.3390/e20020102· OSTI ID:1419762

Xiao, Zhuocheng ^[1]; Wang, Binxu ^[2];

^[3]; Tao, Louis ^[2]

Univ. of Arizona, Tucson, AZ (United States)
Peking Univ., Beijing (China)
Los Alamos National Lab. (LANL), Los Alamos, NM (United States); Univ. of California, Davis, CA (United States)

Here, coherent neuronal activity is believed to underlie the transfer and processing of information in the brain. Coherent activity in the form of synchronous firing and oscillations has been measured in many brain regions and has been correlated with enhanced feature processing and other sensory and cognitive functions. In the theoretical context, synfire chains and the transfer of transient activity packets in feedforward networks have been appealed to in order to describe coherent spiking and information transfer. Recently, it has been demonstrated that the classical synfire chain architecture, with the addition of suitably timed gating currents, can support the graded transfer of mean firing rates in feedforward networks (called synfire-gated synfire chains—SGSCs). Here we study information propagation in SGSCs by examining mutual information as a function of layer number in a feedforward network. We explore the effects of gating and noise on information transfer in synfire chains and demonstrate that asymptotically, two main regions exist in parameter space where information may be propagated and its propagation is controlled by pulse-gating: a large region where binary codes may be propagated, and a smaller region near a cusp in parameter space that supports graded propagation across many layers.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Sponsoring Organization:: USDOE

Grant/Contract Number:: AC52-06NA25396

OSTI ID:: 1419762

Report Number(s):: LA-UR-17-31404; ENTRFG

Journal Information:: Entropy, Vol. 20, Issue 2; ISSN 1099-4300

Publisher:: MDPICopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 6 works

Citation information provided by
Web of Science

References (64)

Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties Gray, Charles M.; König, Peter; Engel, Andreas K. Nature, Vol. 338, Issue 6213 https://doi.org/10.1038/338334a0	journal	March 1989
Oscillatory firing and interneuronal correlations in squirrel monkey striate cortex Livingstone, M. S. Journal of Neurophysiology, Vol. 75, Issue 6 https://doi.org/10.1152/jn.1996.75.6.2467	journal	June 1996
Stimulus-Related Gamma Oscillations in Primate Auditory Cortex Brosch, Michael; Budinger, Eike; Scheich, Henning Journal of Neurophysiology, Vol. 87, Issue 6 https://doi.org/10.1152/jn.2002.87.6.2715	journal	June 2002
Tactile Spatial Attention Enhances Gamma-Band Activity in Somatosensory Cortex and Reduces Low-Frequency Activity in Parieto-Occipital Areas Bauer, M. Journal of Neuroscience, Vol. 26, Issue 2 https://doi.org/10.1523/JNEUROSCI.5228-04.2006	journal	January 2006
Temporal structure in neuronal activity during working memory in macaque parietal cortex Pesaran, Bijan; Pezaris, John S.; Sahani, Maneesh Nature Neuroscience, Vol. 5, Issue 8 https://doi.org/10.1038/nn890	journal	July 2002
Parvalbumin neurons and gamma rhythms enhance cortical circuit performance Sohal, Vikaas S.; Zhang, Feng; Yizhar, Ofer Nature, Vol. 459, Issue 7247 https://doi.org/10.1038/nature07991	journal	April 2009
Coherent gamma oscillations couple the amygdala and striatum during learning Popescu, Andrei T.; Popa, Daniela; Paré, Denis Nature Neuroscience, Vol. 12, Issue 6 https://doi.org/10.1038/nn.2305	journal	May 2009
Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey Bair, Wyeth; Koch, Christof Neural Computation, Vol. 8, Issue 6 https://doi.org/10.1162/neco.1996.8.6.1185	journal	August 1996
Temporal precision in the neural code and the timescales of natural vision Butts, Daniel A.; Weng, Chong; Jin, Jianzhong Nature, Vol. 449, Issue 7158 https://doi.org/10.1038/nature06105	journal	September 2007
Frequency-invariant temporal ordering of interneuronal discharges during hippocampal oscillations in awake mice Varga, C.; Golshani, P.; Soltesz, I. Proceedings of the National Academy of Sciences, Vol. 109, Issue 40 https://doi.org/10.1073/pnas.1210929109	journal	September 2012
Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro Reyes, Alex D. Nature Neuroscience, Vol. 6, Issue 6 https://doi.org/10.1038/nn1056	journal	May 2003
Synchrony of Thalamocortical Inputs Maximizes Cortical Reliability Wang, H. P.; Spencer, D.; Fellous, J. M. Science, Vol. 328, Issue 5974 https://doi.org/10.1126/science.1183108	journal	April 2010
A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding Sornborger, Andrew T.; Wang, Zhuo; Tao, Louis Journal of Computational Neuroscience, Vol. 39, Issue 2 https://doi.org/10.1007/s10827-015-0570-8	journal	August 2015
Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains Wang, Zhuo; Sornborger, Andrew T.; Tao, Louis PLOS Computational Biology, Vol. 12, Issue 6 https://doi.org/10.1371/journal.pcbi.1004979	journal	June 2016
Cusps enable line attractors for neural computation Xiao, Zhuocheng; Zhang, Jiwei; Sornborger, Andrew T. Physical Review E, Vol. 96, Issue 5 https://doi.org/10.1103/PhysRevE.96.052308	journal	November 2017
Integrator or coincidence detector? The role of the cortical neuron revisited König, Peter; Engel, Andreas K.; Singer, Wolf Trends in Neurosciences, Vol. 19, Issue 4 https://doi.org/10.1016/S0166-2236(96)80019-1	journal	April 1996
A mechanism for cognitive dynamics: neuronal communication through neuronal coherence Fries, Pascal Trends in Cognitive Sciences, Vol. 9, Issue 10 https://doi.org/10.1016/j.tics.2005.08.011	journal	October 2005
Stable propagation of synchronous spiking in cortical neural networks Diesmann, Markus; Gewaltig, Marc-Oliver; Aertsen, Ad Nature, Vol. 402, Issue 6761 https://doi.org/10.1038/990101	journal	December 1999
High Frequency Stimulation of the Subthalamic Nucleus Eliminates Pathological Thalamic Rhythmicity in a Computational Model Rubin, Jonathan E.; Terman, David Journal of Computational Neuroscience, Vol. 16, Issue 3 https://doi.org/10.1023/B:JCNS.0000025686.47117.67	journal	May 2004
Stable Propagation of Activity Pulses in Populations of Spiking Neurons Kistler, Werner M.; Gerstner, Wulfram Neural Computation, Vol. 14, Issue 5 https://doi.org/10.1162/089976602753633358	journal	May 2002
Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model Kumar, A.; Rotter, S.; Aertsen, A. Journal of Neuroscience, Vol. 28, Issue 20 https://doi.org/10.1523/JNEUROSCI.2542-07.2008	journal	May 2008
Neural Coding of Natural Stimuli: Information at Sub-Millisecond Resolution Nemenman, Ilya; Lewen, Geoffrey D.; Bialek, William PLoS Computational Biology, Vol. 4, Issue 3 https://doi.org/10.1371/journal.pcbi.1000025	journal	March 2008
Feedback stabilizes propagation of synchronous spiking in cortical neural networks Moldakarimov, Samat; Bazhenov, Maxim; Sejnowski, Terrence J. Proceedings of the National Academy of Sciences, Vol. 112, Issue 8 https://doi.org/10.1073/pnas.1500643112	journal	February 2015
Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding Kumar, Arvind; Rotter, Stefan; Aertsen, Ad Nature Reviews Neuroscience, Vol. 11, Issue 9 https://doi.org/10.1038/nrn2886	journal	September 2010
Analytical Calculation of Mutual Information between Weakly Coupled Poisson-Spiking Neurons in Models of Dynamically Gated Communication Cannon, Jonathan Neural Computation, Vol. 29, Issue 1 https://doi.org/10.1162/NECO_a_00915	journal	January 2017
A Mathematical Theory of Communication Shannon, C. E. Bell System Technical Journal, Vol. 27, Issue 3 https://doi.org/10.1002/j.1538-7305.1948.tb01338.x	journal	July 1948
Estimation of Entropy and Mutual Information Paninski, Liam Neural Computation, Vol. 15, Issue 6 https://doi.org/10.1162/089976603321780272	journal	June 2003
Binless strategies for estimation of information from neural data Victor, Jonathan D. Physical Review E, Vol. 66, Issue 5 https://doi.org/10.1103/PhysRevE.66.051903	journal	November 2002
Entropy and information in neural spike trains: Progress on the sampling problem Nemenman, Ilya; Bialek, William; de Ruyter van Steveninck, Rob Physical Review E, Vol. 69, Issue 5 https://doi.org/10.1103/PhysRevE.69.056111	journal	May 2004
Extracting information in spike time patterns with wavelets and information theory Lopes-dos-Santos, Vítor; Panzeri, Stefano; Kayser, Christoph Journal of Neurophysiology, Vol. 113, Issue 3 https://doi.org/10.1152/jn.00380.2014	journal	February 2015
The Functional Benefits of Criticality in the Cortex Shew, Woodrow L.; Plenz, Dietmar The Neuroscientist, Vol. 19, Issue 1 https://doi.org/10.1177/1073858412445487	journal	May 2012
Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches Shew, W. L.; Yang, H.; Yu, S. Journal of Neuroscience, Vol. 31, Issue 1 https://doi.org/10.1523/JNEUROSCI.4637-10.2011	journal	January 2011
An Information-Maximization Approach to Blind Separation and Blind Deconvolution Bell, Anthony J.; Sejnowski, Terrence J. Neural Computation, Vol. 7, Issue 6 https://doi.org/10.1162/neco.1995.7.6.1129	journal	November 1995
The “independent components” of natural scenes are edge filters Bell, Anthony J.; Sejnowski, Terrence J. Vision Research, Vol. 37, Issue 23 https://doi.org/10.1016/S0042-6989(97)00121-1	journal	December 1997
Fisher and Shannon Information in Finite Neural Populations Yarrow, Stuart; Challis, Edward; Seriès, Peggy Neural Computation, Vol. 24, Issue 7 https://doi.org/10.1162/NECO_a_00292	journal	July 2012
Extracting information from neuronal populations: information theory and decoding approaches Quian Quiroga, Rodrigo; Panzeri, Stefano Nature Reviews Neuroscience, Vol. 10, Issue 3 https://doi.org/10.1038/nrn2578	journal	March 2009
Complex brain networks: graph theoretical analysis of structural and functional systems Bullmore, Ed; Sporns, Olaf Nature Reviews Neuroscience, Vol. 10, Issue 3 https://doi.org/10.1038/nrn2575	journal	February 2009
Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention Fries, P. Science, Vol. 291, Issue 5508 https://doi.org/10.1126/science.1055465	journal	February 2001
Correlated neuronal activity and the flow of neural information Salinas, Emilio; Sejnowski, Terrence J. Nature Reviews Neuroscience, Vol. 2, Issue 8 https://doi.org/10.1038/35086012	journal	August 2001
Mechanisms of Gamma Oscillations in the Hippocampus of the Behaving Rat Csicsvari, Jozsef; Jamieson, Brian; Wise, Kensall D. Neuron, Vol. 37, Issue 2 https://doi.org/10.1016/S0896-6273(02)01169-8	journal	January 2003
Modulation of Neuronal Interactions Through Neuronal Synchronization Womelsdorf, T.; Schoffelen, J. -M.; Oostenveld, R. Science, Vol. 316, Issue 5831 https://doi.org/10.1126/science.1139597	journal	June 2007
Frequency of gamma oscillations routes flow of information in the hippocampus Colgin, Laura Lee; Denninger, Tobias; Fyhn, Marianne Nature, Vol. 462, Issue 7271 https://doi.org/10.1038/nature08573	journal	November 2009
Packet-based communication in the cortex Luczak, Artur; McNaughton, Bruce L.; Harris, Kenneth D. Nature Reviews Neuroscience, Vol. 16, Issue 12 https://doi.org/10.1038/nrn4026	journal	October 2015
The cortex as a central pattern generator Yuste, Rafael; MacLean, Jason N.; Smith, Jeffrey Nature Reviews Neuroscience, Vol. 6, Issue 6 https://doi.org/10.1038/nrn1686	journal	June 2005
Receptive Fields and Functional Architecture in two Nonstriate Visual Areas (18 and 19) of the cat Hubel, David H.; Wiesel, Torsten N. Journal of Neurophysiology, Vol. 28, Issue 2 https://doi.org/10.1152/jn.1965.28.2.229	journal	March 1965
Sparse coding of sensory inputs Olshausen, B.; Field, D. Current Opinion in Neurobiology, Vol. 14, Issue 4 https://doi.org/10.1016/j.conb.2004.07.007	journal	August 2004
Sparse Representation of Sounds in the Unanesthetized Auditory Cortex Hromádka, Tomáš; DeWeese, Michael R.; Zador, Anthony M. PLoS Biology, Vol. 6, Issue 1 https://doi.org/10.1371/journal.pbio.0060016	journal	January 2008
Rat Prefrontal Cortex Inactivations during Decision Making Are Explained by Bistable Attractor Dynamics Piet, Alex T.; Erlich, Jeffrey C.; Kopec, Charles D. Neural Computation, Vol. 29, Issue 11 https://doi.org/10.1162/neco_a_01005	journal	November 2017
Timing and Neural Encoding of Somatosensory Parametric Working Memory in Macaque Prefrontal Cortex Brody, C. D. Cerebral Cortex, Vol. 13, Issue 11 https://doi.org/10.1093/cercor/bhg100	journal	November 2003
How the brain keeps the eyes still Seung, H. S. Proceedings of the National Academy of Sciences, Vol. 93, Issue 23 https://doi.org/10.1073/pnas.93.23.13339	journal	November 1996
Model for a robust neural integrator Koulakov, Alexei A.; Raghavachari, Sridhar; Kepecs, Adam Nature Neuroscience, Vol. 5, Issue 8 https://doi.org/10.1038/nn893	journal	July 2002
Memory without Feedback in a Neural Network Goldman, Mark S. Neuron, Vol. 61, Issue 4 https://doi.org/10.1016/j.neuron.2008.12.012	journal	February 2009
Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations Brody, Carlos D.; Romo, Ranulfo; Kepecs, Adam Current Opinion in Neurobiology, Vol. 13, Issue 2 https://doi.org/10.1016/S0959-4388(03)00050-3	journal	April 2003
Persistent neural activity: prevalence and mechanisms Major, Guy; Tank, David Current Opinion in Neurobiology, Vol. 14, Issue 6 https://doi.org/10.1016/j.conb.2004.10.017	journal	December 2004
Functional dissection of circuitry in a neural integrator Aksay, Emre; Olasagasti, Itsaso; Mensh, Brett D. Nature Neuroscience, Vol. 10, Issue 4 https://doi.org/10.1038/nn1877	journal	March 2007
Context-dependent computation by recurrent dynamics in prefrontal cortex Mante, Valerio; Sussillo, David; Shenoy, Krishna V. Nature, Vol. 503, Issue 7474 https://doi.org/10.1038/nature12742	journal	November 2013
Memory without Feedback in a Neural Network Goldman, Mark S. Neuron, Vol. 93, Issue 3 https://doi.org/10.1016/j.neuron.2017.01.007	journal	February 2017
Neural coding of natural stimuli: information at sub-millisecond resolution Nemenman, Ilya; Lewen, Geoffrey D.; Bialek, William BMC Neuroscience, Vol. 8, Issue S2 https://doi.org/10.1186/1471-2202-8-s2-s7	journal	July 2007
A Mathematical Theory of Communication Shannon, C. E. Bell System Technical Journal, Vol. 27, Issue 4 https://doi.org/10.1002/j.1538-7305.1948.tb00917.x	journal	October 1948
Information capacity and transmission are maximized in balanced cortical networks with neuronal avalanches Shew, Woodrow L.; Yang, Hongdian; Yu, Shan arXiv https://doi.org/10.48550/arxiv.1012.3623	text	January 2010
Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains Wang, Zhou; Sornborger, Andrew T.; Tao, Louis arXiv https://doi.org/10.48550/arxiv.1510.07592	text	January 2015
Cusps Enable Line Attractors for Neural Computation Xiao, Zhuocheng; Zhang, Jiwei; Sornborger, Andrew T. arXiv https://doi.org/10.48550/arxiv.1702.06513	text	January 2017
Entropy and information in neural spike trains: Progress on the sampling problem Nemenman, Ilya; Bialek, William; van Steveninck, Rob de Ruyter arXiv https://doi.org/10.48550/arxiv.physics/0306063	text	January 2003
Temporal structure in neuronal activity during working memory in Macaque parietal cortex Pesaran, B.; Pezaris, J. S.; Sahani, M. arXiv https://doi.org/10.48550/arxiv.q-bio/0309034	preprint	January 2003

Cited By (2)

Information Theory in Neuroscience Piasini, Eugenio; Panzeri, Stefano Entropy, Vol. 21, Issue 1 https://doi.org/10.3390/e21010062	journal	January 2019
Information theory in neuroscience Dimitrov, Alexander G.; Lazar, Aurel A.; Victor, Jonathan D. Journal of Computational Neuroscience, Vol. 30, Issue 1 https://doi.org/10.1007/s10827-011-0314-3	journal	January 2011

Similar Records

Cusps enable line attractors for neural computation

Journal Article · Tue Nov 07 00:00:00 EST 2017 · Physical Review E · OSTI ID:1419762

Xiao, Zhuocheng; Zhang, Jiwei; Sornborger, Andrew T.; +1 more

Feasibility of neuro-morphic computing to emulate error-conflict based decision making.

Technical Report · Tue Sep 01 00:00:00 EDT 2009 · OSTI ID:1419762

Branch, Darren W

Information transmission and recovery in neural communications channels

Journal Article · Wed Nov 01 00:00:00 EST 2000 · Physical Review E · OSTI ID:1419762

Eguia, M C; Rabinovich, M I; Abarbanel, H D. I.

Related Subjects

59 BASIC BIOLOGICAL SCIENCES
Biological Science
Computer Science
Mathematics
Pulse gating
channel capacity
neural coding
feedforward networks
neural information 16 propagation

Title: Mutual Information and Information Gating in Synfire Chains

Citation Formats

References (64)

Cited By (2)

Similar Records

Related Subjects