Cusps enable line attractors for neural computation
Abstract
Here, line attractors in neuronal networks have been suggested to be the basis of many brain functions, such as working memory, oculomotor control, head movement, locomotion, and sensory processing. In this paper, we make the connection between line attractors and pulse gating in feed-forward neuronal networks. In this context, because of their neutral stability along a one-dimensional manifold, line attractors are associated with a time-translational invariance that allows graded information to be propagated from one neuronal population to the next. To understand how pulse-gating manifests itself in a high-dimensional, nonlinear, feedforward integrate-and-fire network, we use a Fokker-Planck approach to analyze system dynamics. We make a connection between pulse-gated propagation in the Fokker-Planck and population-averaged mean-field (firing rate) models, and then identify an approximate line attractor in state space as the essential structure underlying graded information propagation. An analysis of the line attractor shows that it consists of three fixed points: a central saddle with an unstable manifold along the line and stable manifolds orthogonal to the line, which is surrounded on either side by stable fixed points. Along the manifold defined by the fixed points, slow dynamics give rise to a ghost. We show that this line attractor arises atmore »
- Authors:
-
- Univ. of Arizona, Tucson, AZ (United States); Peking Univ., Beijing (China)
- Beijing Computational Science Research Center, Beijing (China)
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States); Univ. of California, Davis, CA (United States)
- Peking Univ., Beijing (China)
- Publication Date:
- Research Org.:
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- National Institutes of Health (NIH); USDOE
- OSTI Identifier:
- 1411361
- Report Number(s):
- LA-UR-17-28766
Journal ID: ISSN 2470-0045; PLEEE8; TRN: US1800226
- Grant/Contract Number:
- AC52-06NA25396
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Physical Review E
- Additional Journal Information:
- Journal Volume: 96; Journal Issue: 5; Journal ID: ISSN 2470-0045
- Publisher:
- American Physical Society (APS)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 59 BASIC BIOLOGICAL SCIENCES; 60 APPLIED LIFE SCIENCES; Biological Science; Computer Science
Citation Formats
Xiao, Zhuocheng, Zhang, Jiwei, Sornborger, Andrew T., and Tao, Louis. Cusps enable line attractors for neural computation. United States: N. p., 2017.
Web. doi:10.1103/PhysRevE.96.052308.
Xiao, Zhuocheng, Zhang, Jiwei, Sornborger, Andrew T., & Tao, Louis. Cusps enable line attractors for neural computation. United States. https://doi.org/10.1103/PhysRevE.96.052308
Xiao, Zhuocheng, Zhang, Jiwei, Sornborger, Andrew T., and Tao, Louis. Tue .
"Cusps enable line attractors for neural computation". United States. https://doi.org/10.1103/PhysRevE.96.052308. https://www.osti.gov/servlets/purl/1411361.
@article{osti_1411361,
title = {Cusps enable line attractors for neural computation},
author = {Xiao, Zhuocheng and Zhang, Jiwei and Sornborger, Andrew T. and Tao, Louis},
abstractNote = {Here, line attractors in neuronal networks have been suggested to be the basis of many brain functions, such as working memory, oculomotor control, head movement, locomotion, and sensory processing. In this paper, we make the connection between line attractors and pulse gating in feed-forward neuronal networks. In this context, because of their neutral stability along a one-dimensional manifold, line attractors are associated with a time-translational invariance that allows graded information to be propagated from one neuronal population to the next. To understand how pulse-gating manifests itself in a high-dimensional, nonlinear, feedforward integrate-and-fire network, we use a Fokker-Planck approach to analyze system dynamics. We make a connection between pulse-gated propagation in the Fokker-Planck and population-averaged mean-field (firing rate) models, and then identify an approximate line attractor in state space as the essential structure underlying graded information propagation. An analysis of the line attractor shows that it consists of three fixed points: a central saddle with an unstable manifold along the line and stable manifolds orthogonal to the line, which is surrounded on either side by stable fixed points. Along the manifold defined by the fixed points, slow dynamics give rise to a ghost. We show that this line attractor arises at a cusp catastrophe, where a fold bifurcation develops as a function of synaptic noise; and that the ghost dynamics near the fold of the cusp underly the robustness of the line attractor. Understanding the dynamical aspects of this cusp catastrophe allows us to show how line attractors can persist in biologically realistic neuronal networks and how the interplay of pulse gating, synaptic coupling, and neuronal stochasticity can be used to enable attracting one-dimensional manifolds and, thus, dynamically control the processing of graded information.},
doi = {10.1103/PhysRevE.96.052308},
journal = {Physical Review E},
number = 5,
volume = 96,
place = {United States},
year = {2017},
month = {11}
}
Web of Science
Works referenced in this record:
Optimal computation with attractor networks
journal, July 2003
- Latham, Peter E.; Deneve, Sophie; Pouget, Alexandre
- Journal of Physiology-Paris, Vol. 97, Issue 4-6
From Spiking Neuron Models to Linear-Nonlinear Models
journal, January 2011
- Ostojic, Srdjan; Brunel, Nicolas
- PLoS Computational Biology, Vol. 7, Issue 1
The Complexity of Dynamics in Small Neural Circuits
journal, August 2016
- Fasoli, Diego; Cattani, Anna; Panzeri, Stefano
- PLOS Computational Biology, Vol. 12, Issue 8
How the brain keeps the eyes still
journal, November 1996
- Seung, H. S.
- Proceedings of the National Academy of Sciences, Vol. 93, Issue 23
Mechanisms Gating the Flow of Information in the Cortex: What They Might Look Like and What Their Uses may be
journal, January 2011
- Gisiger, Thomas; Boukadoum, Mounir
- Frontiers in Computational Neuroscience, Vol. 5
Memory without Feedback in a Neural Network
journal, February 2009
- Goldman, Mark S.
- Neuron, Vol. 61, Issue 4
Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination
journal, February 2005
- Machens, C. K.
- Science, Vol. 307, Issue 5712
Context-dependent computation by recurrent dynamics in prefrontal cortex
journal, November 2013
- Mante, Valerio; Sussillo, David; Shenoy, Krishna V.
- Nature, Vol. 503, Issue 7474
Time structure of the activity in neural network models
journal, January 1995
- Gerstner, Wulfram
- Physical Review E, Vol. 51, Issue 1
Optimal Sensorimotor Integration in Recurrent Cortical Networks: A Neural Implementation of Kalman Filters
journal, May 2007
- Deneve, S.; Duhamel, J. -R.; Pouget, A.
- Journal of Neuroscience, Vol. 27, Issue 21
Neuronal correlates of sensory discrimination in the somatosensory cortex
journal, May 2000
- Hernandez, A.; Zainos, A.; Romo, R.
- Proceedings of the National Academy of Sciences, Vol. 97, Issue 11
Macroscopic Description for Networks of Spiking Neurons
journal, June 2015
- Montbrió, Ernest; Pazó, Diego; Roxin, Alex
- Physical Review X, Vol. 5, Issue 2
Sequential Bayesian Decoding with a Population of Neurons
journal, May 2003
- Wu, Si; Chen, Danmei; Niranjan, Mahesan
- Neural Computation, Vol. 15, Issue 5
Synaptic reverberation underlying mnemonic persistent activity
journal, August 2001
- Wang, Xiao-Jing
- Trends in Neurosciences, Vol. 24, Issue 8
A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding
journal, August 2015
- Sornborger, Andrew T.; Wang, Zhuo; Tao, Louis
- Journal of Computational Neuroscience, Vol. 39, Issue 2
Modular Deconstruction Reveals the Dynamical and Physical Building Blocks of a Locomotion Motor Program
journal, April 2015
- Bruno, Angela M.; Frost, William N.; Humphries, Mark D.
- Neuron, Vol. 86, Issue 1
Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains
journal, June 2016
- Wang, Zhuo; Sornborger, Andrew T.; Tao, Louis
- PLOS Computational Biology, Vol. 12, Issue 6
Kinetic theory for neuronal network dynamics
journal, January 2006
- Cai, David; McLaughlin, David W.; Rangan, Aaditya V.
- Communications in Mathematical Sciences, Vol. 4, Issue 1
Fine-Tuning and the Stability of Recurrent Neural Networks
journal, September 2011
- MacNeil, David; Eliasmith, Chris
- PLoS ONE, Vol. 6, Issue 9
Theory of orientation tuning in visual cortex.
journal, April 1995
- Ben-Yishai, R.; Bar-Or, R. L.; Sompolinsky, H.
- Proceedings of the National Academy of Sciences, Vol. 92, Issue 9
Works referencing / citing this record:
Mutual Information and Information Gating in Synfire Chains
journal, February 2018
- Xiao, Zhuocheng; Wang, Binxu; Sornborger, Andrew
- Entropy, Vol. 20, Issue 2