DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Cusps enable line attractors for neural computation

Abstract

Here, line attractors in neuronal networks have been suggested to be the basis of many brain functions, such as working memory, oculomotor control, head movement, locomotion, and sensory processing. In this paper, we make the connection between line attractors and pulse gating in feed-forward neuronal networks. In this context, because of their neutral stability along a one-dimensional manifold, line attractors are associated with a time-translational invariance that allows graded information to be propagated from one neuronal population to the next. To understand how pulse-gating manifests itself in a high-dimensional, nonlinear, feedforward integrate-and-fire network, we use a Fokker-Planck approach to analyze system dynamics. We make a connection between pulse-gated propagation in the Fokker-Planck and population-averaged mean-field (firing rate) models, and then identify an approximate line attractor in state space as the essential structure underlying graded information propagation. An analysis of the line attractor shows that it consists of three fixed points: a central saddle with an unstable manifold along the line and stable manifolds orthogonal to the line, which is surrounded on either side by stable fixed points. Along the manifold defined by the fixed points, slow dynamics give rise to a ghost. We show that this line attractor arises atmore » a cusp catastrophe, where a fold bifurcation develops as a function of synaptic noise; and that the ghost dynamics near the fold of the cusp underly the robustness of the line attractor. Understanding the dynamical aspects of this cusp catastrophe allows us to show how line attractors can persist in biologically realistic neuronal networks and how the interplay of pulse gating, synaptic coupling, and neuronal stochasticity can be used to enable attracting one-dimensional manifolds and, thus, dynamically control the processing of graded information.« less

Authors:
 [1];  [2]; ORCiD logo [3];  [4]
  1. Univ. of Arizona, Tucson, AZ (United States); Peking Univ., Beijing (China)
  2. Beijing Computational Science Research Center, Beijing (China)
  3. Los Alamos National Lab. (LANL), Los Alamos, NM (United States); Univ. of California, Davis, CA (United States)
  4. Peking Univ., Beijing (China)
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
National Institutes of Health (NIH); USDOE
OSTI Identifier:
1411361
Report Number(s):
LA-UR-17-28766
Journal ID: ISSN 2470-0045; PLEEE8; TRN: US1800226
Grant/Contract Number:  
AC52-06NA25396
Resource Type:
Accepted Manuscript
Journal Name:
Physical Review E
Additional Journal Information:
Journal Volume: 96; Journal Issue: 5; Journal ID: ISSN 2470-0045
Publisher:
American Physical Society (APS)
Country of Publication:
United States
Language:
English
Subject:
59 BASIC BIOLOGICAL SCIENCES; 60 APPLIED LIFE SCIENCES; Biological Science; Computer Science

Citation Formats

Xiao, Zhuocheng, Zhang, Jiwei, Sornborger, Andrew T., and Tao, Louis. Cusps enable line attractors for neural computation. United States: N. p., 2017. Web. doi:10.1103/PhysRevE.96.052308.
Xiao, Zhuocheng, Zhang, Jiwei, Sornborger, Andrew T., & Tao, Louis. Cusps enable line attractors for neural computation. United States. https://doi.org/10.1103/PhysRevE.96.052308
Xiao, Zhuocheng, Zhang, Jiwei, Sornborger, Andrew T., and Tao, Louis. Tue . "Cusps enable line attractors for neural computation". United States. https://doi.org/10.1103/PhysRevE.96.052308. https://www.osti.gov/servlets/purl/1411361.
@article{osti_1411361,
title = {Cusps enable line attractors for neural computation},
author = {Xiao, Zhuocheng and Zhang, Jiwei and Sornborger, Andrew T. and Tao, Louis},
abstractNote = {Here, line attractors in neuronal networks have been suggested to be the basis of many brain functions, such as working memory, oculomotor control, head movement, locomotion, and sensory processing. In this paper, we make the connection between line attractors and pulse gating in feed-forward neuronal networks. In this context, because of their neutral stability along a one-dimensional manifold, line attractors are associated with a time-translational invariance that allows graded information to be propagated from one neuronal population to the next. To understand how pulse-gating manifests itself in a high-dimensional, nonlinear, feedforward integrate-and-fire network, we use a Fokker-Planck approach to analyze system dynamics. We make a connection between pulse-gated propagation in the Fokker-Planck and population-averaged mean-field (firing rate) models, and then identify an approximate line attractor in state space as the essential structure underlying graded information propagation. An analysis of the line attractor shows that it consists of three fixed points: a central saddle with an unstable manifold along the line and stable manifolds orthogonal to the line, which is surrounded on either side by stable fixed points. Along the manifold defined by the fixed points, slow dynamics give rise to a ghost. We show that this line attractor arises at a cusp catastrophe, where a fold bifurcation develops as a function of synaptic noise; and that the ghost dynamics near the fold of the cusp underly the robustness of the line attractor. Understanding the dynamical aspects of this cusp catastrophe allows us to show how line attractors can persist in biologically realistic neuronal networks and how the interplay of pulse gating, synaptic coupling, and neuronal stochasticity can be used to enable attracting one-dimensional manifolds and, thus, dynamically control the processing of graded information.},
doi = {10.1103/PhysRevE.96.052308},
journal = {Physical Review E},
number = 5,
volume = 96,
place = {United States},
year = {Tue Nov 07 00:00:00 EST 2017},
month = {Tue Nov 07 00:00:00 EST 2017}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 7 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Optimal computation with attractor networks
journal, July 2003


From Spiking Neuron Models to Linear-Nonlinear Models
journal, January 2011


The Complexity of Dynamics in Small Neural Circuits
journal, August 2016


How the brain keeps the eyes still
journal, November 1996


Mechanisms Gating the Flow of Information in the Cortex: What They Might Look Like and What Their Uses may be
journal, January 2011


Memory without Feedback in a Neural Network
journal, February 2009


Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination
journal, February 2005


Context-dependent computation by recurrent dynamics in prefrontal cortex
journal, November 2013

  • Mante, Valerio; Sussillo, David; Shenoy, Krishna V.
  • Nature, Vol. 503, Issue 7474
  • DOI: 10.1038/nature12742

Time structure of the activity in neural network models
journal, January 1995


Optimal Sensorimotor Integration in Recurrent Cortical Networks: A Neural Implementation of Kalman Filters
journal, May 2007


Neuronal correlates of sensory discrimination in the somatosensory cortex
journal, May 2000

  • Hernandez, A.; Zainos, A.; Romo, R.
  • Proceedings of the National Academy of Sciences, Vol. 97, Issue 11
  • DOI: 10.1073/pnas.120018597

Macroscopic Description for Networks of Spiking Neurons
journal, June 2015


Sequential Bayesian Decoding with a Population of Neurons
journal, May 2003


Synaptic reverberation underlying mnemonic persistent activity
journal, August 2001


A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding
journal, August 2015

  • Sornborger, Andrew T.; Wang, Zhuo; Tao, Louis
  • Journal of Computational Neuroscience, Vol. 39, Issue 2
  • DOI: 10.1007/s10827-015-0570-8

Modular Deconstruction Reveals the Dynamical and Physical Building Blocks of a Locomotion Motor Program
journal, April 2015


Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains
journal, June 2016


Kinetic theory for neuronal network dynamics
journal, January 2006

  • Cai, David; McLaughlin, David W.; Rangan, Aaditya V.
  • Communications in Mathematical Sciences, Vol. 4, Issue 1
  • DOI: 10.4310/CMS.2006.v4.n1.a4

Fine-Tuning and the Stability of Recurrent Neural Networks
journal, September 2011


Theory of orientation tuning in visual cortex.
journal, April 1995

  • Ben-Yishai, R.; Bar-Or, R. L.; Sompolinsky, H.
  • Proceedings of the National Academy of Sciences, Vol. 92, Issue 9
  • DOI: 10.1073/pnas.92.9.3844

Works referencing / citing this record:

Mutual Information and Information Gating in Synfire Chains
journal, February 2018

  • Xiao, Zhuocheng; Wang, Binxu; Sornborger, Andrew
  • Entropy, Vol. 20, Issue 2
  • DOI: 10.3390/e20020102