Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

A Computational Theory for the Emergence of Grammatical Categories in Cortical Dynamics

Journal Article · · Frontiers in Neural Circuits
 [1];  [2];  [3];  [4];  [5];  [6]
  1. Univ. of Buenos Aires (Argentina); OSTI
  2. Argonne National Lab. (ANL), Lemont, IL (United States)
  3. Argonne National Lab. (ANL), Lemont, IL (United States); Loyola University, Chicago, IL (United States)
  4. Uppsala Univ. (Sweden)
  5. Centro Científico Tecnológico Conicet Mendoza (Argentina)
  6. Instituto de Biología y Medicina Experimental (CONICET), Buenos Aires (Argentina)

A general agreement in psycholinguistics claims that syntax and meaning are unified precisely and very quickly during online sentence processing. Although several theories have advanced arguments regarding the neurocomputational bases of this phenomenon, we argue that these theories could potentially benefit by including neurophysiological data concerning cortical dynamics constraints in brain tissue. In addition, some theories promote the integration of complex optimization methods in neural tissue. In this paper we attempt to fill these gaps introducing a computational model inspired in the dynamics of cortical tissue. In our modeling approach, proximal afferent dendrites produce stochastic cellular activations, while distal dendritic branches–on the other hand–contribute independently to somatic depolarization by means of dendritic spikes, and finally, prediction failures produce massive firing events preventing formation of sparse distributed representations. The model presented in this paper combines semantic and coarse-grained syntactic constraints for each word in a sentence context until grammatically related word function discrimination emerges spontaneously by the sole correlation of lexical information from different sources without applying complex optimization methods. By means of support vector machine techniques, we show that the sparse activation features returned by our approach are well suited—bootstrapping from the features returned by Word Embedding mechanisms—to accomplish grammatical function classification of individual words in a sentence. In this way we develop a biologically guided computational explanation for linguistically relevant unification processes in cortex which connects psycholinguistics to neurobiological accounts of language. We also claim that the computational hypotheses established in this research could foster future work on biologically-inspired learning algorithms for natural language processing applications.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities Division
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
1817166
Journal Information:
Frontiers in Neural Circuits, Journal Name: Frontiers in Neural Circuits Vol. 14; ISSN 1662-5110
Publisher:
Frontiers Research FoundationCopyright Statement
Country of Publication:
United States
Language:
English

References (95)

The decade of the dendritic NMDA spike journal June 2010
Statistical learning and language acquisition journal July 2010
The connection between phonological, syntactic and semantic skills and children’s reading and spelling journal September 1993
Excitatory signal flow and connectivity in a cortical column: focus on barrel cortex journal June 2007
The life of the cortical column: opening the domain of functional architecture of the cortex (1955–1981) journal June 2016
Learning and applying contextual constraints in sentence comprehension journal November 1990
Newborn infants’ sensitivity to perceptual cues to lexical and grammatical words journal September 1999
Postsynaptic pyramidal target selection by descending layer III pyramidal axons: dual intracellular recordings and biocytin filling in slices of rat neocortex journal February 1998
Phonological processing during language production: fMRI evidence for a shared production-comprehension network journal April 2003
Constraints on sentence comprehension journal July 1998
Neural evidence for the interplay between language, gesture, and action: A review journal June 2007
Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing journal May 2009
The effect of semantic relatedness on syntactic analysis: An fMRI study journal May 2010
Laminar processing in the visual cortical column journal August 2006
Backpropagation through time and the brain journal April 2019
Classes of dendritic information processing journal October 2019
Language models based on Hebbian cell assemblies journal July 2006
Identification of activated regions during a language task journal July 2007
Discrete combinatorial circuits emerging in neural networks: A mechanism for rules of grammar in the human brain? journal March 2009
Inter- and intra-laminar connections of pyramidal cells in the neocortex journal October 2005
Analysis of neural mechanisms underlying verbal fluency in cytoarchitectonically defined stereotaxic space—The roles of Brodmann areas 44 and 45 journal May 2004
Semantic processing of Chinese in left inferior prefrontal cortex studied with reversible words journal November 2004
Specialisation in Broca's region for semantic, phonological, and syntactic fluency? journal April 2008
Forward and backward connections in the brain: A DCM study of functional asymmetries journal April 2009
Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions journal January 2010
The language skeleton after dissecting meaning: A functional segregation within Broca's Area journal July 2015
Prediction mechanisms in motor and auditory areas and their role in sound perception and language understanding journal October 2019
A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain journal December 2012
Brain connections of words, perceptions and actions: A neurobiological model of spatio-temporal semantic activation in the human cortex journal April 2017
Meaning-driven syntactic predictions in a parallel processing architecture: Theory and algorithmic modeling of ERP effects journal August 2019
On Broca, brain, and binding: a new framework journal September 2005
The neurobiology of semantic memory journal November 2011
Theories of Error Back-Propagation in the Brain journal March 2019
Experimental evidence for sparse firing in the neocortex journal June 2012
Roles of Supplementary Motor Areas in Auditory Processing and Auditory Imagery journal August 2016
Phonological and acoustic bases for earliest grammatical category assignment: a cross-linguistic perspective journal February 1998
Natural speech reveals the semantic maps that tile human cerebral cortex journal April 2016
Random synaptic feedback weights support error backpropagation for deep learning journal November 2016
Pyramidal neurons: dendritic structure and synaptic integration journal March 2008
Modelling the N400 brain potential as change in a probabilistic representation of meaning journal August 2018
The functional organization of cortical feedback inputs to primary visual cortex journal April 2018
Sensorimotor semantics on the spot: brain activity dissociates between conceptual categories within 150 ms journal June 2013
Cortical representation of the constituent structure of sentences journal January 2011
Structural uniformity of neocortex, revisited journal January 2013
The acquisition of language by children journal October 2001
Microcolumns in the cerebral cortex journal May 2000
Distributional Structure journal August 1954
A stagewise rejective multiple test procedure based on a modified Bonferroni test journal January 1988
The columnar organization of the neocortex journal April 1997
The minicolumn hypothesis in neuroscience journal May 2002
Anatomical Substrates for Functional Columns in Macaque Monkey Primary Visual Cortex journal January 2003
Top-down Dendritic Input Increases the Gain of Layer 5 Pyramidal Neurons journal April 2004
Stochastic models of neuronal dynamics journal May 2005
Topology preservation in self-organizing feature maps: exact definition and measurement journal March 1997
An Augmented Two-Layer Model Captures Nonlinear Analog Spatial Integration Effects in Pyramidal Neuron Dendrites journal May 2014
Infants' Acquisition of Grammatical Gender Dependencies journal June 2015
Development of Abstract Grammatical Categorization in Infants journal October 2012
Synaptic physiology of the flow of information in the cat's visual cortex in vivo journal April 2002
Synaptic connections between layer 4 spiny neurone- layer 2/3 pyramidal cell pairs in juvenile rat barrel cortex: physiology and anatomy of interlaminar signalling within a cortical column journal February 2002
Multiresolution spectrotemporal analysis of complex sounds journal August 2005
Number detectors spontaneously emerge in a deep neural network designed for visual object recognition journal May 2019
Dopamine neurons encode performance error in singing birds journal December 2016
Dendritic action potentials and computation in human layer 2/3 cortical neurons journal January 2020
LIBSVM: A library for support vector machines journal April 2011
Active Properties of Neocortical Pyramidal Neuron Dendrites journal July 2013
The Neurobiology of Language Beyond Single Words journal July 2014
Modality and Topographic Properties of Single Neurons of Cat'S Somatic Sensory Cortex journal July 1957
The Brain Basis of Language Processing: From Structure to Function journal October 2011
Continuous Online Sequence Learning with an Unsupervised Neural Network Model journal November 2016
STDP-Compatible Approximation of Backpropagation in an Energy-Based Model journal March 2017
Feature Forest Models for Probabilistic HPSG Parsing journal March 2008
Reappraising the Functional Implications of the Primate Visual Anatomical Hierarchy journal October 2007
Recognition and Representation of Function Words in English-Learning Infants journal September 2006
Towards a Mathematical Theory of Cortical Micro-circuits journal October 2009
Tuft dendrites of pyramidal neurons operate as feedback-modulated functional subunits journal March 2019
Precursors to Natural Grammar Learning: Preliminary Evidence from 4-Month-Old Infants journal March 2011
Using stochastic language models (SLM) to map lexical, syntactic, and phonological information processing in the brain journal May 2017
Phonetic acquisition in cortical dynamics, a computational approach journal June 2019
Properties of Horizontal and Vertical Inputs to Pyramidal Cells in the Superficial Layers of the Cat Visual Cortex journal March 2000
Categorical Speech Processing in Broca's Area: An fMRI Study Using Multivariate Pattern-Based Analysis journal March 2012
Functional Integration across Brain Regions Improves Speech Perception under Adverse Listening Conditions journal February 2007
Learning To Split and Rephrase From Wikipedia Edit History conference January 2018
Probabilistic disambiguation models for wide-coverage HPSG parsing conference January 2005
Maximum entropy estimation for feature forests conference January 2002
A log-linear model with an n-gram reference distribution for accurate HPSG parsing conference January 2007
Efficacy of beam thresholding, unification filtering and hybrid parsing in probabilistic HPSG parsing conference January 2005
Phonological properties of word classes and directionality in conversion journal October 2017
Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in Neocortex journal March 2016
Apical Function in Neocortical Pyramidal Cells: A Common Pathway by Which General Anesthetics Can Affect Mental State journal July 2018
A Framework for Intelligence and Cortical Function Based on Grid Cells in the Neocortex journal January 2019
Development of Maps of Simple and Complex Cells in the Primary Visual Cortex journal January 2011
Early and parallel processing of pragmatic and semantic information in speech acts: neurophysiological evidence journal January 2013
Contributions of cortical feedback to sensory processing in primary visual cortex journal November 2014
Functional maps of neocortical local circuitry journal November 2007
Towards deep learning with segregated dendrites journal December 2017

Similar Records

Phonetic acquisition in cortical dynamics, a computational approach
Journal Article · Fri Jun 07 00:00:00 EDT 2019 · PLoS ONE · OSTI ID:1559970

Lexical ambiguity resolution
Book · Wed Dec 31 23:00:00 EST 1986 · OSTI ID:5046044

Control of inferencing in natural language understanding
Journal Article · Fri Dec 31 23:00:00 EST 1982 · Comput. Math. Appl.; (United States) · OSTI ID:5342087