skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Field-theoretic approach to fluctuation effects in neural networks

Abstract

A well-defined stochastic theory for neural activity, which permits the calculation of arbitrary statistical moments and equations governing them, is a potentially valuable tool for theoretical neuroscience. We produce such a theory by analyzing the dynamics of neural activity using field theoretic methods for nonequilibrium statistical processes. Assuming that neural network activity is Markovian, we construct the effective spike model, which describes both neural fluctuations and response. This analysis leads to a systematic expansion of corrections to mean field theory, which for the effective spike model is a simple version of the Wilson-Cowan equation. We argue that neural activity governed by this model exhibits a dynamical phase transition which is in the universality class of directed percolation. More general models (which may incorporate refractoriness) can exhibit other universality classes, such as dynamic isotropic percolation. Because of the extremely high connectivity in typical networks, it is expected that higher-order terms in the systematic expansion are small for experimentally accessible measurements, and thus, consistent with measurements in neocortical slice preparations, we expect mean field exponents for the transition. We provide a quantitative criterion for the relative magnitude of each term in the systematic expansion, analogous to the Ginsburg criterion. Experimental identification ofmore » dynamic universality classes in vivo is an outstanding and important question for neuroscience.« less

Authors:
;  [1];  [2]
  1. NIH/NIDDK/LBM, Building 12A Room 4007, MSC 5621, Bethesda, Maryland 20892 (United States)
  2. (United States)
Publication Date:
OSTI Identifier:
21072435
Resource Type:
Journal Article
Resource Relation:
Journal Name: Physical Review. E, Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics; Journal Volume: 75; Journal Issue: 5; Other Information: DOI: 10.1103/PhysRevE.75.051919; (c) 2007 The American Physical Society; Country of input: International Atomic Energy Agency (IAEA)
Country of Publication:
United States
Language:
English
Subject:
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; 46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY; CORRECTIONS; EXPANSION; FLUCTUATIONS; MARKOV PROCESS; MEAN-FIELD THEORY; NEURAL NETWORKS; NONLINEAR PROBLEMS; PHASE TRANSFORMATIONS

Citation Formats

Buice, Michael A., Cowan, Jack D., and Mathematics Department, University of Chicago, Chicago, Illinois 60637. Field-theoretic approach to fluctuation effects in neural networks. United States: N. p., 2007. Web. doi:10.1103/PHYSREVE.75.051919.
Buice, Michael A., Cowan, Jack D., & Mathematics Department, University of Chicago, Chicago, Illinois 60637. Field-theoretic approach to fluctuation effects in neural networks. United States. doi:10.1103/PHYSREVE.75.051919.
Buice, Michael A., Cowan, Jack D., and Mathematics Department, University of Chicago, Chicago, Illinois 60637. Tue . "Field-theoretic approach to fluctuation effects in neural networks". United States. doi:10.1103/PHYSREVE.75.051919.
@article{osti_21072435,
title = {Field-theoretic approach to fluctuation effects in neural networks},
author = {Buice, Michael A. and Cowan, Jack D. and Mathematics Department, University of Chicago, Chicago, Illinois 60637},
abstractNote = {A well-defined stochastic theory for neural activity, which permits the calculation of arbitrary statistical moments and equations governing them, is a potentially valuable tool for theoretical neuroscience. We produce such a theory by analyzing the dynamics of neural activity using field theoretic methods for nonequilibrium statistical processes. Assuming that neural network activity is Markovian, we construct the effective spike model, which describes both neural fluctuations and response. This analysis leads to a systematic expansion of corrections to mean field theory, which for the effective spike model is a simple version of the Wilson-Cowan equation. We argue that neural activity governed by this model exhibits a dynamical phase transition which is in the universality class of directed percolation. More general models (which may incorporate refractoriness) can exhibit other universality classes, such as dynamic isotropic percolation. Because of the extremely high connectivity in typical networks, it is expected that higher-order terms in the systematic expansion are small for experimentally accessible measurements, and thus, consistent with measurements in neocortical slice preparations, we expect mean field exponents for the transition. We provide a quantitative criterion for the relative magnitude of each term in the systematic expansion, analogous to the Ginsburg criterion. Experimental identification of dynamic universality classes in vivo is an outstanding and important question for neuroscience.},
doi = {10.1103/PHYSREVE.75.051919},
journal = {Physical Review. E, Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics},
number = 5,
volume = 75,
place = {United States},
year = {Tue May 15 00:00:00 EDT 2007},
month = {Tue May 15 00:00:00 EDT 2007}
}
  • A field-theoretic approach is developed to study the problem of parity violation in the radiative capture of a neutron by a proton, in order to investigate the role of relativistic effects in the observables in this process. The deuteron and the scattering state are described by Bethe-Salpeter vertex functions satisfying certain symmetry relations due to the generalized Pauli principle. In the case of circular polarization of the photons the isovector relativistic contributions violating the Siegert theorem, which are proportional to the photon energy, cannot noticeably affect the existing discrepancy between the observed magnitude of the effect and the theoretical estimates,more » though they are important in models with neutral currents, where the parity-violating weak ..pi..NN constant is large. It is shown that an electroweak effect similar to that found in the capture np..-->..d..gamma.. also occurs in the case of bremsstrahlung in nucleon-nucleon scattering (in terms approx...omega../sup 0/ in the photon energy).« less
  • A novel approach to neural network learning is developed through the use of team decision theoretic techniques. By considering a neural network as a cooperative team, a learning rule is derived which can adapt with a change in nature's statistics. Since this algorithm is a function of nature's statistics and not a particular pattern, an entire statistical class of patterns is learned. Furthermore, this learning is optimal in the sense of minimum risk. Since the learning is for an entire statistical class of patterns, care must be taken in retrieving the stored data. Specifically, when the input to the networkmore » is a noise corrupted pattern from nature, the network's output will be affected by the noise. Therefore, an algorithm for retrieving a pattern from the statistical class of patterns which has been learned is also derived. This algorithm-a sequential MAP estimator for observations corrupted by colored noise-is able to retrieve a pattern from a clean as well as a noisy input. The algorithm is simulated on a set of 5 x 5 binary patterns which are stored as the class of patterns having a normal distribution with zero mean and unity variance. Results of recalling this set of patterns from both clean and noisy inputs are presented.« less
  • We revisit the quantum noise problem in the mirror-field system by a field-theoretic approach. Here a perfectly reflecting mirror is illuminated by a single-mode coherent state of the massless scalar field. The associated radiation pressure is described by a surface integral of the stress-tensor of the field. The read-out field is measured by a monopole detector, from which the effective distance between the detector and mirror can be obtained. In the slow-motion limit of the mirror, this field-theoretic approach allows to identify various sources of quantum noise that all in all leads to uncertainty of the read-out measurement. In additionmore » to well-known sources from shot noise and radiation pressure fluctuations, a new source of noise is found from field fluctuations modified by the mirror's displacement. Correlation between different sources of noise can be established in the read-out measurement as the consequence of interference between the incident field and the field reflected off the mirror. In the case of negative correlation, we found that the uncertainty can be lowered than the value predicted by the standard quantum limit. Since the particle-number approach is often used in quantum optics, we compared results obtained by both approaches and examine its validity. We also derive a Langevin equation that describes the stochastic dynamics of the mirror. The underlying fluctuation-dissipation relation is briefly mentioned. Finally we discuss the backreaction induced by the radiation pressure. It will alter the mean displacement of the mirror, but we argue this backreaction can be ignored for a slowly moving mirror. - Highlights: Black-Right-Pointing-Pointer The quantum noise problem in the mirror-field system is re-visited by a field-theoretic approach. Black-Right-Pointing-Pointer Other than the shot noise and radiation pressure noise, we show there are new sources of noise and correlation between them. Black-Right-Pointing-Pointer The noise correlations can be used to suppress the overall quantum noise on the mirror. Black-Right-Pointing-Pointer The equation of motion of the mirror is derived and the backreaction of the radiation field is discussed.« less
  • Single-pole autoreclosure is quite extensively used in long-line applications and involves tripping only the faulted phase for single-phase-earth faults. Reliable and fast phase selection is thus imperative in order to avoid potential problems of system insecurity and instability. Conventional phase selectors, primarily based on power frequency measurands, can suffer some impairment in performance because of their heavy dependency on varying system and fault conditions. However, the advent of artificial neural networks (ANNs), with their ability to map complex and highly non-linear input/output patterns, provides an attractive potential solution to the long-standing problems of accurate and fast phase selection. This papermore » describes the design of a novel phase selector using ANNs. The technique is based on utilizing fault generated high frequency noise (captured through the high voltage coupling capacitor of a conventional Capacitor Voltage Transformer) to essentially recognize the various patterns generated within the frequency spectra of the fault generated noise signals on the three phases, for the purposes of accurately deducing the faulted phase. The paper demonstrates a new concept and methodology in phase selection which will facilitate single-pole autoreclosure applications in power systems.« less
  • This paper proposes a new Neural Networks Diagnostic System for on-line fault section estimation using information of relays and circuit breakers. This system has similar profile of an expert system, but can be constructed much more easily from elemental samples. These samples associate fault section with its primary, local and/or remote protective relays and breakers. The diagnostic system can be applicable to the power system control center for single or multiple fault sections estimation, even in the cases of failure operation of relay and breaker, or error-existent data transmission. The proposed approach has been practically verified by testing on amore » model power system. The test results, although preliminary, suggest the system can be implemented by various electric utilities with relatively low customization effort.« less