Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Deep neural network models of sound localization reveal how perception is adapted to real-world environments

Journal Article · · Nature human behaviour

Not provided.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Organization:
USDOE
DOE Contract Number:
AC05-00OR22725
OSTI ID:
1982131
Journal Information:
Nature human behaviour, Vol. 6, Issue 1; ISSN 2397-3374
Publisher:
Nature
Country of Publication:
United States
Language:
English

References (128)

Visual feature-analyzers and aftereffects of tilt and curvature. journal January 1971
Tilt Aftereffect and Adaptation-Induced Changes in Orientation Tuning in Visual Cortex journal December 2005
Physiological mechanisms of psychophysical masking: Observations from auditory‐nerve fibers journal February 1990
The role of feedback in visual masking and visual processing journal January 2007
Psychophysical evidence for separate channels for the perception of form, color, movement, and depth journal November 1987
Pitch as a Medium: A New Approach to Psychophysical Scaling journal June 1971
Physiological and psychophysical correlates of temporal processes in hearing journal August 1988
Universal and Non-universal Features of Musical Pitch Perception Revealed by Singing journal October 2019
Contributions of ideal observer theory to vision research journal April 2011
Frequency discrimination in the auditory system: Place or periodicity mechanisms? journal January 1970
Evaluating Auditory Performance Limits: I. One-Parameter Discrimination Using a Computational Model for the Auditory Nerve journal October 2001
Motion illusions as optimal percepts journal May 2002
Cardinal rules: visual orientation perception reflects knowledge of environmental statistics journal June 2011
Optimal defocus estimation in individual natural images journal September 2011
Image-Computable Ideal Observers for Tasks with Natural Stimuli journal September 2020
LXI. Acoustical observations journal June 1877
Mechanisms of Sound Localization in Mammals journal July 2010
Combined evaluation of interaural time and intensity differences: Psychoacoustic results and computer modeling journal July 1993
A performance adequate computational model for auditory localization journal January 2000
A place theory of sound localization. journal January 1948
Theory of binaural interaction based on auditory‐nerve data. I. General strategy and preliminary results on interaural discrimination journal December 1973
Optimal neural population coding of an auditory spatial cue journal August 2004
A Model for Interaural Time Difference Sensitivity in the Medial Superior Olive: Interaction of Excitatory and Inhibitory Synaptic Inputs, Channel Dynamics, and Cellular Morphology journal March 2005
Sensitivity to Interaural Time Differences Conveyed in the Stimulus Envelope: Estimating Inputs of Binaural Neurons Through the Temporal Analysis of Spike Trains journal June 2016
Mechanism of Binaural Fusion in the Hearing of Speech journal September 1957
Lateralization of complex binaural stimuli: A weighted‐image model
  • Stern, Richard M.; Zeiberg, Andrew S.; Trahiotis, Constantine
  • The Journal of the Acoustical Society of America, Vol. 84, Issue 1 https://doi.org/10.1121/1.396982
journal July 1988
Owl's behavior and neural representation predicted by Bayesian inference journal July 2011
A Probabilistic Model for Robust Localization Based on a Binaural Auditory Front-End journal January 2011
Binaural Localization of Multiple Sources in Reverberant and Noisy Environments journal July 2012
A learning-based approach to direction of arrival estimation in noisy and reverberant environments conference April 2015
On sound source localization of speech signals using deep neural networks text January 2015
Broadband doa estimation using convolutional neural networks trained with noise signals conference October 2017
Exploiting Deep Neural Networks and Head Movements for Robust Binaural Localization of Multiple Sources in Reverberant Environments journal December 2017
Direction of Arrival Estimation for Multiple Sound Sources Using Convolutional Recurrent Neural Network conference September 2018
Deep and CNN fusion method for binaural sound source localisation journal July 2020
Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation journal November 2014
Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream journal July 2015
Using goal-driven deep learning models to understand sensory cortex journal February 2016
Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence journal June 2016
Seeing it all: Convolutional network layers map the function of the human visual system journal May 2017
A Task-Optimized Neural Network Replicates Human Auditory Behavior, Predicts Brain Responses, and Reveals a Cortical Processing Hierarchy journal May 2018
HRTF measurements of a KEMAR journal June 1995
Derivation of auditory filter shapes from notched-noise data journal August 1990
Sound Texture Perception via Statistics of the Auditory Periphery: Evidence from Sound Synthesis journal September 2011
Phase-locking in the cochlear nerve of the guinea-pig and its relation to the receptor potential of inner hair-cells journal January 1986
Individual differences among deep neural network models journal November 2020
Image method for efficiently simulating small‐room acoustics journal April 1979
Adaptive and Selective Time Averaging of Auditory Scenes journal May 2018
The rôle of head movements in auditory localization. journal April 1931
The role of head movements and vestibular and visual cues in sound localization. journal October 1940
Coherent signal-subspace processing for the detection and estimation of angles of arrival of multiple wide-band sources journal August 1985
Multiple emitter location and signal parameter estimation journal March 1986
WAVES: weighted average of signal subspaces for robust wideband direction finding journal January 2001
TOPS: new DOA estimator for wideband signals journal June 2006
End-to-end Binaural Sound Localisation from the Raw Waveform conference May 2019
Listener weighting of cues for lateral angle: The duplex theory of sound localization revisited journal January 2002
Just Noticeable Differences in Dichotic Phase journal September 1956
Lateralization of tonal signals which have neither onsets nor offsets journal February 1979
Lateralization of low-frequency transients journal February 1983
Human interaural time difference thresholds for sine tones: The high-frequency limit journal May 2013
Computing interaural differences through finite element modeling of idealized human heads journal September 2015
Difference thresholds for interaural intensity journal March 1977
Discrimination of interaural differences of level as a function of frequency journal May 1988
Transaural experiments and a revised duplex theory for the localization of low-frequency tones journal February 2016
Localization of Sound from Single and Paired Sources journal September 1955
On the Minimum Audible Angle journal April 1958
Relative sound localisation abilities in human listeners journal August 2015
The bandwidth effect on monaural and binaural localization journal January 1986
Sound source localization identification accuracy: Bandwidth dependencies journal November 2014
Headphone simulation of free‐field listening. II: Psychophysical validation journal February 1989
Relearning sound localization with new ears journal September 1998
Localization using nonindividualized head‐related transfer functions journal July 1993
Role of spectral detail in sound-source localization journal December 1998
Spectral cues are necessary to encode azimuthal auditory space in the mouse superior colliculus journal February 2020
Contribution of spectral cues to human sound localization journal October 2002
The role of high frequencies in speech localization journal July 2005
Spectral cues used in the localization of sound sources on the median plane journal December 1974
Temporal weighting in sound localization journal September 2002
The Precedence Effect in Sound Localization journal July 1949
The precedence effect journal October 1999
The Precedence Effect in Sound Localization journal December 2014
Difference in precedence effect between children and adults signifies development of sound localization abilities in complex listening tasks journal October 2010
Directional perception of distributed sound sources journal March 2011
Perceptual limits in a simulated “Cocktail party” journal May 2015
How many images are in an auditory scene? journal April 2017
The precedence effect and its possible role in the avoidance of interaural ambiguities journal March 1980
Transform coding of audio signals using perceptual noise criteria journal January 1988
Deep neural network models of sensory systems: windows onto the role of task constraints journal April 2019
On hearing with more than one ear: lessons from evolution journal May 2009
Narrow‐band sound localization related to external ear acoustics journal November 1992
Location Coding by Opponent Neural Populations in the Auditory Cortex journal February 2005
Statistics of Natural Binaural Sounds journal October 2014
Coincidence Detection in the Auditory System journal December 1998
Auditory Brainstem Models: Adapting Cochlear Nuclei Improve Spatial Encoding by the Medial Superior Olive in Reverberation journal April 2021
Training-Induced Plasticity of Auditory Localization in Adult Mammals journal March 2006
Building machines that learn and think like people journal November 2016
Deep Neural Networks as a Computational Model for Human Shape Sensitivity journal April 2016
Controversial stimuli: Pitting neural networks against each other as models of human cognition journal November 2020
Efficient coding of natural sounds journal March 2002
Updated parameters and expanded simulation options for a model of the auditory periphery journal January 2014
A phenomenological model of the synapse between the inner hair cell and auditory nerve: Implications of limited neurotransmitter release sites journal March 2018
A convolutional neural-network model of human cochlear mechanics and filter tuning for real-time applications journal February 2021
Statistics of natural reverberation enable perceptual separation of sound and space journal November 2016
Accurate Sound Localization in Reverberant Environments Is Mediated by Robust Encoding of Spatial Cues in the Auditory Midbrain journal April 2009
Head Movements During Sound Localization journal August 1967
The Contribution of Head Movement to the Externalization and Internalization of Sounds journal December 2013
Detectability of varying interaural temporal differencesa) journal February 1978
The Perception of Auditory Motion journal January 2016
Neural coding and perception of auditory motion direction based on interaural time differences journal October 2019
The what, where and how of auditory-object perception journal September 2013
Perceptual separation of concurrent speech sounds: Absence of across‐frequency grouping by common interaural delay journal August 1995
Perceptual segregation of a harmonic from a vowel by interaural time difference and frequency proximity journal October 1997
The benefit of binaural hearing in a cocktail party: Effect of location and type of interferer journal February 2004
The advantage of knowing where to listen journal December 2005
The cocktail party problem journal December 2009
Spatial cues alone produce inaccurate sound segregation: The effect of interaural time differences
  • Schwartz, Andrew; McDermott, Josh H.; Shinn-Cunningham, Barbara
  • The Journal of the Acoustical Society of America, Vol. 132, Issue 1 https://doi.org/10.1121/1.4718637
journal July 2012
Simulating the response of multiple microphones to a single acoustic source in a reverberant room journal November 1986
Distinct Cortical Pathways for Music and Speech Revealed by Hypothesis-Free Voxel Decomposition journal December 2015
Summary statistics in auditory perception journal February 2013
Modeling auditory processing of amplitude modulation. I. Detection and masking with narrow-band carriers journal November 1997
Multiresolution spectrotemporal analysis of complex sounds journal August 2005
Large-Scale Machine Learning with Stochastic Gradient Descent book January 2010
EcoNAS: Finding Proxies for Economical Neural Architecture Search conference June 2020
The Grid Audio-Visual Speech Corpus dataset January 2006
Pyroomacoustics: A Python Package for Audio Room Simulation and Array Processing Algorithms conference April 2018
Sound source localization of filtered noises by listeners with normal hearing: A statistical analysis journal May 2013
Binaural processing model based on contralateral inhibition. I. Model structure journal August 2001
Letter-Value Plots: Boxplots for Large Data journal July 2017