Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Chromatic information and feature detection in fast visual analysis

Journal Article · · PLoS ONE
 [1];  [2];  [3];  [4]
  1. Univ. di Firenze, Firenze (Italy); Univ. of Chicago, Chicago, IL (United States)
  2. Univ. di Pisa, Pisa (Italy); Istituto Nazionale de Fisica Nucleare, Pisa (Italy); Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  3. Univ. of Chicago, Chicago, IL (United States)
  4. Univ. College London, Bloomsbury (United Kingdom)
The visual system is able to recognize a scene based on a sketch made of very simple features. This ability is likely crucial for survival, when fast image recognition is necessary, and it is believed that a primal sketch is extracted very early in the visual processing. Such highly simplified representations can be sufficient for accurate object discrimination, but an open question is the role played by color in this process. Rich color information is available in natural scenes, yet artist's sketches are usually monochromatic; and, black-andwhite movies provide compelling representations of real world scenes. Also, the contrast sensitivity of color is low at fine spatial scales. We approach the question from the perspective of optimal information processing by a system endowed with limited computational resources. We show that when such limitations are taken into account, the intrinsic statistical properties of natural scenes imply that the most effective strategy is to ignore fine-scale color features and devote most of the bandwidth to gray-scale information. We find confirmation of these information-based predictions from psychophysics measurements of fast-viewing discrimination of natural scenes. As a result, we conclude that the lack of colored features in our visual representation, and our overall low sensitivity to high-frequency color components, are a consequence of an adaptation process, optimizing the size and power consumption of our brain for the visual world we live in.
Research Organization:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Grant/Contract Number:
AC02-07CH11359
OSTI ID:
1333683
Report Number(s):
FERMILAB-PUB--16-560; 1495140
Journal Information:
PLoS ONE, Journal Name: PLoS ONE Journal Issue: 8 Vol. 11; ISSN 1932-6203
Publisher:
Public Library of ScienceCopyright Statement
Country of Publication:
United States
Language:
English

References (32)

Coarse Blobs or Fine Edges? Evidence That Information Diagnosticity Changes the Perception of Complex Visual Stimuli journal October 1997
Diagnostic Colors Mediate Scene Recognition journal September 2000
Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm journal February 1975
Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited journal May 2006
Speed of processing in the human visual system journal October 1996
Dr. Angry and Mr. Smile: when categorization flexibly modifies the perception of faces in rapid visual presentations journal January 1999
Ultra-rapid categorisation of natural scenes does not rely on colour cues: a study in monkeys and humans journal July 2000
Modeling the role of salience in the allocation of overt visual attention journal January 2002
Sensory and cognitive contributions of color to the recognition of natural scenes journal June 2000
The Cost of Cortical Computation journal March 2003
A saliency map in primary visual cortex journal January 2002
Some informational aspects of visual perception. journal January 1954
Computational modelling of visual attention journal March 2001
Psychophysical evidence for fast region-based segmentation processes in motion and color. journal July 1996
An Energy Budget for Signaling in the Grey Matter of the Brain journal October 2001
Limits of Capacity for the Exchange of Information in the Human Nervous System journal October 2006
The contrast sensitivity of human colour vision to red-green and blue-yellow chromatic gratings. journal February 1985
Feature-specific interactions in salience from combined feature contrasts: Evidence for a bottom–up saliency map in V1 journal May 2007
Chromaticity diagram showing cone excitation by stimuli of equal luminance journal August 1979
Color and luminance information in natural scenes journal March 1998
Modeling global scene factors in attention journal July 2003
Information and Perception of Meaningful Patterns journal July 2013
Distribution and morphology of human cone photoreceptors stained with anti-blue opsin journal October 1991
Dr. Angry and Mr. Smile: when categorization flexibly modifies the perception of faces in rapid visual presentations journal January 1999
Sensory and cognitive contributions of color to the recognition of natural scenes journal June 2000
A Biologically Inspired Algorithm for the Recovery of Shading and Reflectance Images journal December 2004
Limits of Capacity for the Exchange of Information in the Human Nervous System journal October 2006
Orienting and Defensive Responses to Visual Stimuli journal September 1973
Energy limitation as a selective pressure on the evolution of sensory systems journal June 2008
Chromaticity diagram showing cone excitation by stimuli of equal luminance journal August 1979
Color and luminance information in natural scenes journal March 1998
Temporal Resolution for the Perception of Features and Conjunctions journal January 2007

Similar Records

Human vision, visual processing, and digital display; Proceedings of the Meeting, Los Angeles, CA, Jan. 18-20, 1989
Conference · Sat Dec 31 23:00:00 EST 1988 · OSTI ID:6856469

Bag of Lines (BoL) for Improved Aerial Scene Representation
Journal Article · Sun Sep 21 20:00:00 EDT 2014 · IEEE Geoscience and Remote Sensing Letters · OSTI ID:1163157

Robot navigation using image sequences
Conference · Mon Dec 30 23:00:00 EST 1996 · OSTI ID:430765