skip to main content

SciTech ConnectSciTech Connect

Title: Chromatic information and feature detection in fast visual analysis

The visual system is able to recognize a scene based on a sketch made of very simple features. This ability is likely crucial for survival, when fast image recognition is necessary, and it is believed that a primal sketch is extracted very early in the visual processing. Such highly simplified representations can be sufficient for accurate object discrimination, but an open question is the role played by color in this process. Rich color information is available in natural scenes, yet artist's sketches are usually monochromatic; and, black-andwhite movies provide compelling representations of real world scenes. Also, the contrast sensitivity of color is low at fine spatial scales. We approach the question from the perspective of optimal information processing by a system endowed with limited computational resources. We show that when such limitations are taken into account, the intrinsic statistical properties of natural scenes imply that the most effective strategy is to ignore fine-scale color features and devote most of the bandwidth to gray-scale information. We find confirmation of these information-based predictions from psychophysics measurements of fast-viewing discrimination of natural scenes. As a result, we conclude that the lack of colored features in our visual representation, and our overall low sensitivitymore » to high-frequency color components, are a consequence of an adaptation process, optimizing the size and power consumption of our brain for the visual world we live in.« less
Authors:
 [1] ;  [2] ;  [3] ;  [4]
  1. Univ. di Firenze, Firenze (Italy); Univ. of Chicago, Chicago, IL (United States)
  2. Univ. di Pisa, Pisa (Italy); Istituto Nazionale de Fisica Nucleare, Pisa (Italy); Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  3. Univ. of Chicago, Chicago, IL (United States)
  4. Univ. College London, Bloomsbury (United Kingdom)
Publication Date:
OSTI Identifier:
1333683
Report Number(s):
FERMILAB-PUB--16-560
Journal ID: ISSN 1932-6203; 1495140
Grant/Contract Number:
AC02-07CH11359
Type:
Accepted Manuscript
Journal Name:
PLoS ONE
Additional Journal Information:
Journal Volume: 11; Journal Issue: 8; Journal ID: ISSN 1932-6203
Publisher:
Public Library of Science
Research Org:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Org:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING luminance; color vision; visual system; entropy; probability distribution; bandwidth (signal processing); cognition; psychophysics