skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: An infrared/video fusion system for military robotics

Technical Report ·
DOI:https://doi.org/10.2172/562563· OSTI ID:562563

Sensory information is critical to the telerobotic operation of mobile robots. In particular, visual sensors are a key component of the sensor package on a robot engaged in urban military operations. Visual sensors provide the robot operator with a wealth of information including robot navigation and threat assessment. However, simple countermeasures such as darkness, smoke, or blinding by a laser, can easily neutralize visual sensors. In order to provide a robust visual sensing system, an infrared sensor is required to augment the primary visual sensor. An infrared sensor can acquire useful imagery in conditions that incapacitate a visual sensor. A simple approach to incorporating an infrared sensor into the visual sensing system is to display two images to the operator: side-by-side visual and infrared images. However, dual images might overwhelm the operator with information, and result in degraded robot performance. A better solution is to combine the visual and infrared images into a single image that maximizes scene information. Fusing visual and infrared images into a single image demands balancing the mixture of visual and infrared information. Humans are accustom to viewing and interpreting visual images. They are not accustom to viewing or interpreting infrared images. Hence, the infrared image must be used to enhance the visual image, not obfuscate it.

Research Organization:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE Assistant Secretary for Human Resources and Administration, Washington, DC (United States); Defense Advanced Research Projects Agency, Arlington, VA (United States)
DOE Contract Number:
W-7405-ENG-36
OSTI ID:
562563
Report Number(s):
LA-UR-97-3329; ON: DE98001494; CNN: Contract AO 8029; TRN: 98:000373
Resource Relation:
Other Information: PBD: 5 Aug 1997
Country of Publication:
United States
Language:
English