Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network

  Advanced Search  

Temporal spatio-velocity transform and its application to tracking and interaction

Summary: Temporal spatio-velocity transform and
its application to tracking and interaction
Koichi Sato*, J.K. Aggarwal
Computer and Vision Research Center, Department of Electrical and Computer Engineering,
The University of Texas at Austin, Austin, TX 78712, USA
Received 7 August 2002; accepted 2 February 2004
Available online 3 September 2004
This paper describes the temporal spatio-velocity (TSV) transform for extracting pixel
velocities from binary image sequences. The TSV transform is derived from the Hough trans-
form over windowed spatio-temporal images. We present the methodology of the transform
and its implementation in an iterative computational form. The intensity at each pixel in
the TSV image represents a measure of the likelihood of occurrence of a pixel with instanta-
neous velocity in the current position. Binarization of the TSV image extracts blobs based on
the similarity of velocity and position. The TSV transform provides an efficient way to remove
noise by focusing on stable velocities, and constructs noise-free blobs. We apply the transform
to tracking human figures in a sidewalk environment and extend its use to an interaction rec-
ognition system. The system performs background subtraction to separate the foreground
image from the background, extracts standing human objects and generates a one-dimensional
binary image sequence. The TSV transform takes the one-dimensional image sequence and


Source: Aggarwal, J. K. - Department of Electrical and Computer Engineering, University of Texas at Austin


Collections: Computer Technologies and Information Sciences; Engineering