PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Gaze shift behavior on video as composite information foraging
Giuseppe Boccignone and Mario Ferraro
Signal Processing: Image Communication pp. 1-18, 2012. ISSN 0923-5965


The ability to predict, given an image or a video, where a human might fixate elements of a viewed scene has long been of interest in the vision community. However, one point that is not addressed by the great majority of computational models is the variability exhibited by different observers when viewing the same scene, or even by the same subject along different trials. Here we present a model of gaze shift behavior which is driven by a composite foraging strategy operating over a time varying visual landscape and accounts for such variability. The system performs a deterministic walk if in a neighborhood of the current position of the gaze there exists a point of sufficiently high saliency; otherwise the search is driven by a Langevin equation whose random term is generated by an a-stable distribution. Results of the simulations on complex videos from the publicly available University of South California CRCNS eye-1 dataset are compared with eye-tracking data and show that the model yields gaze shift motor behaviors that exhibits statistics similar to those exhibited by human observers.

EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
User Modelling for Computer Human Interaction
Learning/Statistics & Optimisation
ID Code:9608
Deposited By:Giuseppe Boccignone
Deposited On:01 December 2012