PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

“Here’s looking at you, kid.” Detecting people looking at each other in videos
M. Marin-Jimenez, Andrew Zisserman and Vittorio Ferrari
In: BMVC 2011, 29 August - 2 September 2011, Dundee.


The objective of this work is to determine if people are interacting in TV video by detecting whether they are looking at each other or not. We determine both the temporal period of the interaction and also spatially localize the relevant people. We make the following three contributions: (i) head pose estimation in unconstrained scenarios (TV video) using Gaussian Process regression; (ii) propose and evaluate several methods for assessing whether and when pairs of people are looking at each other in a video shot; and (iii) introduce new ground truth annotation for this task, extending the TV Human Interactions Dataset [22]. The peformance of the methods is evaluated on this dataset, which consists of 300 video clips extracted from TV shows. Despite the variety and difficulty of this video material, our best method obtains an average precision of 86:2%.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
ID Code:8324
Deposited By:Sunando Sengupta
Deposited On:20 October 2011