PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Hello! My name is... Buffy -- automatic naming of characters in TV video
Mark Everingham, Josef Sivic and Andrew Zisserman
In: BMVC 2006, 4-7 September 2006, Edinburgh, UK.


We investigate the problem of automatically labelling appearances of characters in TV or film material. This is tremendously challenging due to the huge variation in imaged appearance of each character and the weakness and ambiguity of available annotation. However, we demonstrate that high precision can be achieved by combining multiple sources of information, both visual and textual. The principal novelties that we introduce are: (i) automatic generation of time stamped character annotation by aligning subtitles and transcripts; (ii) strengthening the supervisory information by identifying when characters are speaking; (iii) using complementary cues of face matching and clothing matching to propose common annotations for face tracks. Results are presented on episodes of the TV series "Buffy the Vampire Slayer".

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
ID Code:2192
Deposited By:Mudigonda Pawan Kumar
Deposited On:09 September 2006