PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Method for visualisation and analysis of hand and head movements in sign language video
Matti Karppa, Tommi Jantunen, Markus Koskela, Jorma Laaksonen and Ville Viitaniemi
In: 2nd Gesture and Speech in Interaction conference, 5-7 Sep 2011, Bielefeld, Germany.

Abstract

This paper presents a method for the visualisation and motion analysis of hand and head movements in videos containing sign language and gestures. The method detects the parts of the person's bare skin on a video with an adaptive colour model, characterises the shapes of the hands and the head with a point distribution model, and tracks their motion separately by using the Kanade-Lucas-Tomasi algorithm and active shape models. The quantitative results are visualised in ELAN annotation software. The method is demonstrated in the paper in terms of its relevance to the annotation and analysis of sign language.

EPrint Type:Conference or Workshop Item (Oral)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
User Modelling for Computer Human Interaction
ID Code:9123
Deposited By:Markus Koskela
Deposited On:21 February 2012

[Edit]