PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Towards automated visualization and analysis of signed language prosody: Method and linguistic issues
Tommi Jantunen, Markus Koskela, Jorma Laaksonen and Päivi Rainò
In: Proceedings of 5th International Conference on Speech Prosody, 11-14 May 2010, Chicago, Illinois.


This paper presents a semi-automatic method for the visualization and analysis of motion in signed language from a digital video. The method detects the different parts of the signer's bare skin on the video, tracks the motion of the different parts of the body and represents the frame-wise motion of the parts of the body with statistical descriptors. Results of an experiment are demonstrated and discussed. The main linguistic issue deals with the relationship between signs and transitional sequences. Evidence is provided for the claim that lexical-phonological and transitional sequences are qualitatively different in terms of their motion characteristics.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
User Modelling for Computer Human Interaction
ID Code:7991
Deposited By:Markus Koskela
Deposited On:17 March 2011