PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Give Me a Sign : A Person Independent Interactive Sign Dictionary
Helen Cooper, Eng-Jon Ong and Richard Bowden
(2011) Technical Report. CVSSP, University of Surrey, Guildford, UK.


This paper presents a method to perform person independent sign recognition. This is achieved by implementing generalising features based on sign linguistics. These are combined using two methods. The first is traditional Markov models, which are shown to lack the required generalisation. The second is a discriminative approach called Sequential Pattern Boosting, which combines feature selection with learning. The resulting system is introduced as a dictionary application, allowing signers to query by performing a sign in front of a Kinect. Two data sets are used and results shown for both, with the query-return rate reaching 99.9\% on a 20 sign multi-user dataset and 85.1\% on a more challenging and realistic subject independent, 40 sign test set.

EPrint Type:Monograph (Technical Report)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
Learning/Statistics & Optimisation
ID Code:9010
Deposited By:Helen Cooper
Deposited On:21 February 2012