PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Reading the Signs: A Video Based Sign Dictionary
Hellen Cooper, Nicolas Pugeault and Richard Bowden
In: 2nd IEEE Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams (ARTEMIS), Barcelona, Spain(2011).


This article presents a dictionary for Sign Language using visual sign recognition based on linguistic subcomponents. We demonstrate a system where the user makes a query, receiving in response a ranked selection of similar results. The approach uses concepts from linguistics to provide sign sub-unit features and classifiers based on motion, sign-location and handshape. These sub-units are combined using Markov Models for sign level recognition. Results are shown for a video dataset of 984 isolated signs performed by a native signer. Recognition rates reach 71.4\% for the first candidate and 85.9\% for retrieval within the top 10 ranked signs.

EPrint Type:Conference or Workshop Item (Oral)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
ID Code:8947
Deposited By:Helen Cooper
Deposited On:21 February 2012