PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Learning Relevant Eye MovementFeature Spaces Across Users
Zakria Hussain, Kitsuchart Pasupa and John Shawe-Taylor
In: ETRA 2010, 22-24 March 2010, Austin, USA.


In this paper we predict the relevance of images based on a lowdimensional feature space found using several users’ eye movements. Each user is given an image-based search task, during which their eye movements are extracted using a Tobii eye tracker. The users also provide us with explicit feedback regarding the relevance of images. We demonstrate that by using a greedy Nystr¨om algorithm on the eye movement features of different users, we can find a suitable low-dimensional feature space for learning. We validate the suitability of this feature space by projecting the eye movement features of a new user into this space, training an online learning algorithm using these features, and showing that the number of mistakes (regret over time) made in predicting relevant images is lower than when using the original eye movement features. We also plot Recall-Precision and ROC curves, and use a sign test to verify the statistical significance of our results.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Information Retrieval & Textual Information Access
ID Code:6614
Deposited By:Zakria Hussain
Deposited On:08 March 2010