PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Pinview: Implicit Feedback in Content-Based Image Retrieval
Peter Auer, Zakria Hussain, Samuel Kaski, Arto Klami, Jussi Kujala, Jorma Laaksonen, Alex Leung, Kitsuchart Pasupa and John Shawe-Taylor
In: International Conference on Machine Learning (ICML'2010) Workshop on Reinforcement Learning and Search in Very Large Spaces, 25 June 2010, Haifa, Israel.


This paper describes Pinview, a contentbased image retrieval system that exploits implicit relevance feedback during a search session. The goal is to retrieve interesting images and the relevance feedback could be eye movements or clicks on the images. Pinview contains several novel methods that infer the intent of the user. From relevance feedback and visual features of images Pinview learns a similarity metric between images which depends on the current interests of the user. It then retrieves images with a specialized reinforcement learning algorithm that balances the tradeo between exploring new images and exploiting the already inferred interests of the user. In practise, Pinview is integrated to the content-based image retrieval system PicSOM, so it is possible to apply it to realworld image databases. Preliminary experiments show that eye movements provide a rich input modality from which it is possible to learn the interests of the user.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Multimodal Integration
Theory & Algorithms
Information Retrieval & Textual Information Access
ID Code:8259
Deposited By:Kitsuchart Pasupa
Deposited On:28 June 2011