PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Thoughts on evaluation of image retrieval inspired by ImageCLEF 2007 object retrieval task
Ville Viitaniemi and Jorma Laaksonen
In: 3rd MUSCLE/ImageCLEF Workshop on Image and Video Retrieval Evaluation, Budapest, Hungary(2007).

Abstract

In this paper we discuss questions on information retrieval evaluation brought up by the analysis of the recent ImageCLEF 2007 object retrieval task. We question the adequacy of the pooling strategy used in this evaluation and discuss pooling in general. We also argue that use of MAP to rank the participants is not very meaningful in this case. Instead, the result of each query should be considered separately.

EPrint Type:Conference or Workshop Item (Oral)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Information Retrieval & Textual Information Access
ID Code:3297
Deposited By:Ville Viitaniemi
Deposited On:07 February 2008

[Edit]