PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Improving ranking by respecting the multidimensionality and uncertainty of user preferences
Bettina Berendt and Veit Köppen
In: Intelligent Information Access (2010) Springer , pp. 39-56.


Rankings and ratings are popular methods for structuring large information sets in search engines, e-Commerce, e-Learning, etc. But do they produce the right rankings for their users? In this paper, we give an overview of major evaluation approaches for rankings as well as major challenges facing the use and usability of rankings. We point out the importance of an interdisciplinary perspective for a truly user-centric evaluation of rankings.We then focus on two central problems: the multidimensionality of the criteria that influence both users’ and systems’ rankings, and the randomness inherent in users’ preferences. We propose multi-criteria decision analysis and the integration of randomness into rankings as solution approaches to these problems. We close with an outlook on new challenges arising for ranking when systems address not only individuals, but also groups.

EPrint Type:Book Section
Project Keyword:Project Keyword UNSPECIFIED
Subjects:User Modelling for Computer Human Interaction
Information Retrieval & Textual Information Access
ID Code:8057
Deposited By:Bettina Berendt
Deposited On:17 March 2011