PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Ranking and empirical minimization of U-statistics
Stephan Clemencon, Gábor Lugosi and Nicolas Vayatis
Annals of Statistics -159, 2008.


The problem of ranking/ordering instances, instead of simply classifying them, has recently gained much attention in machine learning. In this paper we formulate the \textit{ranking problem} in a rigorous statistical framework. The goal is to learn a ranking rule for deciding, among two instances, which one is ``better,'' with minimum ranking risk. Since the natural estimates of the risk are of the form of a $U$-statistic, results of the theory of $U$-processes are required for investigating the consistency of empirical risk minimizers. We establish, in particular, a tail inequality for degenerate U-processes, and apply it for showing that fast rates of convergence may be achieved under specific noise assumptions, just like in classification. Convex risk minimization methods are also studied.

EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:3931
Deposited By:Gábor Lugosi
Deposited On:25 February 2008