PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

An application of bayesian model averaging to histograms
Rudy Sicard and Thierry Artières
In: CAP 2007, 2-6 Jul 2007, Grenoble (France).

There is a more recent version of this eprint available. Click here to view it.

Abstract

We present a method for learning class posterior probability for one-dimensional input data. It may be used for instance to convert a non probabilistic classifier (e.g. Support Vector Machines) into a probabilistic one or to calibrate a probabilistic classifier. We use the Bayesian Model Averaging method (BMA), which provides a principled way to learn a probability function from data. It achieves an optimal trade-off between complexity and accuracy by averaging over all possible models. Our method is fully non-parametric and relies on the family of histogram models. This family is rich enough to implement arbitrarily close any continuous real function. We show how to perform exact BMA in our case with a dynamic programming algorithm that allows summing over all possible histograms, i.e. number of bins and their boundaries. We provide experimental results that compares the behaviour of our method with other approximation scheme.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:3079
Deposited By:Thierry Artieres
Deposited On:07 December 2007

Available Versions of this Item