PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Suboptimal behaviour of Bayes and MDL in classification under misspecification
Peter Grünwald and John Langford
In: Seventeenth Annual Conference on Computational Learning Theory (COLT 2004), 8-11 July 2004, Banff, Canada.


We show that the MDL Principle and the Bayesian posterior in a form often applied to classification problems can be {\em inconsistent}. This means there exists a learning problem such that for all amounts of data the generalization error of the classifier selected by MDL or the Bayesian posterior remains bounded away from the smallest achievable generalization error.

Postscript - Requires a viewer, such as GhostView
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Theory & Algorithms
ID Code:165
Deposited By:Peter Grünwald
Deposited On:03 June 2004