PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

A note on the evidence and Bayesian Occam's razor
Iain Murray and Zoubin Ghahramani
(2005) Technical Report. Gatsby Unit Technical Report, London, UK.


In his thesis MacKay introduced a figure explaining how Bayes rule provides an automatic "Occam’s razor" effect, penalizing unnecessarily complex models. This figure has been adopted by several authors in the same schematic form. Here, after briefly reviewing necessary material, we compute a realization of the plot for a toy data modeling problem. We discuss interesting aspects of this plot and their implications for understanding model complexity.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Monograph (Technical Report)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
ID Code:1165
Deposited By:Iain Murray
Deposited On:19 November 2005