PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Compact approximations to Bayesian predictive distributions
Ed Snelson and Zoubin Ghahramani
In: ICML 2005, 7-11 Aug 2005, Bonn, Germany.


We provide a general framework for learning precise, compact, and fast representations of the Bayesian predictive distribution for a model. This framework is based on minimizing the KL divergence between the true predictive density and a suitable compact approximation. We consider various methods for doing this, both sampling based approximations, and deterministic approximations such as expectation propagation. These methods are tested on a mixture of Gaussians model for density estimation and on binary linear classification, with both synthetic data sets for visualization and several real data sets. Our results show significant reductions in prediction time and memory footprint.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:1148
Deposited By:Ed Snelson
Deposited On:12 November 2005