PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Stable Directed Belief Propagation in Gaussian DAGs using the auxiliary variable trick
David Barber and Peter Sollich
In: Neural Information Processing Systems 2005, 5-10 Dec 2005, Vancouver, Canada.


We consider approximate inference in the important class of large Gaussian distributions corresponding to multiply-connected directed acylic networks. We show how Directed Belief Propagation can be implemented in a numerically stable manner by associating backward (lambda) messages with an auxiliary variable, enabling intermediate computations to be carried out in moment form. We apply our method to the Fast Fourier Transform network with missing data, and show that the results are more accurate than those obtained using Undirected Belief Propagation on the equivalent pairwise Markov network.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
Postscript - Requires a viewer, such as GhostView
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:1016
Deposited By:Peter Sollich
Deposited On:14 July 2005