PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Approximate inference techniques with expectation constraints
Tom Heskes, Manfred Opper, Wim Wiegerinck, Ole Winther and Onno Zoeter
Journal of Statistical Mechanics 2005.


This article discusses inference problems in probabilistic graphical models that often occur in a machine learning setting. In particular it presents a unified view of several recently proposed approximation schemes. Expectation consistent approximations and expectation propagation are both shown to be related to Bethe free energies with weak consistency constraints, i.e.\ free energies where local approximations are only required to agree on certain statistics instead of full marginals.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:1847
Deposited By:Manfred Opper
Deposited On:29 November 2005