PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Approximate inference techniques with expectation constraints
tom heskes, Manfred Opper, Wim Wiegerinck, ole winther and Onno Zoeter
Journal of Statistical Mechanics: Theory and Experiment Number P11015, 2005.


This paper discusses inference problems in probabilistic graphical models that often occur in a machine learning setting. In particular it presents a unified view of several recently proposed approximation schemes. Expectation consistent approximations and expectation propagation are both shown to be related to Bethe free energies with weak consistency constraints, i.e. free energies where local approximations are only required to agree on certain statistics instead of full marginals.

EPrint Type:Article
Additional Information:
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:2752
Deposited By:Wim Wiegerinck
Deposited On:22 November 2006