PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Renyi Entropy of Marginal distributions
Peter Harremoes and Christophe Vignat
Journal of Multivariate Analysis 2006. ISSN 0047-259X


In this paper we are interested in the n-dimensional uniform distributions on the sphere. We show that the marginal distribution maximizes the Renyi entropy under a moment constraint. Moreover, using an example we show that a distribution on a triangle with (uniform) maximum entropy marginals may have arbitrarily small entropy. As a last result we address the asymptotic behavior and make a link to the de Finetti Theorem.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
ID Code:2741
Deposited By:Peter Harremoes
Deposited On:22 November 2006