PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

An unsupervised data projection that preserves the cluster structure
Lev Faivishevsky and Jacob Goldberger
Pattern Recognition Letters Volume 33, Number 3, pp. 256-262, 2012.


In this paper we propose a new unsupervised dimensionality reduction algorithm that looks for a projection that optimally preserves the clustering data structure of the original space. Formally we attempt to find a projection that maximizes the mutual information between data points and clusters in the projected space. In order to compute the mutual information, we neither assume the data are given in terms of distributions nor impose any parametric model on the within-cluster distribution. Instead, we utilize a non-parametric estimation of the average cluster entropies and search for a linear projection and a clustering that maximizes the estimated mutual information between the projected data points and the clusters. The improved performance is demonstrated on both synthetic and real world examples.

EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
ID Code:8802
Deposited By:Jacob Goldberger
Deposited On:21 February 2012