PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Correlational Spectral Clustering
Matthew Blaschko and Christoph Lampert
In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 24-26 Jun 2008, Anchorage, USA.


We present a new method for spectral clustering with paired data based on kernel canonical correlation analysis, called correlational spectral clustering. Paired data are common in real world data sources, such as images with text captions. Traditional spectral clustering algorithms either assume that data can be represented by a single similarity measure, or by co-occurrence matrices that are then used in biclustering. In contrast, the proposed method uses separate similarity measures for each data representation, and allows for projection of previously unseen data that are only observed in one representation (e.g. images but not text). We show that this algorithm generalizes traditional spectral clustering algorithms and show consistent empirical improvement over spectral clustering on a variety of datasets of images with associated text.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Multimodal Integration
ID Code:4797
Deposited By:Christoph Lampert
Deposited On:24 March 2009