PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Consistency of spectral clustering
Ulrike v. Luxburg, Mikhail Belkin and Olivier Bousquet
Annals of Statistics Volume ???, Number ???, 2005.


Consistency is a key property of statistical algorithms when the data is drawn from some underlying probability distribution. Surprisingly, despite decades of work, little is known about consistency of most clustering algorithms. In this paper we investigate consistency of the popular family of spectral clus- tering algorithms, which clusters the data with the help of eigenvectors of graph Laplacian matrices. We develop new methods to establish that for increasing sample size, those eigenvectors converge to the eigenvectors of certain limit operators. As a result we can prove that one of the two ma jor classes of spec- tral clustering (normalized clustering) converges under very general conditions, while the other (unnormalized clustering) is only consistent under strong ad- ditional assumptions, which are not always satisfied in real data. We conclude that our analysis provides strong evidence for the superiority of normalized spectral clustering.

EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Theory & Algorithms
ID Code:3904
Deposited By:Ulrike Von Luxburg
Deposited On:25 February 2008