Random projections for assessing gene expression cluster stability
Alberto Bertoni and Giorgio Valentini
In: IJCNN2005, The IEEE-INNS International Joint Conference on Neural Networks, 31 Jul - 04 Aug 2005, Montreal, Canada.
Clustering analysis of gene expression is characterized by the very high dimensionality and low
cardinality of the data, and two important related topics are the validation and the estimate of the number of the obtained clusters.
In this paper we focus on the estimate of the stability of the clusters.
Our approach to this problem is based on random projections obeying the Johnson-Lindenstrauss lemma,
by which gene expression data may be projected into randomly selected low dimensional subspaces,
approximately preserving pairwise distances between examples.
We experiment with different types of random projections, comparing empirical and theoretical distortions induced by randomized
embeddings between euclidean metric spaces, and
we present cluster-stability measures that may be used to validate and to quantitatively assess the reliability of the clusters
obtained by a large class of clustering algorithms.
Experimental results with high dimensional synthetic and DNA microarray data show the effectiveness of the proposed approach.