PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

GSML: A unified framework for sparse metric learning
Kaizhu Huang, Yiming Ying and Colin Campbell
In: ICDM 2009, 6 Dec-9 Dec 2009, Miami, FL,USA.


Sparse Metric Learning (SML), capable of learning both a good distance metric and low-dimension representations simultaneously, has received much attention recently. However, performance of existing sparse metric learning approaches is usually limited because they either made some relaxations or targeted the SML objective indirectly. In this paper, we propose a Generalized Sparse Metric Learning method (GSML). This novel framework offers a unified view for understanding many of the popular sparse metric learning algorithms including the Sparse Metric Learning framework proposed in [15], the Large Margin Nearest Neighbor (LMNN) [21][22], and the D-ranking Vector Machine (D-ranking VM) [14]. Moreover, GSML also establishes a close relationship with the Pairwise Support Vector Machine [20]. Furthermore, the proposed framework is capable of extending many current non-sparse metric learning models such as Relevant Vector Machine (RCA) [4] and a state-of-the-art method proposed in [23] into their sparse versions. We present the detailed framework, provide theoretical justifications, build various connections with other models, and propose a practical iterative optimization method, making the framework both theoretically important and practically scalable for medium or large datasets. A series of experiments show that the proposed approach can outperform previous methods in terms of both test accuracy and dimension reduction, on six real-world benchmark datasets.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:5498
Deposited By:Yiming Ying
Deposited On:09 December 2009