PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Sparse multinomial kernel discriminant analysis (sMKDA)
Robert Harrison and Kitsuchart Pasupa
Pattern Recognition Volume 42, Number 9, pp. 1795-1802, 2008.


Dimensionality reduction via canonical variate analysis (CVA) is important for pattern recognition and has been extended variously to permit more flexibility, e.g. by “kernelizing” the formulation. This can lead to over-fitting, usually ameliorated by regularization. Here, a method for sparse, multinomial kernel discriminant analysis (sMKDA) is proposed, using a sparse basis to control complexity. It is based on the connection between CVA and least-squares, and uses forward selection via orthogonal least-squares to approximate a basis, generalizing a similar approach for binomial problems. Classification can be performed directly via minimum Mahalanobis distance in the canonical variates. sMKDA achieves state-of-the-art performance in terms of accuracy and sparseness on 11 benchmark datasets.

EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:4575
Deposited By:Kitsuchart Pasupa
Deposited On:08 March 2010