PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Non-sparse Multiple Kernel Learning for Fisher Discriminant Analysis
Fei Yan, Josef Kittler, Krystian Mikolajczyk and Muhammad Tahir
In: IEEE International Conference on Data Mining 2009, 6-9 Dec 2009, Miami, US.


We consider the problem of learning a linear combination of pre-specified kernel matrices in the Fisher discriminant analysis setting. Existing methods for such a task impose an L1 norm regularisation on the kernel weights, which produces sparse solution but may lead to loss of information. In this paper, we propose to use L2 norm regularisation instead. The resulting learning problem is formulated as a semi-infinite program and can be solved efficiently. Through experiments on both synthetic data and a very challenging object recognition benchmark, the relative advantages of the proposed method and its L1 counterpart are demonstrated, and insights are gained as to how the choice of regularisation norm should be made.

EPrint Type:Conference or Workshop Item (Oral)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
Learning/Statistics & Optimisation
Multimodal Integration
ID Code:6211
Deposited By:Fei Yan
Deposited On:08 March 2010