PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Sparse Feature Extraction using Generalised Partial Least Squares
Charanpal Dhanjal, Steve Gunn and John Shawe-Taylor
In: 2006 IEEE International Workshop on Machine Learning For Signal Processing, 6-8 Sept 2006, Maynooth, Ireland.

There is a more recent version of this eprint available. Click here to view it.


We describe a general framework for feature extraction based on the deflation scheme used in Partial Least Squares (PLS). The framework provides many desirable properties, such as conjugacy and efficient computation of the resulting features. When the projection vectors are constrained in a certain way, the resulting features have dual representations. Using the framework, we derive two new sparse feature extraction algorithms, Sparse Maximal Covariance (SMC) and Sparse Maximal Alignment (SMA). These algorithms produce features which are competitive with those extracted by Kernel Boosting, Boosted Latent Features (BLF) and sparse kernel PLS on several UCI datasets. Furthermore, the sparse algorithms are shown to improve the performance of an SVM on a sample of the Reuters Corpus Volume 1 dataset.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Theory & Algorithms
ID Code:2660
Deposited By:Charanpal Dhanjal
Deposited On:22 November 2006

Available Versions of this Item