PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Combining a Filter Method with SVMs
Thomas N. Lal, Olivier Chapelle and Bernhard Schölkopf
In: Feature Extraction, Foundations and Applications (2006) Springer-Verlag , Berlin/Heidelberg, Germany , pp. 439-445.


Our goal for the competition (feature selection competition NIPS 2003) was to evaluate the usefulness of simple machine learning techniques. We decided to use the correlation criteria as a feature selection method and Support Vector Machines for the classification part. Here we explain how we chose the regularization parameter C of the SVM, how we determined the kernel parameter and how we estimated the number of features used for each data set. All analyzes were carried out on the training sets of the competition data. We choose the data set Arcene as an example to explain the approach step by step. In our view the point of this competition was the construction of a well performing classifier rather than the systematic analysis of a specific approach. This is why our search for the best classifier was only guided by the described methods and that we deviated from the road map at several occasions. All calculations were done with the software Spider [2004].

EPrint Type:Book Section
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:2599
Deposited By:Bernhard Schölkopf
Deposited On:22 November 2006