|
Example-dependent Basis Vector Selection for Kernel-Based Classifiers
Antti Ukkonen and Marta Arias
In: ECML/PKDD 2010, 20-24 Sep 2010, Barcelona, Spain.
AbstractWe study methods for speeding up classification time of kernel-based classifiers. Existing solutions are based on explicitly seek- ing sparse classifiers during training, or by using budgeted versions of the classifier where one directly limits the number of basis vectors al- lowed. Here, we propose a more flexible alternative: instead of using the same basis vectors over the whole feature space, our solution uses dif- ferent basis vectors in different parts of the feature space. At the core of our solution lies an optimization procedure that, given a set of ba- sis vectors, finds a good partition of the feature space and good subsets of the existing basis vectors. Using this procedure repeatedly, we build trees whose internal nodes specify feature space partitions and whose leaves implement simple kernel classifiers. Experiments suggest that our method reduces classification time significantly while maintaining per- formance. In addition, we propose several heuristics that also perform well. [Edit]
|
