PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Efficient algorithms for max-margin structured classification
Craig Saunders, Sandor Szedmak, John Shawe-Taylor and Juho Rousu
In: Predicting Structured Data Neural Information Processing . (2007) MIT Press , Cambridge, Usa , pp. 105-128. ISBN 0262026178


We present a general and efficient optimization methodology for max-margin structured classification tasks. The efficiency of the method relies on the interplay of several techniques: formulation of the structured support vector machine or max-margin Markov problem as an optimization problem; marginalization of the dual of the optimization; partial decomposition via a gradient formulation; and finally tight coupling of a maximum likelihood inference algorithm into the optimization algorithm, as opposed to using inference as a working set maintenance mechanism only. The tight coupling also allows fast approximate inference to be used effectively in the learning. The generality of the method follows from the fact that changing the output structure in essence only changes the inference algorithm, that is, the method can to a large extent be used in a `plug and play' fashion.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Book Section
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Theory & Algorithms
Information Retrieval & Textual Information Access
ID Code:2272
Deposited By:Juho Rousu
Deposited On:13 October 2006