PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Variational Bayes learning from relevant tasks only
Jaakko Peltonen, Yusuf Yaslan and Samuel Kaski
In: NIPS 2008 Learning from Multiple Sources Workshop, 13 Dec 2008, Whistler, Canada.


We extend our recent work on relevant subtask learning, a new variant of multi-task learning where the goal is to learn a good classifier for a task-of-interest with too few training samples, by exploiting "supplementary data" from several other tasks. It is crucial to model the uncertainty about which of the supplementary data samples are relevant for the task-of-interest, that is, which samples are classified in the same way as in the task-of-interest. We have shown that the problem can be solved by careful mixture modeling: all tasks are modeled as mixtures of relevant and irrelevant samples, and the model for irrelevant samples is flexible enough so that the relevant model only needs to explain the relevant data. Previously we used simple maximum likelihood learning; now we extend the method to variational Bayes inference more suitable for high-dimensional data. We compare the method experimentally to a recent multi-task learning method and two naive methods.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Poster)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Theory & Algorithms
ID Code:4231
Deposited By:Jaakko Peltonen
Deposited On:07 December 2008