PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Regularized Multi-task Learning
Theodoros Evgeniou and Massimiliano Pontil
In: SIGKDD, 22-25 August 2004, Seattle, USA.

Abstract

Past empirical work has shown that learning multiple related tasks from data simultaneously can be advantageous in terms of predictive performance relative to learning these tasks independently. In this paper we present an approach to multi--task learning based on the minimization of regularization functionals similar to existing ones, such as the one for Support Vector Machines (SVMs), that have been successfully used in the past for single--task learning. Our approach allows to model the relation between tasks in terms of a novel kernel function that uses a task--coupling parameter. We implement an instance of the proposed approach similar to SVMs and test it empirically using simulated as well as real data. The experimental results show that the proposed method performs better than existing multi--task learning methods and largely outperforms single--task learning using SVMs.

PDF - PASCAL Members only - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Additional Information:Multi-task Learning
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Multimodal Integration
Theory & Algorithms
ID Code:825
Deposited By:Theodoros Evgeniou
Deposited On:01 January 2005