PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

A Spectral Regularization Framework for Multi-Task Structure Learning
Andreas Argyriou, Charles A. Micchelli, Massimiliano Pontil and Yiming Ying
In: Advances in Neural Information Processing Systems (NIPS), 3-6 Dec 2007, Vancouver, Canada.

Abstract

Learning the common structure shared by a set of supervised tasks is an important practical and theoretical problem. Knowledge of this structure may lead to better generalization performance on the tasks and may also facilitate learning new tasks. We propose a framework for solving this problem, which is based on regularization with spectral functions of matrices. This class of regularization problems exhibits appealing computational properties and can be optimized ef ciently by an alternating minimization algorithm. In addition, we provide a necessary and suf cient condition for convexity of the regularizer. We analyze concrete examples of the framework, which are equivalent to regularization with Lp matrix norms. Experiments on two real data sets indicate that the algorithm scales well with the number of tasks and improves on state of the art statistical performance.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Spotlight)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Learning/Statistics & Optimisation
ID Code:3420
Deposited By:Andreas Argyriou
Deposited On:10 February 2008