PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Asymptotically optimal regularization in smooth parametric models
Percy Liang, Francis Bach, Guillaume Bouchard and Michael Jordan
In: NIPS 2009(2009).


Many types of regularization schemes have been employed in statistical learning, each motivated by some assumption about the problem domain. In this paper, we present a unified asymptotic analysis of smooth regularizers, which allows us to see how the validity of these assumptions impacts the success of a particular regularizer. In addition, our analysis motivates an algorithm for optimizing regularization parameters, which in turn can be analyzed within our framework. We apply our analysis to several examples, including hybrid generative-discriminative learning and multi-task learning.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Theory & Algorithms
ID Code:6009
Deposited By:Francis Bach
Deposited On:08 March 2010