PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Estimating functions for blind source separation when sources have variance dependencies
M Kawanabe and KR Muller
JMLR Volume 6, pp. 453-482, 2005.


A blind separation problem where the sources are not independent, but have variance dependencies ¨is discussed. For this scenario Hyvarinen and Hurri (2004) proposed an algorithm which requires no assumption on distributions of sources and no parametric model of dependencies between com- ponents. In this paper, we extend the semiparametric approach of Amari and Cardoso (1997) to variance dependencies and study estimating functions for blind separation of such dependent sources. In particular, we show that many ICA algorithms are applicable to the variance-dependent model as well under mild conditions, although they should in principle not. Our results indicate that separation can be done based only on normalized sources which are adjusted to have station- ary variances and is not affected by the dependent activity levels. We also study the asymptotic distribution of the quasi maximum likelihood method and the stability of the natural gradient learn- ing in detail. Simulation results of artificial and realistic examples match well with our theoretical findings.

EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:1887
Deposited By:Klaus-Robert Müller
Deposited On:29 December 2005