PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Asymptotic behaviour of a family of gradient algorithms in $\RR^d$ and Hilbert spaces
Luc Pronzato, Henry P. Wynn and Anatoly A. Zhigljavsky
(2004) Technical Report. Luc Pronzato, Sophia Antipolis.

Abstract

The asymptotic behaviour of a family of gradient algorithms (including the methods of steepest descent and minimum residues) for the optimisation of bounded quadratic operators in $\RR^d$ and Hilbert spaces is analyzed. The results obtained generalize those of Akaike (1959) in several directions. First, all algorithms in the family are shown to have the same asymptotic behaviour (convergence to a two-point attractor), which implies in particular that they have similar asymptotic convergence rates. Second, the analysis also covers the Hilbert space case. A detailed analysis of the stability property of the attractor is provided.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Monograph (Technical Report)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
ID Code:65
Deposited By:Luc Pronzato
Deposited On:14 May 2004