PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Parametric polynomial time perceptron rescaling algorithm
Andriy Kharechko
In: Algorithms and Complexity in Durham 2006: Proceedings of the Second ACiD Workshop Texts in Algorithmics , 7 . (2006) College Publications, King's College , London, UK , pp. 157-157. ISBN 1-904987-38-9


Let us consider a linear feasibility problem with a possibly infinite number of inequality constraints posed in an on-line setting: an algorithm suggests a candidate solution, and the oracle either confirms its feasibility, or outputs a violated constraint vector. This model can be solved by subgradient optimisation algorithms for non-smooth functions, also known as the perceptron algorithms in the machine learning community, and its solvability depends on the problem dimension and the radius of the constraint set. The classical perceptron algorithm may have an exponential complexity in the worst case when the radius is infinitesimal. To overcome this difficulty, the space dilation technique was exploited in the ellipsoid algorithm to make its running time polynomial. A special case of the space dilation, the rescaling procedure is utilised in the perceptron rescaling algorithm with a probabilistic approach to choosing the direction of dilation. A parametric version of the perceptron rescaling algorithm is the focus of this work. It is demonstrated that some fixed parameters of the latter algorithm (the initial estimate of the radius and the relaxation parameter) may be modified and adapted for particular problems. The generalised theoretical framework allows to determine convergence of the algorithm with any chosen set of values of these parameters, and suggests a potential way of decreasing the complexity of the algorithm which remains the subject of current research.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
Postscript - Requires a viewer, such as GhostView
EPrint Type:Book Section
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Theory & Algorithms
ID Code:2966
Deposited By:Andriy Kharechko
Deposited On:13 March 2007