PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Adjusted Viterbi training for hidden Markov models
Alexey Koloydenko and Jüri Lember
(2005) Technical Report. Eurandom, Eindhoven, The Netherlands.

Abstract

We consider estimation of the emission parameters in hidden Markov models. Commonly, one uses the EM algorithm for this purpose. However, our primary motivation is the Philips speech recognition system wherein the EM algorithm is replaced by the Viterbi training algorithm. Viterbi training is faster and computationally less involved than EM, but it is also biased and need not even be consistent. For this reason we propose an alternative to the Viterbi training -- adjusted Viterbi training -- that has the same order of computational complexity as Viterbi training but gives more accurate estimators. Elsewhere, we studied the adjusted Viterbi training for a special case of mixtures with relevant simulations ascertaining the theory. This paper shows how the adjusted Viterbi training is also possible for more general hidden Markov models.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Monograph (Technical Report)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Speech
Theory & Algorithms
ID Code:1967
Deposited By:Alexei Koloidenko
Deposited On:02 January 2006