PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Infinite hierarchical hidden Markov models
Katherine Heller, Yee Whye Teh and Dilan Gorur
In: AISTATS 2009, 16-18 April 2009, Florida, USA.


In this paper we present the Infinite Hierarchical Hidden Markov Model (IHHMM), a nonparametric generalization of Hierarchical Hidden Markov Models (HHMMs). HHMMs have been used for modeling sequential data in applications such as speech recognition, detecting topic transitions in video and extracting information from text. The IHHMM provides more flexible modeling of sequential data by allowing a potentially unbounded number of levels in the hierarchy, instead of requiring the specification of a fixed hierarchy depth. Inference and learning are performed efficiently using Gibbs sampling and a modified forward-backtrack algorithm. We present encouraging results on toy sequences and English text data.

EPrint Type:Conference or Workshop Item (Poster)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
ID Code:5348
Deposited By:Dilan Gorur
Deposited On:24 March 2009