PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Word Features for Latent Dirichlet Allocation
James Petterson, Alex Smola, Tiberio Caetano, Wray Buntine and Shravan Narayanamurthy
In: NIPS, 6-11 Dec 2010, Vancouver, Canada.


We extend Latent Dirichlet Allocation (LDA) by explicitly allowing for the encoding of side information in the distribution over words. This results in a variety of new capabilities, such as improved estimates for infrequently occurring words, as well as the ability to leverage thesauri and dictionaries in order to boost topic cohesion within and across languages. We present experiments on multi-language topic synchronisation where dictionary information is used to bias corresponding words towards similar topics. Results indicate that our model substantially improves topic cohesion when compared to the standard LDA model.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Poster)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Information Retrieval & Textual Information Access
ID Code:7238
Deposited By:James Petterson
Deposited On:14 March 2011