PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Online Entropy-based Model of Lexical Category Acquisition
Grzegorz Chrupala and Afra Alishahi
In: Fourteenth Conference on Computational Natural Language Learning, 15-16 July 2010, Uppsala, Sweden.


Children learn a robust representation of lexical categories at a young age. We pro- pose an incremental model of this process which efficiently groups words into lexi- cal categories based on their local context using an information-theoretic criterion. We train our model on a corpus of child- directed speech from CHILDES and show that the model learns a fine-grained set of intuitive word categories. Furthermore, we propose a novel evaluation approach by comparing the efficiency of our induced categories against other category sets (in- cluding traditional part of speech tags) in a variety of language tasks. We show the categories induced by our model typically outperform the other category sets.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
ID Code:7918
Deposited By:Afra Alishahi
Deposited On:17 March 2011