PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Improving Text Categorization Bootstrapping via Unsupervised Learning
Alfio Gliozzo, Carlo STRAPPARAVA and Ido Dagan
ACM Transactions on Speech and Language Processing (TSLP) Volume 6, Number 1, pp. 1-24, 2009. ISSN 1550-4875


We propose a text-categorization bootstrapping algorithm in which categories are described by relevant seed words. Our method introduces two unsupervised techniques to improve the initial categorization step of the bootstrapping scheme: (i) using latent semantic spaces to estimate the similarity among documents and words, and (ii) the Gaussian mixture algorithm, which differentiates relevant and nonrelevant category information using statistics from unlabeled examples. In particular, this second step maps the similarity scores to class posterior probabilities, and therefore reduces sensitivity to keyword-dependent variations in scores. The algorithm was evaluated on two text categorization tasks, and obtained good performance using only the category names as initial seeds. In particular, the performance of the proposed method proved to be equivalent to a pure supervised approach trained on 70--160 labeled documents per category.

EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Natural Language Processing
Information Retrieval & Textual Information Access
ID Code:6678
Deposited By:Ido Dagan
Deposited On:08 March 2010