PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Feature Vector Quality and Distributional Similarity
Maayan Geffet and Ido Dagan
Proceedings of Coling 2004 pp. 247-254, 2004.


We suggest a new goal and evaluation criterion for word similarity measures. The new criterion - meaning-entailing substitutability - fits the needs of semantic-oriented NLP applications and can be evaluated directly (independent of an application) at a good level of human agreement. Motivated by this semantic criterion we analyze the empirical quality of distributional word feature vectors and its impact on word similarity results, proposing an objective measure for evaluating feature vector quality. Finally, a novel feature weighting and selection function is presented, which yields superior feature vectors and better word similarity performance.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Natural Language Processing
Information Retrieval & Textual Information Access
ID Code:266
Deposited By:Maayan Geffet
Deposited On:23 November 2004