PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Evaluating the Inferential Utility of Lexical-Semantic Resources
Shachar Mirkin, Ido Dagan and Eyal Shnarch
In: EACL 2009, 30 March - 3 April, 2009, Athens, Greece.

Abstract

Lexical-semantic resources are used extensively for applied semantic inference, yet a clear quantitative picture of their current utility and limitations is largely missing. We propose system- and application-independent evaluation and analysis methodologies for resources’ performance, and systematically apply them to seven prominent resources. Our findings identify the currently limited recall of available resources, and indicate the potential to improve performance by examining non-standard relation types and by distilling the output of distributional methods. Further, our results stress the need to include auxiliary information regarding the lexical and logical contexts in which a lexical inference is valid, as well as its prior validity likelihood.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Natural Language Processing
ID Code:4363
Deposited By:Shachar Mirkin
Deposited On:01 July 2009