PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

The Fourth PASCAL Recognizing Textual Entailment Challenge
Danilo Giampiccolo, Hoa Trang Dang, Bernardo Magnini, Ido Dagan, Elena Cabrio and Bill Dolan
In: Text Analysis Conference (TAC) 2008, November, 2008, Gaithersburg, MD, USA.


In 2008 the Recognizing Textual Entailment Challenge (RTE-4) was proposed for the first time as a track at the Text Analysis Conference (TAC). Another important innovation introduced in this campaign was a three-judgment task, which required the systems to make a further distinction between pairs where the entailment does not hold because the content of H is contradicted by the content of T, and pairs where the entailment cannot be determined because the truth of H cannot be verified on the basis of the content of T. A classic twoway task was also offered. RTE-4 attracted 26 teams, more than half of whom submitted runs for the new 3-way task. This paper describes the preparation of the dataset, and gives an overview of the results achieved by the participating systems.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Learning/Statistics & Optimisation
Natural Language Processing
ID Code:6681
Deposited By:Ido Dagan
Deposited On:08 March 2010