Statistical confidence measures for probabilistic parsing.
Ricardo Sánchez-Sáez, Joan Andreu Sánchez and José Miguel Benedí
In: International Conference on Recent Advances in Natural Language Processing (RANLP '09)(2009).

Abstract

We introduce a formal framework that allows the cal- culation of new purely statistical confidence measures for parsing, which are estimated from posterior proba- bility of constituents. These measures allow us to mark each constituent of a parse tree as correct or incor- rect. Experimental assessment using the Penn Tree- bank shows favorable results for the classical confi- dence evaluation metrics: the CER and the ROC curve. We also present preliminar experiments on application of confidence measures to improve parse trees by au- tomatic constituent relabeling.

[Edit]