PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

MDL hierarchical clustering for stemmatology
Po-Hsiang Lai, Teemu Roos and Joseph O'Sullivan
In: 2010 IEEE International Symposium on Information Theory (ISIT-10), 13-18 June 2010, Austin, Texas, USA.


In real life, one often encounters situations where one needs to infer a structural relationship among data points based on an incomplete dataset. Stemmatology and phylogenetics are two classes of such problems where partial text scripts or genome sequences are available and the goal is to reconstruct the copying history of scripts or evolutionary relations among species. In this paper, we study the potential applications of minimum description length (MDL) concepts to the structural inference problem, particularly focusing on stemmatology where in addition to missing data points, the available data points have missing values. We offer new insights on how to handle these issues, especially missing values. We develop a general algorithm based on MDL insights that is simple to implement and can be used along with other existing algorithms, and propose a generic MDL encoder with minimal assumptions made about the data. In simulations, our method performs reasonably well on a simple dataset and outperforms major existing methods in a larger and much more realistic dataset. We discuss directions and ongoing efforts to further improve performance.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Natural Language Processing
ID Code:7287
Deposited By:Teemu Roos
Deposited On:16 March 2011