PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Machine Translation Using Overlapping Alignments and Sample Rank
Benjamin Roth, Andrew McCallum, Marc Dymetman and Nicola Cancedda
In: Conference of the Association for Machine Translation in the Americas, AMTA 2010, October 31 - November 5, 2010, Denver, Colorado, US..


We present a conditional-random-field approach to discriminatively-trained phrasebased machine translation in which training and decoding are both cast in a sampling framework and are implemented uniformly in a new probabilistic programming language for factor graphs. In traditional phrase-based translation, decoding infers both a "Viterbi" alignment and the target sentence. In contrast,in our approach, a rich overlappingphrase alignment is produced by a fast deterministic method, while probabilistic decoding infers only the target sentence, which is then able to leverage arbitrary features of the entire source sentence, target sentence and alignment. By using SampleRank for learning we could in principle efficiently estimate hundreds of thousands of parameters. Testtime decoding is done by MCMC sampling with annealing. To demonstrate the potential of our approach we show preliminary experiments leveraging alignments that may contain overlapping bi-phrases.

EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Natural Language Processing
ID Code:7187
Deposited By:Nicola Cancedda
Deposited On:08 March 2011