Language and Translation Model Adaptation using Comparable Corpora

Traditionally, statistical machine translation systems have relied on parallel bi-lingual data to train a translation model. While bi-lingual parallel data are expensive to generate, monolingual data are relatively common. Yet monolingual data have been under-utilized, having been used primarily for training a language model in the target language. This paper describes a novel method for utilizing monolingual target data to improve the performance of a statistical machine translation system on news stories. The method exploits the existence of comparable text--multiple texts in the target language that discuss the same or similar stories as found in the source language document. For every source document that is to be translated, a large monolingual data set in the target language is searched for documents that might be comparable to the source documents. These documents are then used to adapt the MT system to increase the probability of generating texts that resemble the comparable d...

• Type: Conference
• Year: 2008
• Where: EMNLP
• Authors: Matthew G. Snover, Bonnie J. Dorr, Richard M. Schwartz
• Keywords: EMNLP 2008, Monolingual Data, Natural Language Processing, Statistical Machine Translation, Target Language