Linguistically Inspired Language Model Augmentation for MT

Hits: 3959
Research areas: Year: 2016
Type of Publication: In Proceedings Keywords: corpus-based MT, language model augmentation, extraction of knowledge from corpora
  • George Tambouratzis, Vassiliki Pouli
Book title: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016)
Pages: 573-577
Organization: ELRA Month: 23-28 May
The present article reports on efforts to improve the translation accuracy of a corpus–based Machine Translation (MT) system. In order to achieve that, an error analysis performed on past translation outputs has indicated the likelihood of improving the translation accuracy by augmenting the coverage of the Target-Language (TL) side language model. The method adopted for improving the language model is initially presented, based on the concatenation of consecutive phrases. The algorithmic steps are then described that form the process for augmenting the language model. The key idea is to only augment the language model to cover the most frequent cases of phrase sequences, as counted over a TL-side corpus, in order to maximize the cases covered by the new language model entries. Experiments presented in the article show that substantial improvements in translation accuracy are achieved via the proposed method, when integrating the grown language model to the corpus-based MT system.