Abstract
In statistical machine translation, large numbers of parallel sentences are required to train the model parameters. However, plenty of the bilingual language resources available on web are aligned only at the document level. To exploit this data, we have to extract the bilingual sentences from these documents. The common method is to break the documents into segments using predefined anchor words, then these segments are aligned. This approach is not error free, incorrect alignments may decrease the translation quality. We present an alternative approach to extract the parallel sentences by partitioning a bilingual document into two pairs. This process is performed recursively until all the sub-pairs are short enough. In experiments on the Chinese-English FBIS data, our method was capable of producing translation results comparable to those of a state-of-the-art sentence aligner. Using a combination of the two approaches leads to better translation performance.
Original language | English |
---|---|
Pages | 78-85 |
Number of pages | 8 |
State | Published - 2006 |
Event | 2006 Workshop on Statistical Machine Translation, WMT 2006, collocated with the HLT-NAACL 2006 - New York City, United States Duration: 8 Jun 2006 → 9 Jun 2006 |
Conference
Conference | 2006 Workshop on Statistical Machine Translation, WMT 2006, collocated with the HLT-NAACL 2006 |
---|---|
Country/Territory | United States |
City | New York City |
Period | 8/06/06 → 9/06/06 |