LexMatcher: Dictionary-centric Data Curation for LLM-based Machine Translation
Abstract: The fine-tuning of open-source large language models (LLMs) for machine translation has recently received considerable attention, marking a shift towards data-centric research from traditional neural machine translation. However, the area of data collection for instruction fine-tuning in machine translation remains relatively underexplored. In this paper, we present LexMatcher, a simple yet effective method for data curation, the design of which is driven by the coverage of senses found in bilingual dictionaries.
The construction process comprises data retrieval from an existing corpus and data augmentation that supplements the infrequent senses of polysemous words. Utilizing LLaMA2 as our base model, our approach outperforms the established baselines on the WMT2022 test sets and also exhibits remarkable performance in tasks related to word sense disambiguation and specialized terminology translation.
These results underscore the effectiveness of LexMatcher in enhancing LLM-based machine translation.
Paper Type: Long
Research Area: Machine Translation
Research Area Keywords: efficient MT training, multilingual MT
Contribution Types: NLP engineering experiment
Languages Studied: English, German, Chinese, Russian
Submission Number: 4915
Loading