Discriminative Training of 150 Million Translation Parameters and Its Application to PruningDownload PDF

2013 (modified: 16 Jul 2019)HLT-NAACL 2013Readers: Everyone
Abstract: Until recently, the application of discriminative training to log linear-based statistical machine translation has been limited to tuning the weights of a limited number of features or training features with a limited number of parameters. In this paper, we propose to scale up discriminative training of (He and Deng, 2012) to train features with 150 million parameters, which is one order of magnitude higher than previously published effort, and to apply discriminative training to redistribute probability mass that is lost due to model pruning. The experimental results confirm the effectiveness of our proposals on NIST MT06 set over a strong baseline.
0 Replies

Loading