Tokengram_F, a Fast and Accurate Token-based chrF++ Derivative

Sören Dreano, Derek Molloy, Noel Murphy

Abstract: Tokengram_F is an F-score-based evaluation metric for Machine Translation that is heavily in- spired by chrF++ and can act as a more accurate replacement. By replacing word n-grams with n-grams obtained from tokenization algorithms, tokengram_F better captures similarities between words.