An Evaluation Tool for Machine Translation: Fast Evaluation for MT Research

Sonja Nießen, Franz Josef Och, Gregor Leusch, Hermann Ney

Abstract: In this paper we present a tool for the evaluation of translation quality. First, the typical requirements of such a tool in the framework of machine translation (MT) research are discussed. We define evaluation criteria which are more adequate than pure edit distance and we describe how the measurement along these quality criteria is performed semi-automatically in a fast, convenient and above all consistent way using our tool and the corresponding graphical user interface.