A Metric for Sentence Ordering Assessment Based on Topic-Comment Structure

Liana Ermakova, Josiane Mothe, Anton Firsov

Abstract: Sentence ordering (SO) is a key component of verbal ability. It is also crucial for automatic text generation. While numerous researchers developed various methods to automatically evaluate the informativeness of the produced contents, the evaluation of readability is usually performed manually. In contrast to that, we present a self-sufficient metric for SO assessment based on text topic-comment structure. We show that this metric has high accuracy.