YAD: Leveraging T5 for improved automatic diacritization of Yorùbá text

Akindele Michael Olawole, Jesujoba Oluwadara Alabi, Aderonke Busayo Sakpere, David Ifeoluwa Adelani

Keywords: diacritization, Yorùbá, automatic diacritization, T5

Abstract:

In this work we present Yorùbá automatic diacritization (YAD) benchmark dataset for evaluating Yorùbá diacritization systems. In addition, we pre-train text-to-text transformer, T5 model for Yorùbá and showed that this model outperform several multilingually trained T5 models.
Lastly, we showed that more data and bigger models are better at diacritization for Yorùbá

Submission Number: 45