AcCompl-it @ EVALITA2020: overview of the acceptability & complexity evaluation task for Italian

Dominique Brunato, Cristiano Chesi, Felice Dell'Orletta, Simonetta Montemagni, Giulia Venturi, Roberto Zamparelli

Abstract: The Acceptability and Complexity eval-uation task for Italian (AcCompl-it) wasaimed at developing and evaluating meth-ods to classify Italian sentences accordingto Acceptability and Complexity. It con-sists of two independent tasks asking par-ticipants to predict either the acceptabil-ity or the complexity rate (or both) of agiven set of sentences previously scoredby native speakers on a 1-to-7 points Lik-ert scale. In this paper, we introduce thedatasets distributed to the participants, wedescribe the different approaches of theparticipating systems and provide a firstanalysis of the obtained results.