Workshop on Automatic Evaluation of Learning and Assessment Content

Luca Benedetto, Shiva Taslimipoor, Andrew Caines, Diana Galván-Sosa, George Dueñas, Anastassia Loukina, Torsten Zesch

Abstract: The evaluation of learning and assessment content has always been a crucial task in the educational domain, but traditional approaches based on human feedback are not always usable in modern educational settings. Indeed, the advent of machine learning models, in particular Large Language Models (LLMs), enabled to quickly and automatically generate large quantities of texts, making human evaluation unfeasible. Still, these texts are used in the educational domain – e.g., as questions, hints, or even to score and assess students – and thus the need for accurate and automated techniques for evaluation becomes pressing. This workshop aims to attract professionals from both academia and the industry, and to to offer an opportunity to discuss which are the common challenges in evaluating learning and assessment content in education.