A semi-automatic annotation methodology that combines Summarization and Human-In-The-Loop to create disinformation detection resources

Alba Bonet-Jover, Robiert Sepúlveda-Torres, Estela Saquete, Patricio Martínez-Barco

Abstract: Highlights•Developing of an assisted annotation methodology with summaries and human in the loop.•Building of a reliability dataset of Spanish news applying the methodology.•The assisted system increases annotator efficacy and speed, with fewer examples.•The methodology benefits from a balance between annotation time reduction/accuracy.•The reliability dataset is applied to veracity detection task.