Applying Human-in-the-Loop to construct a dataset for determining content reliability to combat fake news

Alba Bonet-Jover, Robiert Sepúlveda-Torres, Estela Saquete, Patricio Martínez-Barco, Alejandro Piad-Morffis, Suilan Estevez-Velarde

Abstract: Highlights•A Human-in-the-Loop based methodology is proposed for semi-automatic annotation.•A semi-automatic reliability dataset in Spanish is obtained and validated.•Efficiency and effectiveness in complex annotation tasks is achieved.•Quality annotated resources with high performance are obtained.