Texture and artifact decomposition for improving generalization in deep-learning-based deepfake detection

Jie Gao, Marco Micheletto, Giulia Orrù, Sara Concas, Xiaoyi Feng, Gian Luca Marcialis, Fabio Roli

Abstract: Highlights•We build an artifact and texture inconsistency detector for deepfake detection.•Texture coherence is analyzed via a novel mask extraction method and an autoencoder.•The use of an ensemble training strategy improved the ability to generalize.•Extensive experiments verified the effectiveness of the model we built.