Heterogeneous Face Recognition Using Inter-Session Variability Modelling

Tiago de Freitas Pereira, Sébastien Marcel

Abstract: The task of Heterogeneous Face Recognition consists in to match face images that were sensed in different modalities, such as sketches to photographs, thermal images to photographs or near infrared to photographs. In this preliminary work we introduce a novel and generic approach based on Inter-session Variability Modelling to handle this task. The experimental evaluation conducted with two different image modalities showed an average rank-1 identification rates of 96.93% and 72.39% for the CUHK-CUFS (Sketches) and CASIA NIR-VIS 2.0 (Near infrared) respectively. This work is totally reproducible and all the source code for this approach is made publicly available.