Bi-Encoder Contrastive Learning for Fingerprint and Iris Biometrics

Matthew So, Judah Goldfeder, Mark Lis, Hod Lipson

Submission Track: Short papers presenting ongoing research or work submitted to other venues (up to 5 pages, excluding references)

Keywords: biometrics, fingerprint recognition, iris recognition, cross-modal matching, bi-encoder, siamese networks, contrastive learning, contrastive loss, deep learning, machine learning, vision transformers

Abstract: There has been a historic assumption that the biometrics of an individual are statistically uncorrelated. We test this assumption by training Bi‑Encoder networks on three verification tasks, including fingerprint-to-fingerprint matching, iris-to-iris matching, and cross-modal fingerprint-to-iris matching using 274 subjects with $\sim$100k fingerprints and 7k iris images. We trained ResNet‑50 and Vision Transformer backbones in Bi-Encoder architectures such that the contrastive loss between images sampled from the same individual is minimized. The iris ResNet reaches 91 ROC AUC score for iris-to-iris matching, providing clear evidence that the left and right irises of an individual are correlated. Fingerprint models reproduce the positive intra‑subject suggested by prior work in this space. This is the first work attempting to use Vision Transformers for this matching. Cross‑modal matching rises only slightly above chance, which suggests that more data and a more sophisticated pipeline is needed to obtain compelling results. These findings continue challenge independence assumptions of biometrics and we plan to extend this work to other biometrics in the future.

Submission Number: 2