PrimateFace: A Machine Learning Resource for Automated Face Analysis in Human and Non-human Primates

Felipe Parodi

Keywords: cross-species, primates, face analysis, computer visio

TL;DR: PrimateFace, a cross-species primate dataset & model suite, shows training on taxonomically diverse data yields useful models that enable scalable & diverse facial communication analysis.

Abstract: Machine learning has revolutionized human face analysis, but equivalent tools for non-human primates remain limited and species-specific, hindering progress in neuroscience, anthropology, and conservation. Here, we present PrimateFace, a comprehensive, cross-species platform for primate facial analysis comprising a systematically curated dataset of 260,000+ images spanning over 60 genera, including a genus-balanced subset of 60,000 images, annotated with bounding boxes and facial landmark configurations. Face detection and facial landmark estimation models trained on PrimateFace achieve high cross-species performance, from tarsiers to gorillas, achieving performance comparable to baseline models trained exclusively on human data (0.34 vs. 0.39 mAP for face detection; 0.061 vs. 0.053 normalized landmark error), demonstrating the generalization benefits of cross-species training. PrimateFace enables diverse downstream applications including individual recognition, gaze analysis, and automated extraction of stereotyped (e.g., lip-smacking) and subtle (e.g., soft left turn) facial movements. PrimateFace provides a standardized platform for analyzing facial communication across the primate order, empowering data-driven studies that advance the health and well-being of human and non-human primates.

Submission Number: 35