Generalization of feature embeddings transferred from different video anomaly detection domains

Fernando Pereira dos Santos, Leonardo Sampaio Ferraz Ribeiro, Moacir A. Ponti

Abstract: Highlights • Cross-domain feature space generalization measure quantifies transfer learning. • Simple approach that allows a guideline for feature extraction tools. • Transfer component analysis offers high generalization for video anomaly detection. Abstract Detecting anomalous activity in video surveillance often suffers from limited availability of training data. Transfer learning may close this gap, allowing to use existing annotated data from some source domain. However, analyzing the source feature space in terms of its potential for transfer of learning to another context is still to be investigated. This paper reports a study on video anomaly detection, focusing on the analysis of feature embeddings of pre-trained CNNs with the use of novel cross-domain generalization measures that allow to study how source features generalize for different target video domains. This generalization analysis represents not only a theoretical approach, can be useful in practice as a path to understand which datasets allow better transfer of knowledge. Our results confirm this, achieving better anomaly detectors for video frames and allowing analysis of transfer learning’s positive and negative aspects.