Delving into CLIP latent space for Video Anomaly Recognition

Luca Zanella, Benedetta Liberatori, Willi Menapace, Fabio Poiesi, Yiming Wang, Elisa Ricci

Abstract: Highlights•Vision and Language Model (VLM) for video anomaly detection and recognition.•VLM feature space transformation using normality prototype for direction learning.•A Selector model using transformed VLM space for robust abnormal segment selection.•A Temporal model capturing short-term frame relations and long-term dependencies.