Short Video Interestingness: A Machine Learning Approach to Determine Creative Cues in Audiovisual Production

Claudia Rabaioli, Alessandra Grossi, Francesca Gasparini

Abstract: Models predicting video interestingness often prioritize visual aspects while neglecting audio and the overall audiovisual perspective. They typically depend on less interpretable deep learning techniques to enhance prediction efficiency. Video production usually focuses on grammar analysis of trends and viral content rather than exploring signal behaviour or human perception, which are important in other creative fields. This work aims to develop a model that integrates audio, visual, and audiovisual elements, analyzing key instants based on distinct visual and sound characteristics. Handcrafted features are implemented in order to obtain off-the-shelf cues for audiovisual production, which aspires to create potentially interesting content for the viewers.

External IDs:doi:10.1007/978-3-031-90167-6_25