A multimodal hyperlapse method based on video and songs' emotion alignment

Open Webpage

Diognei de Matos, Washington L. S. Ramos, Michel Melo Silva, Luiz Romanhol, Erickson R. Nascimento

Published: 01 Jan 2023, Last Modified: 22 Oct 2025Pattern Recognit. Lett. 2023EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Highlights•New models for recognizing emotions in images and songs.•A novel optimization algorithm to create hyperlapse matching video and song’s emotion contents.•A new method to select the best song for the video from a list of songs.•A quantitative comparison to other hyperlapse creation methods and curve alignment methods.•A qualitative comparison to other curve alignment methods through a user study.