Automatic music summarization based on music structure analysis

Xi Shao, Namunu C. Maddage, Changsheng Xu, Mohan S. Kankanhalli

Abstract: In this paper, we present a novel approach for music summarization based on music structure analysis. From the audio signal, we first extract the note onset representing the time tempo of the song and the music structure analysis can be performed based on this tempo information. After music content has been structured into different semantic regions such as introduction (intro), verse, chorus, ending (outro), etc., the final music summary can be created with chorus and music phrases which are included anterior or posterior to the selected chorus to get the desired length of the final summary. In this way, we can guarantee that the summaries begin and end at meaningful music phrase boundaries, which is a difficult problem for existing music summarization methods. Experiments show our proposed method can capture the main theme of the music compared to the ideal summaries selected by music experts and user subjective evaluation indicates our proposed method has a good performance.