Spectral emotion profile

Pouria Fewzee, Fakhri Karray

Abstract: Proposed in this work is the notion of spectral emotion profile. The purpose of spectral emotion profile is to highlight the spectral differences of individuals in expressing emotions, and to make use of those differences towards personalizing recognition of emotions in speech. To define spectral emotion profile, we have taken advantage of the spectral energy distribution as a set of speech features. To demonstrate the idea in a more sensible way, we have made use of two emotional speech datasets. Results of our experimental study based on the proposed notion of spectral emotion profile show how different spectral intervals of individual speakers, as well as those of different genders, vary in the amount to which they contribute to the expression of emotions. It is also shown that using spectral emotion profile results in higher prediction accuracy.