"How are you?" Estimation of anxiety, sleep quality, and mood using computational voice analysis

Samuel Kim, Namhee Kwon, Henry O'Connell, Nathan Fisk, Scott Ferguson, Mark Bartlett

Abstract: We developed a method of estimating impactors of cognitive function (ICF) - such as anxiety, sleep quality, and mood - using computational voice analysis. Clinically validated questionnaires (VQs) were used to score anxiety, sleep and mood while salient voice features were extracted to train regression models with deep neural networks. Experiments with 203 subjects showed promising results with significant concordance correlation coefficients (CCC) between actual VQ scores and the predicted scores (0.46 = anxiety, 0.50 = sleep quality, 0.45 = mood).