Text Analysis and Recognition of Emotional Content Using Deep Learning Methods and BERT

Efthymios Andrikakis, Isidoros Perikos, Michael Paraskevas, Ioannis Hatzilygeroudis

Abstract: Recognizing the emotional content of Natural Language sentences can improve the way humans communicate with a computer system by enabling them to recognize and imitate emotional expressions. In this paper, deep learning, deep neural networks as well as Transformers were examined. Specifically, we designed and developed deep learning methods and BERT-based implementations for recognizing emotional content in user-generated data. Extensive experiments were conducted using these models on a variety of textual data and all the designed methods were evaluated. The results of the study show that BERT achieved the best overall performance, getting an F1-score of 0.86 on the Twitter Data dataset. Also, the Bi-LSTM with Attention Mechanism and Bi-LSTM using Word2vec performed quite well, achieving F1-scores of 0.83 and 0.82, respectively.