Transformer-based language models for mental health issues: A survey

Candida Maria Greco, Andrea Simeri, Andrea Tagarelli, Ester Zumpano

Abstract: Highlights•To overview Transformer models used for text-based mental health issue identification.•To characterize the methods based on Transformers developed in the past few years.•To highlight opportunities and challenges of the methods in addressing mental issues.