Vision-based estimation of fatigue and engagement in cognitive training sessions

Yanchen Wang, Adam Turnbull, Yunlong Xu, Kathi L. Heffner, Feng Vankee Lin, Ehsan Adeli

Abstract: Highlights•Scalable real-time mental fatigue prediction from video-recorded facial expressions•Novel RVT model, combining a clip-wise transformer with a session-wise RNN classifier•New Gesture-Induced Fatigue Scores (GIFS) metric to quantify effective CCT engagement•Accurate rating of mental fatigue, objectively validated (using reaction time)