Data-driven spatio-temporal RGBD feature encoding for action recognition in operating rooms

Andru Putra Twinanda, Emre O. Alkan, Afshin Gangi, Michel de Mathelin, Nicolas Padoy

Abstract: Context-aware systems for the operating room (OR) provide the possibility to significantly improve surgical workflow through various applications such as efficient OR scheduling, context-sensitive user interfaces, and automatic transcription of medical procedures. Being an essential element of such a system, surgical action recognition is thus an important research area. In this paper, we tackle the problem of classifying surgical actions from video clips that capture the activities taking place in the OR.