A spatio-temporal network for video semantic segmentation in surgical videos

Maria Grammatikopoulou, Ricardo Sanchez-Matilla, Felix J. S. Bragman, David Owen, Lucy Culshaw, Karen Kerr, Danail Stoyanov, Imanol Luengo

Abstract: Semantic segmentation in surgical videos has applications in intra-operative guidance, post-operative analytics and surgical education. Models need to provide accurate predictions since temporally inconsistent identification of anatomy can hinder patient safety. We propose a novel architecture for modelling temporal relationships in videos to address these issues.