Holistic OR domain modeling: a semantic scene graph approach

Ege Özsoy, Tobias Czempiel, Evin Pinar Örnek, Ulrich Eck, Federico Tombari, Nassir Navab

Abstract: Surgical procedures take place in highly complex operating rooms (OR), involving medical staff, patients, devices and their interactions. Until now, only medical professionals are capable of comprehending these intricate links and interactions. This work advances the field toward automated, comprehensive and semantic understanding and modeling of the OR domain by introducing semantic scene graphs (SSG) as a novel approach to describing and summarizing surgical environments in a structured and semantically rich manner.