Gaze-probe joint guidance with multi-task learning in obstetric ultrasound scanning

Qianhui Men, Clare Teng, Lior Drukker, Aris T. Papageorghiou, J. Alison Noble

Abstract: Highlights•New multimodal approach for online US guidance by incorporating operator eye gaze.•Multi-task Learning for probe and gaze that simulates human decision-making process.•Random variables that account for inter- and intra-sonographer variations.•Feasibility on common obstetric examinations under practical guidance policies.