Spatiotemporal motion prediction in free-breathing liver scans via a recurrent multi-scale encoder decoder

Liset Vazquez Romaguera, Rosalie Plantefeve, Samuel Kadoury

Keywords: motion prediction, liver, MRI, free-breathing, LSTM

TL;DR: Classification-based model for motion field extrapolation

Abstract: In this work we propose a multi-scale recurrent encoder-decoder architecture to predict the breathing induced organ deformation in future frames. The model was trained end-to-end from input images to predict a sequence of motion labels. Targets were created by quantizing the motion fields obtained from deformable image registration. We propose a multi-scale feature extraction scheme in the spatial encoder which processes the input at different resolutions. We report results using MRI free-breathing acquisitions from 12 volunteers. Experiments were aimed at investigating the proposed multi-scale design and the effect of increasing the number of predicted frames on the overall accuracy of the model. The proposed model was able to predict vessel positions in the next temporal image with a mean accuracy of 2.03 (2.89) mm showing increased performance in comparison with state-of-the-art approaches.

Track: short paper

Paper Type: methodological development

Presentation Upload Agreement: I agree that my presentation material (videos and slides) will be made public.