Fast forward: Rephrasing 3D deformable image registration through density alignment and splatting
Keywords: Deformable registration, Splatting, Warping
TL;DR: Forward splatting via differentiable rasterisation surpassing backward warping in registration robustness and accuracy, setting SOTA for multiple benchmarks.
Abstract: Unsupervised learning- and optimisation-based 3D registration has almost exclusively been approached using backward warping (interpolation) for transforming images. While this has practical advantages in particular the ease of implementation within common libraries it limits the robustness and accuracy in certain challenging scenarios. The alternative solution of forward splatting (extrapolation) is currently limited to very few applications, e.g. mesh or point cloud registration, requiring specific geometric learning architectures that are so far less efficient compared to dense 3D convolutional networks. In this work, we propose to use a straightforward forward splatting technique based on differentiable rasterisation. Contrary to prior work, we rephrase the problem of deformable image registration as a density alignment of rasterised volumes based on intermediate point cloud representations that can be automatically obtained through e.g. geometric vessel filters or surface segmentations. Our experimental validation demonstrates state-of-the-art performance over a wide range of registration tasks including intra- and inter-patient alignment of thorax and abdomen.
Primary Subject Area: Image Registration
Secondary Subject Area: Geometric Deep Learning
Paper Type: Validation or Application
Registration Requirement: Yes
Reproducibility: https://github.com/mattiaspaul/fastforward
Submission Number: 219
Loading