DRMIME: Differentiable Mutual Information and Matrix Exponential for Multi-Resolution Image RegistrationDownload PDF

Published: 18 Apr 2020, Last Modified: 05 May 2023MIDL 2020Readers: Everyone
Track: full conference paper
TL;DR: Image registration using differentiable mutual information
Keywords: Image registration, mutual information, neural networks, differentiable programming, end-to-end optimization
Abstract: In this work, we present a novel unsupervised image registration algorithm. It is differentiable end-to-end and can be used for both multi-modal and mono-modal registration. This is done using mutual information (MI) as a metric. The novelty here is that rather than using traditional ways of approximating MI which are often histogram based, we use a neural estimator called MINE and supplement it with matrix exponential for transformation matrix computation. The introduction of MINE tackles some of the drawbacks of histogram based MI computation and matrix exponential makes the optimization process smoother. We also introduce the idea of a multi-resolution loss, which makes the optimization process faster and more robust. This leads to improved results as compared to the standard algorithms available out-of-the-box in state-of-the-art image registration toolboxes, both in terms of time as well as registration accuracy, which we empirically demonstrate on publicly available datasets.
Paper Type: both
Supplementary Material: zip
Source Latex: zip
Presentation Upload: zip
Presentation Upload Agreement: I agree that my presentation material (videos and slides) will be made public.
13 Replies