DRMIME: Differentiable Mutual Information and Matrix Exponential for Multi-Resolution Image Registration

Jan 25, 2020 Blind Submission readers: everyone Show Bibtex
  • Track: full conference paper
  • TL;DR: Image registration using differentiable mutual information
  • Keywords: Image registration, mutual information, neural networks, differentiable programming, end-to-end optimization
  • Abstract: In this work, we present a novel unsupervised image registration algorithm. It is differentiable end-to-end and can be used for both multi-modal and mono-modal registration. This is done using mutual information (MI) as a metric. The novelty here is that rather than using traditional ways of approximating MI which are often histogram based, we use a neural estimator called MINE and supplement it with matrix exponential for transformation matrix computation. The introduction of MINE tackles some of the drawbacks of histogram based MI computation and matrix exponential makes the optimization process smoother. We also introduce the idea of a multi-resolution loss, which makes the optimization process faster and more robust. This leads to improved results as compared to the standard algorithms available out-of-the-box in state-of-the-art image registration toolboxes, both in terms of time as well as registration accuracy, which we empirically demonstrate on publicly available datasets.
  • Paper Type: both
  • Supplementary Material:  zip
  • Source Latex:  zip
  • Presentation Upload:  zip
  • Presentation Upload Agreement: I agree that my presentation material (videos and slides) will be made public.
0 Replies