Guided Filter Regularization for Improved Disentanglement of Shape and Appearance in Diffeomorphic Autoencoders

Hristina Uzunova, Heinz Handels, Jan Ehrhardt

Keywords: Disentanglement, Diffeomorphic autoencoder, Guided filter

Abstract: Diffeomorphic and deforming autoencoders have been recently explored in the field of medical imaging for appearance and shape disentanglement. Both models are based on the deformable template paradigm, however they show different weaknesses for the representation of medical images. Diffeomorphic autoencoders only consider spatial deformations, whereas deforming autoencoders also regard changes in the appearance, however no uniform template is generated for the whole training dataset, and the appearance is modeled depending on a very few parameters. In this work, we propose a method that represents images based on a global template, where next to the spatial displacement, the appearance is modeled as the pixel-wise intensity difference to the unified template. To however ensure that the generated appearance offsets adhere to the template shape, a guided filter smoothing of the appearance map is integrated into an end-to-end training process. This regularization significantly improves the disentanglement of shape and appearance and thus enables multi-modal image modeling. Furthermore, the generated templates are crisper and the registration accuracy improves. Our experiments also show applications of the proposed approach in the field of automatic population analysis.

Registration: I acknowledge that publication of this at MIDL and in the proceedings requires at least one of the authors to register and present the work during the conference.

Authorship: I confirm that I am the author of this work and that it has not been submitted to another publication before.

Paper Type: methodological development

Primary Subject Area: Unsupervised Learning and Representation Learning

Secondary Subject Area: Image Registration

TL;DR: We extend diffeomorphic autoencoders for image appearance modeling and integrate guided filter regularization.

Source Code Url: https://github.com/hristina-uzunova/GF_DAE

Data Set Url: https://cloud.imi.uni-luebeck.de/s/dsFe2rqfc6BiBdM