Keywords: Disentanglement, Diffeomorphic autoencoder, Guided filter
TL;DR: We extend diffeomorphic autoencoders for image appearance modeling and integrate guided filter regularization.
Abstract: Diffeomorphic and deforming autoencoders have been recently explored in the field of medical imaging for appearance and shape disentanglement. Both models are based on the deformable template paradigm, however they show different weaknesses for the representation of medical images. Diffeomorphic autoencoders only consider spatial deformations, whereas deforming autoencoders also regard changes in the appearance, however no uniform template is generated for the whole training dataset, and the appearance is modeled depending on a very few parameters. In this work, we propose a method that represents images based on a global template, where next to the spatial displacement, the appearance is modeled as the pixel-wise intensity difference to the unified template. To however ensure that the generated appearance offsets adhere to the template shape, a guided filter smoothing of the appearance map is integrated into an end-to-end training process. This regularization significantly improves the disentanglement of shape and appearance and thus enables multi-modal image modeling. Furthermore, the generated templates are crisper and the registration accuracy improves. Our experiments also show applications of the proposed approach in the field of automatic population analysis.
Registration: I acknowledge that publication of this at MIDL and in the proceedings requires at least one of the authors to register and present the work during the conference.
Source Code Url: https://github.com/hristina-uzunova/GF_DAE
Authorship: I confirm that I am the author of this work and that it has not been submitted to another publication before.
Data Set Url: https://cloud.imi.uni-luebeck.de/s/dsFe2rqfc6BiBdM
Paper Type: methodological development
Source Latex: zip
Primary Subject Area: Unsupervised Learning and Representation Learning
Secondary Subject Area: Image Registration