Towards Interpretable Controllability in Object-Centric Learning

Published: 16 Jun 2024, Last Modified: 16 Jun 2024CORR, CVPR 2024 PosterEveryoneRevisionsBibTeXCC BY 4.0
Keywords: object-centric learning, representation learning, self-supervised learning, unsupervised learning
TL;DR: In this paper, we explore the uncharted research area of interpretable controllability within object-centric learning, utilizing an image augmentation skill.
Abstract:

In the field of computer vision, object-centric learning (OCL) is extensively researched to better understand complex scenes by acquiring object representations or slots. While recent studies in OCL have made strides with complex images or videos, the interpretability and interactivity over object representation remain largely uncharted, still holding promise in the field of OCL. In this paper, we introduce a novel method, Slot Attention with Image Augmentation (SlotAug), to explore the possibility of learning interpretable controllability over slots in a self-supervised manner by utilizing an image augmentation strategy. We also devise the concept of sustainability in controllable slots by introducing iterative and reversible controls over slots with two proposed submethods: Auxiliary Identity Manipulation and Slot Consistency Loss.

Submission Number: 10
Loading