Identifiable Object Representations under Spatial Ambiguities

Avinash Kori, Francesca Toni, Ben Glocker

Track: long paper (up to 8 pages)

Keywords: object centric learning, spatial ambiguities, identifiability

TL;DR: We introduce a probabilistic model that resolves spatial ambiguities and provides theoretical guarantees for identifiability without additional viewpoint annotations.

Abstract: Modular object-centric representations are essential for human-like reasoning but are challenging to obtain under spatial ambiguities, e.g. due to occlusions and view ambiguities. However, addressing challenges presents both theoretical and practical difficulties. We introduce a novel multi-view probabilistic approach that aggregates view-specific slots to capture invariant content information while simultaneously learning disentangled global viewpoint-level information. Unlike prior single-view methods, our approach resolves spatial ambiguities, provides theoretical guarantees for identifiability, and requires no viewpoint annotations. Extensive experiments on standard benchmarks and novel complex datasets validate our method's robustness and scalability.

Submission Number: 61