Topology-Aware Flow-Based Point Cloud Generation

Takumi Kimura, Takashi Matsubara, Kuniaki Uehara

Abstract: Point clouds have attracted attention as a representation of an object’s surface. Deep generative models have typically used a continuous map from a dense set in a latent space to express their variations. However, a continuous map cannot adequately express the varying numbers of holes. That is, previous approaches disregarded the topological structure of point clouds. Furthermore, a point cloud comprises several subparts, making it difficult to express it using a continuous map. This paper proposes ChartPointFlow, a flow-based deep generative model that forms a map conditioned on a label. Similar to a manifold chart, a map conditioned on a label is assigned to a continuous subset of a point cloud. Thus, ChartPointFlow is able to maintain the topological structure with clear boundaries and holes, whereas previous approaches generated blurry point clouds with fuzzy holes. The experimental results show that ChartPointFlow achieves state-of-the-art performance in various tasks, including generation, reconstruction, upsampling, and segmentation.