The Geometry of Diffusion Models: Tubular Neighbourhoods and Singularities

Kotaro Sakamoto, Ryosuke Sakamoto, Masato Tanabe, Masatomo Akagawa, Yusuke Hayashi, Manato Yaguchi, Masahiro Suzuki, Yutaka Matsuo

Track: Proceedings

Keywords: Diffusion models, geometry, tubular neighborhoods

TL;DR: We investigate the relationship between the geometry of diffusion models and singularities of the generative dynamics.

Abstract: Diffusion generative models have been a leading approach for generating high-dimensional data. The current research aims to investigate the relation between the dynamics of diffusion models and the tubular neighbourhoods of a data manifold. We propose an algorithm to estimate the injectivity radius, the supremum of radii of tubular neighbourhoods. Our research relates geometric objects such as curvatures of data manifolds and dimensions of ambient spaces, to singularities of the generative dynamics such as emergent critical phenomena or spontaneous symmetry breaking.

Submission Number: 78