HVQ-VAE: Variational auto-encoder with hyperbolic vector quantization

Shangyu Chen, Pengfei Fang, Mehrtash Harandi, Trung Le, Jianfei Cai, Dinh Q. Phung

Abstract: Highlights•This paper introduces HVQ-VAE enhancing traditional VQ-VAE with geometric priors.•The encoder of HVQ-VAE can learn the inherent hierarchical structures from the data.•Demonstrates superior image reconstruction and learning efficiency.•HVQ-VAE’s geometric prior leads to higher codebook usage, faster convergence, and improved performance.•HVQ-VAE employs Riemannian optimization to update the codebook within hyperbolic space.