Frequency-Aware Gaussian Splatting Decomposition

Yishai Lavi, Leo Segre, Shai Avidan

Keywords: 3D Gaussian Splatting; Level of Detail; Frequency Decomposition; Progressive Rendering; Novel View Synthesis; 3D Reconstruction

TL;DR: We propose a frequency-aware decomposition of 3D Gaussian Splatting, achieving state-of-the-art quality and speed for level-of-detail rendering while enabling several applications.

Abstract:

3D Gaussian Splatting (3D-GS) enables efficient novel view synthesis, but treats all frequencies uniformly, making it difficult to separate coarse structure from fine detail. Recent works have started to exploit frequency signals, but lack explicit frequency decomposition of the 3D representation itself. We propose a frequency-aware decomposition that organizes 3D Gaussians into groups corresponding to Laplacian-pyramid subbands of the input images. Each group is trained with spatial frequency regularization to confine it to its target frequency, while higher-frequency bands use signed residual colors to capture fine details that may be missed by lower-frequency reconstructions. A progressive coarse-to-fine training schedule stabilizes the decomposition.

Our method achieves state-of-the-art reconstruction quality and rendering speed among all LOD-capable methods.
In addition to improved interpretability, our method enables dynamic level-of-detail rendering, progressive streaming, foveated rendering, promptable 3D focus, and artistic filtering.
Our code will be made publicly available.

Submission Number: 234