Structure-Guided Memory-Efficient 3D Gaussians for Large-Scale Reconstruction

Zinan Lv, Yeqiang Qian, Chunxiang Wang, Ming Yang

Abstract: 3D reconstruction is a critical technology with significant implications for applications such as urban planning, autonomous driving, and virtual reality. Recent advances in 3D Gaussian Splatting (3DGS) have demonstrated impressive results in small-scale scenes, achieving high-quality reconstructions with real-time rendering capabilities. However, when applied to large-scale scenes, existing 3DGS methods face significant challenges due to the exponential growth of model size, often exceeding the memory capacity of consumer-grade GPUs and making training and rendering infeasible. In this paper, we propose a structure-guided memory-efficient 3DGS framework that uses only half the memory of current large-scale 3DGS methods while maintaining state-of-the-art reconstruction accuracy. Specifically, we introduce a structure-guided density control mechanism that uses a heuristic approach to split Gaussian ellipsoids in challenging regions and optimizes their attributes during densification, significantly reducing memory storage requirements while preserving structural details with fewer ellipsoids. Moreover, we propose a novel structure loss to supervise the learning of scene structural information, enabling the model to better capture and preserve geometric details such as straight lines and edges, further enhancing reconstruction accuracy. We also propose the largest known drone dataset for 3D reconstruction, comprising over 10,000 high-resolution images covering more than 2.5 million square meters. Extensive experiments on multiple benchmark datasets and our proposed dataset demonstrate that our new method is highly memory-efficient with high accuracy. We strongly recommend you to watch our demo at https://lvzinan.github.io/STGS.github.io/.

External IDs:dblp:journals/tvcg/LvQWY26