TraceFlow: Dynamic 3D Reconstruction of Specular Scenes Driven by Ray Tracing

ICLR 2026 Conference Submission19465 Authors

Keywords: 4D Reconstruction; Ray Tracing; Specular

TL;DR: We present TraceFlow, a novel framework for high-fidelity rendering of dynamic specular scenes.

Abstract: We present TraceFlow, a novel framework for high-fidelity rendering of dynamic specular scenes by addressing two key challenges: precise reflection direction estimation and physically accurate reflection modeling. To achieve this, we propose a Residual Material-Augmented 2D Gaussian Splatting representation that models dynamic geometry and material properties, allowing accurate reflection ray computation. Furthermore, we introduce a Dynamic Environment Gaussian representation and a hybrid rendering pipeline that decomposes rendering into diffuse and specular components, enabling physically grounded specular synthesis via rasterization and ray tracing. Finally, we devise a coarse-to-fine training strategy to improve optimization stability and promote physically meaningful decomposition. Extensive experiments on dynamic scene benchmarks demonstrate that TraceFlow outperforms prior methods both quantitatively and qualitatively, producing sharper and more realistic specular reflections in complex dynamic environments.

Primary Area: applications to computer vision, audio, language, and other modalities

Submission Number: 19465