Abstract: Highlights•Recent advancements in computer vision and graphics enabled realistic virtual scenes.•Cutting-edge computer graphics techniques can model a given virtual environment.•The latest virtual scene optimization methods can be applied to real-world scenes.•Combining multiscale L1 loss with structural losses improves reconstruction accuracy.