Room2XR: Virtual Interactive Collaboration in Real-world Scenes

Hung-Jui Guo, Hiranya Garbha Kumar, Minhas Kamal, Balakrishnan Prabhakaran

Abstract: The rising prominence of Virtual Reality (VR), Mixed Reality (MR), and Extended Reality (XR) devices is transforming various industries by offering immersive and interactive experiences. Despite this, there is a notable gap in research and development of frameworks that seamlessly integrate real-world scenes into virtual environments for collaborative use. Current methods experience extended reconstruction times and latency issues, rendering them impractical for real-time collaborative applications. This paper introduces Room2XR, a framework designed to dynamically reconstruct real-world scenes into virtual semantically similar representations using CAD models, and share them for remote collaboration. Room2XR employs advanced scene understanding technologies to create detailed virtual environments, enabling multiple users to interact with and manipulate these spaces in real time. By leveraging efficient algorithms and data transmission methods, Room2XR ensures accessibility and usability even on low-bandwidth networks. The source code and detailed documentation are provided in the following two repositories- 1. https://github.com/HenryGuo2003/Room2XR-Unity and 2. https://hub.docker.com/r/kumarhiranya/vrrec