Edge-assisted Real-time Dynamic 3D Point Cloud Rendering for Multi-party Mobile Virtual Reality
Abstract: Multi-party Mobile Virtual Reality (MMVR) enables multiple mobile users to share virtual scenes for immersive multimedia experience in scenarios such as gaming, social interaction, and industrial mission collaboration. Dynamic 3D Point Cloud (DPCL) is an emerging representation form of MMVR that can be consumed as a free-viewpoint video with 6 degree of freedom. Given that it is challenging to render DPCL at a satisfying frame rate with limited on-device resources, offloading rendering tasks to edge servers is recognized as a practical solution. However, repeated loading of DPCL scenes with a substantial amount of metadata introduces a significant redundancy overhead that cannot be overlooked when enabling multiple edge servers to support the rendering requirements of user groups. In this paper, we design PoClVR, an edge-assisted DPCL rendering system for MMVR applications, which breaks down the rendering process of the complete dynamic scene into multiple rendering tasks of individual dynamic objects. PoClVR significantly reduces the repetitive loading overhead of DPCL scenes on edge servers and periodically adjusts the rendering task allocation for edge servers during the application running to accommodate rendering requirements. We deploy PoClVR based on a real-world implementation and the experimental evaluation results show that PoClVR can reduce GPU utilization by up to 15.1\% and increase rendering frame rate by up to 34.6\% compared to other baselines while ensuring that the image quality viewed by the user is virtually unchanged.
Primary Subject Area: [Experience] Multimedia Applications
Relevance To Conference: Our research work focuses on the challenges of rendering dynamic 3D point cloud scenes, an immersive media form with 6 degrees of freedom, to provide mobile virtual reality services for multiple users. The process of rendering a dynamic point cloud is essentially transforming 3D media content into 2D media within the user's field of view to provide an immersive experience, which is a computation-intensive task for edge servers. In this work, we prove that using edge servers to render dynamic 3D point cloud scenes for multi-party mobile virtual reality applications is more challenging than rendering traditional 3D models. We design PoClVR, an edge-assisted DPCL rendering system for MMVR applications, which breaks down the rendering process of the complete dynamic scene into multiple rendering tasks of individual dynamic objects. The experimental results show that we can significantly improve the performance of the edge-assisted rendering system, which means that we advance the conversion and application of multimedia content.
Submission Number: 5329
Loading