Real-time Stage Modelling and Visual Effects for Live Performances

Taehyun Rhee, Andrew Chalmers, Faisal Zaman, Anna Stangnes, Vic Roberts

Abstract: We present a novel live platform enhancing stage performances with real-time visual effects. Our demo showcases real-time 3D modeling, rendering and blending of assets, and interaction between real and virtual performers. We demonstrate our platform’s capabilities with a mixed reality performance featuring virtual and real actors engaged with in-person audiences.