Effortless: AI-Augmented Music Composition and Live Performance in Virtual and Mixed Reality

Strong Bear

Keywords: Virtual Reality (VR), Mixed Reality (MR), AI-assisted music, Generative models, Music interaction, Multiplayer collaboration, ONNX, Unity Sentis, Csound, Magenta (GrooVAE, MusicVAE, Realtime), Lyria RT, BlockadeLabs Skybox, Effortless

TL;DR: We present an immersive multiplayer VR/MR system for Meta Quest that enables collaborative, embodied, and AI-assisted music composition and performance.

Abstract: We present Effortless, an immersive multiplayer system for the Meta Quest platform that enables new modes of music composition and performance through the integration of virtual reality (VR), mixed reality (MR), and artificial intelligence (AI). Multiple players interact in shared VR worlds or physical environments via passthrough, where musical elements appear as tangible objects. AI-assisted instruments support prompt-based sound generation, real-time synthesis, and transformation of MIDI material. Musical elements are structured hierarchically into palettes, movements, and complete compositions. The system introduces a paradigm for collaborative, embodied, and AI-augmented music creation.

Track: Demo Track

Confirmation: Demo Track: I confirm that I have followed the formatting guideline and included all author names and affiliations.

(Optional) Short Video Recording Link: https://www.youtube.com/playlist?list=PLzui51-zngvnyioXff8Wpacqiruo-i-sh

Submission Number: 81