PAAP: Performer-Aware Automatic Panning System

Sungyoung Kim

Abstract: We propose PAAP (Performer-Aware Automatic Panning System), the first system to automatically track performer(s) and generate spatial audio panning data integrated with a Digital Audio Workstation (DAW). The system pipeline consists of three main stages: (1) visual cue analysis via performer tracking and monocular depth estimation, (2) spatial information prediction using a custom algorithm that produces DAW-compatible panning parameters, and (3) integration of industry-standard DAW using embedded script processing. We tested and validated the technical feasibility and real-world applicability including Open Sound Control (OSC) based real-time processing. To our knowledge, this is the first complete study of an automatic panning with DAW and we anticipate PAAP to streamline live and studio music production.