RoboDJ: Live Commentary Robots System Driven by Physical- and Cyber-World Observations

Yasutomo Kawanishi, Yutaka Nakamura, Taiken Shintani, Carlos Toshinori Ishi, Seiya Kawano, Koichiro Yoshino, Takashi Minato, Michihiko Minoh

Abstract: In this paper, we introduce RoboDJ, a novel system in which two robots collect real-time information from both the physical and cyber worlds and provide live commentary based on this data. These robots provide information to the audience while observing their surroundings, much like radio DJs performing live public broadcasts. The system enables dynamic and context-aware dialogue between the robots, leveraging real-time inputs from both environments. We implemented a domain-specific scripting language and its interpreter to manage system control and scenario description.