Towards AI Rapper: Creating an Interactive Rap Battle Experience with Generative AI

Nikita Kozodoi, Elizaveta Zinovyeva, Zainab Afolabi, Egor Krashenninikov

Keywords: generative ai, rap

TL;DR: Creating a Rap Battle Experience with Generative AI

Abstract: This demo lets you experience a real-time interactive rap battle between a human and AI or two AI opponents. We develop an end-to-end solution that leverages multiple data modalities and ML models. Our system integrates speech recognition, emotion detection, language modeling, vision, text-to-speech, and voice cloning. The system combines multiple models to process user audio input, generates appropriate and contextually-aware text and synthesizes audio responses aligned with the background beat music. The demo demonstrates the potential of AI systems in creative music applications and offers insights into challenges and opportunities associated with integrating AI systems for interactive entertainment.

Track: Demo Track

Confirmation: Demo Track: I confirm that I have followed the formatting guideline and included all author names and affiliations.

(Optional) Short Video Recording Link: https://youtu.be/M7l5RjHEons

Submission Number: 32