Addressing Character Consistency Challenges in AI Filmmaking

Marcin Kalinski, Michal Podstawski, Krzysztof Ostrowski, Malgorzata Kudelska, Patryk Bartkowiak, Piotr Lyczko, Michal Piasecki, Thomas Visscher, Haohong Wang

Abstract: Generative AI is revolutionizing filmmaking work-flows, but achieving visual consistency across characters remains a significant challenge. This paper explores the practical application of state-of-the-art techniques to address this challenge, leveraging insights from extensive experiments and real-world use cases in film productions. Key difficulties include preserving character identities across varied poses and expressions (spanning both realistic and animated styles). By sharing lessons learned, best practices, and practical insights, this paper emphasizes the transformative potential of generative AI techniques in crafting cohesive cinematic experiences and engaging product-centric storytelling, setting the stage for future advancements in AI-driven filmmaking.