VidAnimator: User-Guided Stylized 3D Character Animation from Human Videos

Xinwu Ye, JUN-HSIANG YAO, Jielin Feng, Xingyu Lan, Siming Chen

Keywords: Stylized 3D Character Animation, Human-AI Collaboration

Abstract: With captivating visual effects, stylized 3D character animation has gained widespread use in cinematic production, advertising, social media, and the potential development of virtual reality (VR) non-player characters (NPCs). However, animating stylized 3D characters often requires significant time and effort from animators. We propose a mixed-initiative framework and interactive system to have stylized 3D characters mimic motion in human videos. The framework takes a single-view human video and a stylized 3D character (the target character) as input, captures the motion of the video, and then transfers the motion to the target character. In addition, it involves two interaction modules for customizing the result. Accordingly, the system incorporates two authoring tools that empower users with intuitive modification. A questionnaire study offers tangible evidence of the framework's capability of generating natural stylized 3D character animation similar to motion of the video. Additionally, three case studies demonstrate the utility of our approach in creating diverse results.

Email Sharing: We authorize the sharing of all author emails with Program Chairs.

Data Release: We authorize the release of our submission and author names to the public in the event of acceptance.

Submission Number: 4