PC-Dance: Posture-controllable Music-driven Dance Synthesis

Jibin Gao, Junfu Pu, Honglun Zhang, Ying Shan, Wei-Shi Zheng

Abstract:

Music-driven dance synthesis is a task to generate high-quality dance according to the music given by the user, which has promising
entertainment applications. However, most of the existing methods cannot provide an efficient and effective way for user intervention
in dance generation, e.g., posture-controllable. In this work, we propose a powerful framework named PC-Dance to perform adaptive posture-controllable music-driven dance synthesis. Consisting of an music-to-dance alignment embedding network (M2D-Align)
and a posture-controllable dance synthesis (PC-Syn), PC-Dance is feasible to fine-grained control by input anchor poses efficiently
without artist participation. Specifically, to relieve the cost of artist participation but ensure generating high-quality dance efficiently,
a self-supervised rhythm alignment module is designed to further learn the music-to-dance alignment embedding. As for PC-Syn, we
introduce an efficient scheme for adaptive motion graph construction (AMGC), which could improve the efficiency of graph-based
optimization and preserve the diversity of motions. Since there is few related public dataset, we collect a MMD-ARC dataset for musicdriven dance synthesis. The experimental results on MMD-ARC dataset demonstrate the effectiveness of our framework and the
feasibility for dance synthesis with adaptive posture controlling.