A Marker-Free Motion Capture System Built on Unsynchronized Cameras

Haofei Hou, Shunyi Zhao, Zuxin Fan, Wei Jin, Jintao Zhu, Lecheng Ruan, Qining Wang

Abstract: Human Motion Capture (MoCap) involves tracking and recording human movements. Image-based MoCap systems have gained significant research interest, particularly for their simplified deployment that eliminates the requirement for reflective markers and wearable sensors. However, the deployment of such systems faces two major challenges: temporal misalignments caused by unsynchronized cameras and the sparsity of detectable features on human bodies. To address these limitations, we propose a marker-free MoCap system built on unsynchronized cameras. For the temporal misalignment issue, we introduce two crucial components: multi-view temporal post-processing and temporal augmentation training, which enable automatic temporal alignment across multiple cameras. To overcome feature sparsity, we define virtual markers as 3D surface points on the human mesh model. Experimental results validate the high performance of our system in global marker localization. The proposed approach presents a scalable and flexible solution for MoCap deployment in unconstrained environments, showing promise for applications in mobile health monitoring and sports training.

External IDs:dblp:conf/icira/HouZFJZRW25