Z-Pose: Continuous 3D Hand Pose Tracking Using Single-Point Bio-Impedance Sensing on a Ring

Anandghan Waghmare, Ishan Chatterjee, Shwetak N. Patel

Abstract: This paper introduces Z-Pose, a method for continuous 3D hand pose tracking that uses swept-frequency RF sensing via a worn ring device. By modeling the hand as an RF antenna and analyzing its geometry-dependent impedance, Z-Pose performs real-time hand tracking based on the unique impedance signature of each pose. Unlike camera-based systems, this sensing technique is robust to occlusion and illumination, performing well in our evaluation studies even with obstructions such as sleeves and gloves. The results indicate that the system achieves an average Euclidean error of 7.2mm across individual hand joints, lending itself to a variety of interactive applications.