MDSI: Pluggable Multi-strategy Decoupling with Semantic Integration for RGB-D Gesture Recognition

Fengyi Fang, Zihan Liao, Zhehan Kan, Guijin Wang, Wenming Yang

Abstract: Highlights•A pluggable method tackling info redundancy and absence in RGB-D gesture recognition.•A Multi-strategy Decoupling Network (MDN) for precise gesture feature extraction.•A Semantic Integration Network (SIN) integrates language modeling into gestures.•The proposed method outperforms the state-of-the-art on two public datasets.