MoFLeuR: Motion-based Federated Learning Gesture Recognition

Seyed Jamal Seyed-Mohammadi, Seyed Mohammad Sheikholeslami, Jamshid Abouei, Arash Mohammadi, Konstantinos N. Plataniotis

Abstract: Most of the recent works on Human Gesture Recognition (HGR) using motion data rely on gathering a dataset, that faces two major challenges: $a)$ the datasets are originally stored on the smart devices at the end-users, and gathering them in one place is not feasible due to communication limitations, and $b)$ clients are reluctant to share their private data with a central server due to privacy concerns. In this paper, we address these issues and propose a privacy-preserving framework based on Federated Learning (FL) for HGR using motion data. Furthermore, we consider data heterogeneity which have destructive effects on the performance of the global model. Accordingly, we propose a communication and computation-efficient client selection method, mitigating the impact of data heterogeneity in the FL process. In the proposed framework, clients are not requested to share sensitive information about their local datasets with the edge server. Simulation results show that the proposed MoFLeuR algorithm improves the performance of the global model in the presence of different degrees of data heterogeneity, and it outperforms the baseline algorithms in terms of different metrics, namely accuracy, convergence speed, and communication and computation efficiency.