A Personalized Federated Learning Framework Using Side Information for Heterogeneous Data Classification

Yupei Zhang, Shuangshuang Wei, Yifei Wang, Yunan Xu, Yuxin Li, Xuequn Shang

Abstract: Federated learning (FL) allows a large number of clients to improve their respective models through training a shared global model. However, passing the same global model is not conducive to the training of a few clients and leads to a large loss of localization information. In practical, there are often some prior information that can be shared between clients. Our study takes into account the use of such prior information to calculate a personalized global model for each client, resulting in an enhanced personalized federated learning framework, dubbed PerFL for short, that takes advantage of available client features that can be shared with other clients. More specifically, PerFL calculates the incidence matrix of all involved clients by using the permitted shareable side information and then updates the local models by using their similar clients instead of all clients. Employing the neural network as the classification model, PerFL learns the parameter matrices at each client in an iterative manner. On three publicly available image datasets, PerFL can benefit from the employed similarity and achieve an improved classification performance in comparison with the state-of-the-art FL models.