A Framework Using Absolute Compression Hard-Threshold for Improving The Robustness of Federated Learning Model

Yuzhang Wu, Beilun Wang

Abstract: Nowadays, with the popularity of the federated learning, it becomes crucial for us to tackle the challenges, communication cost and model robustness. And targeting at the communication bottleneck, data compression is widely used to solve the problem. Besides, the usage of variance reduction for achieving robustness and communication compression for reducing costs has been studied. The Byz-VR-MARINA pro- posed before uses random-sparsification. In this paper, we adopt the absolute compressors hard-threshold and propose a robust compressed framework Byz-VR-BARRY. Experimental results on w8a and a9a datasets have shown the effectiveness of our method, which can decrease the optimality gap obviously.