An Information Theoretic Perspective for Heterogeneous Subgraph Federated Learning

Jiayan Guo, Shangyang Li, Yan Zhang

Abstract: Mining graph data has gained wide attention in modern applications. With the explosive growth of graph data, it is common to see many of them collected and stored in different distinction systems. These local graphs can not be directly shared due to privacy and bandwidth concerns. Thus, Federated Learning approach needs to be considered to collaboratively train a powerful generalizable model. However, these local subgraphs are usually heterogeneously distributed. Such heterogeneity brings challenges for subgraph federated learning. In this work, we analyze subgraph federated learning and find that sub-optimal objectives under the FedAVG training setting influence the performance of GNN. To this end, we propose InfoFedSage, a federated subgraph learning framework guided by Information bottleneck to alleviate the non-iid issue. Experiments on public datasets demonstrate the effectiveness of InfoFedSage against heterogeneous subgraph federated learning.