Dissimilar Nodes Improve Graph Active Learning

Zhicheng Ren, Yifu Yuan, Yuxin Wu, Xiaxuan Gao, YEWEN WANG, Yizhou Sun

Keywords: Graph Neural Network, Active Learning

TL;DR: In this work, with aim of selecting valuable training nodes, we propose 3 dissimilarity-based importance scores for graph active learning system to select valuable nodes.

Abstract: Training labels for graph embedding algorithms could be costly to obtain in many practical scenarios. Active learning (AL) algorithms are very helpful to obtain the most useful labels for training while keeping the total number of label queries under a certain budget. The existing Active Graph Embedding framework proposes to use centrality score, density score, and entropy score to evaluate the value of unlabeled nodes, and it has been shown to be capable of bringing some improvement to the node classification tasks of Graph Convolutional Networks. However, when evaluating the importance of unlabeled nodes, it fails to consider the influence of existing labeled nodes on the value of unlabeled nodes. In other words, given the same unlabeled node, the computed informative score is always the same and is agnostic to the labeled node set. With the aim to address this limitation, in this work, we introduce 3 dissimilarity-based information scores for active learning: feature dissimilarity score (FDS), structure dissimilarity score (SDS), and embedding dissimilarity score (EDS). We find out that those three scores are able to take the influence of the labeled set on the value of unlabeled candidates into consideration, boosting our AL performance. According to experiments, our newly proposed scores boost the classification accuracy by 2.1$\%$ on average and are capable of generalizing to different Graph Neural Network architectures.

Community Implementations: [ 1 code implementation](https://www.catalyzex.com/paper/arxiv:2212.01968/code)