Posterior Label Smoothing for Node Classification

Jaeseung Heo, MoonJeong Park, Dongwoo Kim

Keywords: node classification, label smoothing

TL;DR: We propose a label smoothing method based on the posterior distribution of nodes given their neighborhood labels.

Abstract: Soft labels can improve the generalization of a neural network classifier in many domains, such as image classification. Despite its success, the current literature has overlooked the efficiency of label smoothing in node classification with graph-structured data. In this work, we propose a simple yet effective label smoothing for the transductive node classification task. We design the soft label to encapsulate the local context of the target node through the neighborhood label distribution. We apply the smoothing method for seven baseline models to show its effectiveness. The label smoothing methods improve the classification accuracy in 10 node classification datasets in most cases. In the following analysis, we find that incorporating global label statistics in posterior computation is the key to the success of label smoothing. Further investigation reveals that the soft labels mitigate overfitting during training, leading to better generalization performance.

Primary Area: Graph neural networks

Submission Number: 1374