Advancing Graph Neural Networks Through Joint Time-Space Dynamics

Qiyu Kang, Yanan Zhao, Kai Zhao, Xuhao Li, Qinxu Ding, Wee Peng Tay, Sijie Wang

Keywords: graph neural network, fractional-order system

Abstract: We introduce the GeneRAlized Fractional Time-space graph diffusion network (GRAFT), a framework combining temporal and spatial nonlocal operators on graphs to effectively capture long-range interactions across time and space. Leveraging time-fractional diffusion processes, GRAFT encompasses a system's full historical context, while the $d$-path Laplacian diffusion ensures extended spatial interactions based on shortest paths. Notably, GRAFT mitigates the over-squashing problem common in graph networks. Empirical results show its prowess on self-similar, tree-like data due to its fractal-conscious design with fractional time derivatives. We delve deeply into the mechanics of GRAFT, emphasizing its distinctive ability to encompass both time and space diffusion processes through a random walk perspective.

Submission Number: 27