Node4All:无需数据集特定优化的通用图节点表示学习

Node4All: Learning Node Representation Beyond Datasets

精选理由

不用为每个图数据集调参了,Node4All一个模型跑25个基准排名第5,还支持one-shot学习。

AI 摘要

Node4All由Channel Graph Transformer(CGT)架构和基于合成图的自监督学习方法组成。在25个节点分类基准上对比21个基线方法,单个统一模型无需任何数据集调优即取得第5名。它支持one-shot和in-context学习,表现优于近年图基础模型。代码和模型权重已在GitHub开源。

原文 · arXiv cs.LG

Node4All: Learning Node Representation Beyond Datasets

Node representation learning has advanced rapidly, yet most existing methods rely on per-dataset training and hyperparameter tuning. This dataset-specific optimization comes from the difficulty of designing reusable graph models that generalize across diverse graph datasets. In this work, we introduce Node4All, a node representation learner applicable to arbitrary graph datasets without any dataset-specific optimization. Node4All is built on two complementary ideas. At the architectural level, we introduce the Channel Graph Transformer (CGT), which enables a single fixed parameterization to process arbitrary graph datasets. At the learning level, we propose a self-supervised learning based on a series of synthetic graphs. Together, these components enable generalization beyond individual datasets, which is infeasible with existing architectures and learning frameworks. We extensively evaluate Node4All on node classification across 25 benchmarks against 21 baselines, covering both supervised and self-supervised methods. Despite all baselines being trained and optimized for each dataset, a single Node4All, applied uniformly across the datasets, achieves a competitive ranking of 5th among 21 baselines. Moreover, Node4All supports one-shot and in-context learning with an appropriate predictor and outperforms recent graph foundation models (GFMs) in these settings. These results demonstrate that Node4All not only achieves reusability across arbitrary graph datasets, but also remains an effective solution in practice. Code and model checkpoints are available in https://github.com/dooho00/node4all.