做图神经网络或集合学习的研究者,GST解决了图集任务中局部与全局信息割裂的痛点,代码已开源,值得复现对比。
Graph Set Transformer (GST) 是一种专为图集(sets of graphs)学习设计的新型神经网络架构,解决了现有方法需先用GNN编码图嵌入、导致特征提取与集合上下文建模分离的瓶颈。GST在每一层交错进行节点级特征传播和图间上下文建模,并通过门控机制融合两类信息。在合成数据集和三个真实基准(原子反应中心识别、反应产率预测、图像分类)上,GST在相同参数量下优于DeepSets、SetTransformer等基线。消融实验表明,局部与集合上下文的交错融合是性能提升的关键。
Graph Set Transformer
We introduce the Graph Set Transformer (GST), a neural network architecture for learning on sets of graphs, designed for tasks in which per-element predictions depend on set-wide context as well as local structure. Existing architectures, including DeepSets and SetTransformer, require pre-encoded graph embeddings from a separate GNN, creating a bottleneck between feature extraction and set-level contextualisation. In contrast, GST interleaves node-level feature propagation and cross-graph contextual modelling at every layer, fusing the two levels of information through a gating mechanism. We evaluate GST on a controlled synthetic suite designed to isolate set-conditional structural reasoning and on three real-data benchmarks spanning per-atom reaction-centre identification, reaction yield prediction, and image classification. Under matched parameter budgets, GST performs better than the baselines across these settings. An architectural ablation strongly suggests that the interleaving of local and set context contributes substantially to this advantage.