做知识图谱推理或链接预测的团队，GA-S2S用图结构补上了Seq2Seq模型的盲区，效果提升明显，值得在CoDEx等数据集上复现试试。
本文提出GA-S2S框架，将T5-small编码器-解码器与关系图注意力网络（RGAT）结合，用于知识图谱链接预测。现有Seq2Seq模型仅依赖实体和关系的文本描述，最多将查询实体的邻域展平为线性序列，丢失了图结构信息。GA-S2S同时编码文本特征和查询实体周围的完整k跳子图拓扑，通过融合原始编码器输出与RGAT的关系感知嵌入，捕获更丰富的多跳关系模式和文本信息。在CoDEx数据集上的初步实验表明，GA-S2S相比竞争性的Seq2Seq基线模型，链接预测准确率最高提升19%。
Leveraging Graph Structure in Seq2Seq Models for Knowledge Graph Link Prediction
We introduce Graph-Augmented Sequence-to-Sequence (GA-S2S), a novel framework that integrates a T5-small encoder-decoder with a Relational Graph Attention Network (RGAT) to improve link prediction in knowledge graphs. While existing Seq2Seq models rely solely on surface-level textual descriptions of entities and relations and at best, flatten the neighborhoods of a query entity into a single linear sequence, thereby discarding the inherent graph structure, GA-S2S jointly encodes both textual features and the full $k$-hop subgraph topology surrounding the query entity. By integrating raw encoder outputs with RGAT's relation-aware embeddings, our model captures and leverages richer multi-hop relational patterns and textual information. Our preliminary experiments on the CoDEx dataset demonstrate that GA-S2S outperforms competitive Seq2Seq-based baseline models, achieving up to a 19\% relative gain in link prediction accuracy.