论文精选

知识图谱理解框架 EXYGEN 发布,提升 LLM 对图谱的问答能力

Enabling Knowledge Graph Understanding at Scale with the EXplore Your Graphs ENgine (EXYGEN)

精选理由

这个研究很实用,它教我们如何用 ShEx 元数据和 RAG 机制,让 LLM 直接理解知识图谱,而不用再花大力气微调模型,对做知识图谱应用的开发者应该挺有帮助。

EXYGEN 框架通过整合 ShEx 元数据、检索到的三元组和示例问答对,在 SciQA 基准上实现了 0.419 的精确匹配率,无需对 LLM 进行任务特定微调。该框架还提出了一种高效的并行图采样策略,在 OpenCitations Meta 和 GESIS 数据集上,能以极小的三元组损失保留高谓词覆盖率,并大幅缩短运行时间。

原文 · arXiv cs.LG

Enabling Knowledge Graph Understanding at Scale with the EXplore Your Graphs ENgine (EXYGEN)

We present EXYGEN (EXplore Your Graphs ENgine), a framework for knowledge graph (KG) understanding that enables conversational access to KGs at scale. We address two questions in sequence. First, how effectively can LLMs perform text-to-SPARQL generation given only automatically derived structured metadata and small graph samples, rather than task-specific fine-tuning? We integrate VoID descriptions and ShEx schemas into a retrieval-augmented generation (RAG) pipeline and ablate KG-derived context on the SciQA benchmark. Our best configuration -- combining ShEx schemas, retrieved triples, and example question-query pairs -- reaches an exact match of 0.419 on execution results without any LLM fine-tuning. We further find that lexical metrics such as F1 poorly predict query correctness, and that larger general-purpose LLMs can outperform smaller code-specialized ones once given sufficient context. Second, we ask how to generate the structured metadata that this method relies on from very large KGs, where KG metadata generation becomes computationally intractable. We introduce a predicate-coverage-aware parallel graph sampling strategy that preserves structural diversity while remaining computationally tractable. On OpenCitations Meta and GESIS, it retains high predicate coverage with minimal triple loss and reduces runtime by over 80x; on ORKG, sampling is not just faster but the only tractable path to obtain complete metadata. Together, these results show that structured schema context and lightweight prompting can substantially reduce reliance on fine-tuning for scalable conversational access to KGs, though closing the remaining gap to fully fine-tuned approaches will likely require reducing dependence on curated question-query exemplars -- whether through synthetic generation or an execution-feedback-driven approach -- and validating these findings beyond a single benchmark.