做数据驱动智能体或自动化工作流的团队,这篇论文直接告诉你该不该依赖语义元数据——结论是结构化数据仍是可靠执行的基石,值得点开看具体精度对比。
一项新研究对比了智能体在两种环境下检索数据的效果:基线智能体搜索数十亿网页,语义智能体利用 schema.org 元数据检索 9000 万数据集。结果显示,语义智能体在检索可操作数据方面精度更高,元数据丰富注册表的精度提升 44.9%,机器可读下载页面的精度提升 46.6%。基线智能体虽然覆盖更广(多回答 40% 的问题),但常返回散文式页面或门户登录页,导致“最后一英里”失效。研究认为,无结构检索适合探索性任务,而结构化元数据生态是可靠自动化工作流的基础。
Do Agents Need Semantic Metadata? A Comparative Study in Agentic Data Retrieval
In the era of autonomous agents, machine-actionable data is critical for data-driven workflows. For more than a decade, semantic metadata like schema.org has anchored the FAIR principles (Findable, Accessible, Interoperable, and Reusable) for machine-actionable data and enabled discovery tools like Google Dataset Search. However, the rise of Large Language Models (LLMs) capable of navigating the unstructured web raises a fundamental question: Is semantic metadata still necessary for agentic data discovery, or can agents reliably retrieve actionable data directly from the web? We present a comparative analysis of agentic data retrieval across two distinct environments: a Baseline Agent searching billions of open-web documents, and a Semantic Agent leveraging a corpus of 90 million datasets using schema.org. We deploy an "LLM-as-a-judge" evaluation pipeline, mapped directly to the FAIR principles, to assess the semantic relevance, data accessibility, and computational utility of the retrieved data. Our results reveal a clear divergence. The Semantic Agent excels at retrieving actionable data, achieving a 44.9% higher precision for metadata-rich registries and a 46.6% higher precision for pages with machine-readable downloads among its returned results. Conversely, the Baseline Agent frequently suffers "Last-Mile Utility" failures, retrieving prose-heavy pages (20.1% of results) and portal landing pages (8.5%) rather than actual data pages. While the Baseline Agent achieves higher coverage by answering 40% more questions, the Semantic Agent delivers greater accuracy, achieving 65.7% higher overall precision in retrieving FAIR-compliant datasets. We conclude that while unstructured retrieval supports broad exploratory tasks, structured ecosystems remain the indispensable foundation for reliable, execution-oriented autonomous workflows.