AI产品精选

LlamaIndex创始人称RAG是临时方案

Thanks @juliafedorin for a great conversation! Some tidbits from the podcast on the AI space: - We...

精选理由

LlamaIndex创始人谈从RAG到文档基础设施的转变,解释为什么90%的信息被锁在文档中,以及为什么上下文而非智能是当前瓶颈。

AI 摘要

LlamaIndex创始人Jerry Liu在播客中表示,公司已从构建RAG框架转向构建AI智能体的文档基础设施。他指出,文档占世界非结构化上下文的90%,解决上下文层是实现通用智能的最大瓶颈。RAG只是临时解决方案,构建生产级检索系统仍然困难。

原文 · Jerry Liu

Thanks @juliafedorin for a great conversation! Some tidbits from the podcast on the AI space: - We...

Thanks @juliafedorin for a great conversation! Some tidbits from the podcast on the AI space: - We've pivoted from building a RAG framework towards building the document infrastructure for agents - Documents are 90% of the world's unstructured context, and solving the context layer is the most important bottleneck towards unlocking general intelligence - There's a lot of ways to hack building basic RAG, but building production retrieval systems is still hard Julia Fedorin @juliafedorin My conversation with @jerryjliu0 . He's building @llama_index : document infrastructure for AI agents, the layer underneath everything models need to work. Did you know he's the guy whose tool half the industry used for RAG? Then he called RAG a hack, two years before the field agreed. Here's the problem he's pointing at: 90% of the world's information is locked inside PDFs, PowerPoints, and Word documents. The models are already smarter than humans. But until an agent can read and reason over all that, it just sits still. RAG was the hack everyone reached for to bridge that gap: chunk, embed, retrieve, done. The easiest thing that kind of worked, so people could ship demos. Anything complex, and it falls apart. We got into: •Why RAG has no first principles, and what's replacing it •Why context, not intelligence, is the real bottleneck now •Why even MCP doesn't fully solve context •How you get agents to follow a company's culture, not just its instructions •What he'd build if he started LlamaIndex today 𝐓𝐈𝐌𝐄𝐒𝐓𝐀𝐌𝐏𝐒 (00:00) The Context Bottleneck (02:00) One Commit, One Tweet: The Origin (05:00) Feeding GPT-3 Your Private Data, Pre-RAG (08:00) From Quora to Uber's Self-Driving Lab (11:00) Meeting His Co-Founder at Uber ATG (14:00) Document Infrastructure for AI Agents (18:00) "RAG Is a Hack" — What He Meant (22:00) Why Production Search Is Still Unsolved (24:00) How a Research Background Changes How You Build (33:00) The Open Problem: Context Across Sources (38:00) Specs, Cultural Context, and Underspecified Tasks (40:00) What He'd Build Differently Today Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 2 🔄 0 ❤️ 4 👀 1065 📊 2 ⚡