Jerry Liu：定义评测再爬坡，比手写工作流更能解决任务
LlamaIndex 的 Jerry Liu 发了条推：别再手写 Agent 工作流了，先定义 eval 再优化，方向和标准比流程更重要。
LlamaIndex 创始人 Jerry Liu 提出，与其直接设计确定性的 Agent 工作流，不如先定义一个 eval，再针对它做 hillclimbing 优化。他认为数据提供商的核心工作是给各类经济活动定义 eval，让 frontier 模型胜任更多任务。多数任务可以压缩成目标和 eval 指令，只有最复杂的流程才需要显式的工作流搭建界面。
These days, you can pretty much solve any task by defining an eval and hillclimbing over it, instead of directly defining the deterministic/agentic workflow to solve it. The data provider companies' entire job is to define evals for all economic activity to make the frontier models capable of doing anything. Your job then becomes pointing frontier intelligence in the right direction - defining what to solve, and how to measure what good looks like. Agent application interfaces will evolve to capture this. The most complex processes will still need some sort of explicit workflow builder interface, but most tasks can be compressed into goals and eval instructions. 💬 5 🔄 0 ❤️ 5 👀 582 📊 6 ⚡
