模型路由是 AI 应用落地的关键杠杆,做 AI 产品/Agent 的团队可以直接借鉴——用更少的钱跑出更好的效果,建议点开看看具体怎么实现。
LlamaIndex 创始人 Jerry Liu 指出,初创公司相比前沿实验室的一个核心优势在于模型路由(model routing)能力。随着开源和闭源模型在成本-性能曲线上形成健康分布,初创公司可以通过为每个任务精准选择最合适的模型,在保持前沿性能的同时将成本和延迟降低 2-10 倍。Factory 推出的模型路由功能正是这一理念的实践,能自动为每个任务选择最佳模型,削减 25% 成本。这一策略让初创公司能够优化模型组合,实现更高的效率。
This is actually one of the main advantages startups have over frontier labs, as long as there's a h...
This is actually one of the main advantages startups have over frontier labs, as long as there's a healthy spectrum of open-weight to closed-weight models on the cost-performance curve. Building a model harness is fundamentally a bit different than building the underlying model. The last year has shown that an increase in model capabilities has led to an increase in sophistication around agent harnesses as well (e.g. just look at Claude Code ultracode) Every startup has a meaningful advantage here - from Factory to Cognition to honestly us - if they're able to optimize and finetune the model set for the precise amount of intelligence needed to do a task. Same or higher accuracy at 2-10x lower cost and latency is a real advantage. Factory @FactoryAI Introducing model routing to Factory. Factory Router picks the right model for every task, automatically. Maintain frontier performance while cutting costs by 25%. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 5 🔄 4 ❤️ 29 👀 2608 📊 9 ⚡