Simon Mo是vLLM作者，他讲开源权重模型怎么在成本和控制上赢过闭源API，还吐槽专有API宕机问题，适合做线上服务的开发者。
a16z官方账号发布访谈视频，vLLM维护者、Inferact CEO Simon Mo与合伙人Matt Bornstein讨论开源权重模型的价值。Simon Mo认为世界不能被专有API垄断，闭源模型成本过高，而开源权重允许企业自行控制基础设施、扩展模型或添加护栏。他提到，控制问题近两年一直重要，成本问题从近几个月开始凸显，例如语音智能体公司需要自有模型保证响应时间。访谈还提及vLLM目前在任意时刻运行于约50万块GPU上，并讨论了Kimi K3的发布与开源模型许可证变化。
Simon Mo and Matt Bornstein on why open-weight models matter: cost and control. "Open weight absolu...
Simon Mo and Matt Bornstein on why open-weight models matter: cost and control. "Open weight absolutely matters in the ecosystem. The world cannot just be controlled by proprietary APIs, where open weight, open development and research of these models are blocked or banned." "There's almost two pieces to this. There's the cost thing, where the closed models are too expensive, and then there's the control thing, where I want to be in control of my infrastructure and in control of the model. If I need to extend it or put on my own guardrails or anything." "Control matters a lot over the last few years, and then cost just started to matter over the last few months... It's about controlling the system performance against what they're paying for." "For a voice agent company, they want to control their own model so that it can make sure the model actually responds by the required time... This sometimes is only you can do with your controlled intelligence... versus signing up for relying on your critical infrastructure with a proprietary API where they might go down any time." @simon_mo_ @BornsteinMatt Your browser does not support the video tag. 🔗 View on Twitter a16z @a16z vLLM runs on half a million GPUs at any given moment. Most people have never heard of it. Simon Mo, co-founder and CEO of @inferact and lead maintainer of vLLM, sits down with a16z’s Matt Bornstein and Elena Burger to discuss what it takes to actually run open models in production, the advantages of open models, Simon’s mission at Inferact, and more. 00:00 Intro 01:46 When open source became critical infrastructure 08:55 Day zero model releases, and the drama behind them 14:59 What Kimi K3 actually buys you 18:56 Why open model licenses are changing 22:24 The pharmaceutical analogy for funding model training 26:16 If GPUs got 99% cheaper 29:08 Why vLLM, OpenRouter, and Ollama all started before ChatGPT 35:42 Building a company on an open source project 39:48 The inventor of RoPE removing RoPE @simon_mo_ @BornsteinMatt @VirtualElena Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 1 🔄 3 ❤️ 16 👀 7421 📊 2 ⚡