行业72°

Decagon CEO:企业开源采用率下降,是采用扩散前的信号

.@DecagonAI co-founder and CEO Jesse Zhang says enterprise open-source adoption is falling right now...

精选理由

CEO说开源推理占比下降是好事:新用例先用前沿模型,成熟后换开源省钱。Decagon九成业务跑开源。

AI 摘要

Decagon CEO Jesse Zhang 表示,企业开源模型采用率当前在下滑,开源推理占比正在走低,但这并非拒绝开源,而是采用扩散前的信号。企业启动新用例时会先用前沿模型,待流程跑通后,再迁移到更便宜、更快的开源模型。他透露 Decagon 自身 90% 的业务已运行在开源模型上。他还提到,客户支持需求永远超过供给,降低使用成本会带来更多购买。

图片来源 · a16z
原文 · a16z

.@DecagonAI co-founder and CEO Jesse Zhang says enterprise open-source adoption is falling right now...

. @DecagonAI co-founder and CEO Jesse Zhang says enterprise open-source adoption is falling right now, and that's a sign of adoption rather than rejection: "Even though there's a lot of hype for open-source, the share of open-source inference is actually going down right now." "People are spinning up all these new use cases, and if you're spinning up new use cases, of course you're gonna use the frontier models until they're working." "Once it's at that point, they're heavily incentivized to use open-source because it's way cheaper and faster." "Enterprises have a lot of desire to move, but they can only do so many use cases at once. There is inertia there, and they have to go through all the model risk governance and all the security things." "I think it'll take time, but it will get there." @thejessezhang Your browser does not support the video tag. 🔗 View on Twitter a16z @a16z A $100K/year customer gets white-glove treatment while a $10/year customer gets a help center. @DecagonAI 's bet is that AI closes that gap, and enterprise is buying it. Co-founders Jesse Zhang and Ashwin Sreenivas sit down with a16z's Kimberly Tan and Sarah Wang to discuss what they've learned running agents inside the biggest banks, airlines, and telcos: - Smart-vs-cheap models are a false trade-off - Start with frontier models on new use cases, then migrate to open-source after they mature - Fine-tuning per use case works at the application layer - Support demand always outran supply: make it cheaper and companies buy more of it 00:00 Intro 01:07 90% of Decagon runs on open-source 05:00 The smart vs. cheap trade-off is false 09:26 Building a model factory in-house 15:07 Are the labs the last startups? 21:21 Are forward deployed engineers a trap? 28:36 The agent that builds the agent 37:02 Glass box beats black box 47:55 From help desk to AI concierge 1:14:45 Jevons paradox in customer support @thejessezhang @AshwinSreenivas @kimberlywtan @sarahdingwang Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 0 🔄 1 ❤️ 7 👀 5383 📊 1 ⚡