Vals AI进行无限代币实验
Vals AI花了150万测试AI工具使用,发现Devin很省代币,教你如何智能选择AI工具而不破产。
Vals AI CEO Rayan Krishnan进行了一项为期一个月的代币最大化实验,团队工程师每天消耗10亿至20亿代币,总花费约150万美元。
这一支出相当于当月员工薪资的10倍。实验发现Cognition Devin工具代币效率很高,公司已决定更多采用。
订阅模式相比代币计价能获得更好的价格模型。
Vals AI CEO Rayan Krishnan on the unlimited tokens experiment that revealed an anxious obligation for engineers to use models all the time, everywhere: "I wanted to do a tokenmaxxing experiment. I was able to get unlimited access for our team for a month for some of the coding tools. We had a lot of engineers spending between one to two billion tokens a day." "I went back and did some math, and it looked like in that month, we spent roughly $1.5 million worth of tokens... It was actually 10x more we were spending in tokens than employee salary for that month." "We cannot continue with this mode of operation for the next month. How do we intelligently figure out what are the right tools we should use, for what teams, and what projects?" "We found some pretty surprising insights. The Cognition Devin tool is actually very token-efficient, and so that's a place we've chosen to adopt more." "There are a lot of places where you can get better pricing models out of subscriptions as opposed to token-based pricing." "It's actually informed our strategy for how we can effectively tokenmaxx without spending $1.5 million per month." @RayanKrishnan @JenniferHli
This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Vals AI, Devin, 代币效率, AI成本.
Source attribution: curated from a16z (@a16z).