Cost per task 将成为未来12个月的重要度量

Cost per task is going to be a meaningful metric these next 12 months.

精选理由

别只看 token 单价了,朋友。同样跑15个任务,Haiku 比 Opus 贵10倍。这提醒我们,算成本要看任务总花费。

AI 摘要

Suhail 指出未来12个月“每任务成本”将是更有意义的指标。Alex Atallah 以 Terminal-Bench 为例,用 Claude Haiku 和 Opus 运行15个任务子集,结果显示 Haiku 成本是 Opus 的10倍,说明价格/代币不等于成本/任务。这提醒开发者关注实际任务开销而非单价。

原文 · Suhail

Cost per task is going to be a meaningful metric these next 12 months.

Cost per task is going to be a meaningful metric these next 12 months. Alex Atallah @alexatallah On price/token != cost/task: To help internalize this fact for yourself, run Terminal-Bench using Haiku and then using Opus. Here are the results for a 15-task subset. Haiku is 10x the cost! 🔗 View Quoted Tweet 💬 4 🔄 1 ❤️ 9 👀 1812 📊 4 ⚡