Artificial Analysis Makes Time per Task Its Headline Benchmark Metric
Benchmarking by task completion time rather than tokens per second changes how verbose models rank: GPT-6 Astra beats faster rivals because it emits about 50k output tokens per task versus 120k–170k for competitors. Default-effort data shows medium effort cuts task time 3–5x at a modest intelligence cost, which directly informs cost-sensitive API choices. Developers comparing models for agentic workloads should re-read leaderboards with this metric in mind.
