AI产品精选

Vercel AI Gateway宣称TTFT最快,冷热启动均领先

Vercel AI Gateway is the fastest way to get tokens, cold or hot, across the board. DMs open if you ...

精选理由

Vercel放出了AI Gateway的TTFT基准,冷热启动都最快,还开源了测试代码,想比一比可以去跑。

AI 摘要

Vercel AI Gateway在首个token时间(TTFT)基准测试中表现最佳,无论冷启动还是热启动。开源基准测试由Ronny Badilla发布,结果显示Vercel在端到端延迟上胜出,而Cloudflare和OpenRouter在连接阶段(DNS+TCP+TLS)更快。开发者可根据工作负载选择不同网关。

原文 · Guillermo Rauch

Vercel AI Gateway is the fastest way to get tokens, cold or hot, across the board. DMs open if you ...

Vercel AI Gateway is the fastest way to get tokens, cold or hot, across the board. DMs open if you need help migrating or benchmarking your current solutions. Ronny Badilla @rbadillap Full picture: My table showed cold connection setup (DNS+TCP+TLS). Real and reproduced. But setup ≠ end-to-end. Same model, same prompt, interleaved runs: @vercel wins TTFT from here, cold or warm. @cloudflare and @openrouter win the connection phase, which is what short-lived CLI/desktop processes feel most. Both things are true. Both statements are true, you may want to pick per workload. Open sourced my benchmark if you want to reproduce it from your region: github.com/rbadillap/ai-g… 🔗 View Quoted Tweet 💬 10 🔄 1 ❤️ 26 👀 5722 📊 9 ⚡

Vercel AI Gateway宣称TTFT最快,冷热启动均领先 · AI 热点