Vercel AI Gateway 新增置信度阈值兜底功能
精选理由
Vercel 给 AI Gateway 加了置信度兜底：主模型不确定时自动换备用模型重跑，做智能体的可以试试。
Vercel 推出 AI Gateway beta 新功能：当主模型输出的置信度低于开发者设定的阈值时，请求会自动 rerun 到一个 fallback 模型上重新决策。该功能面向智能体场景，用于大规模 AI 决策时降低不确定输出。开发者在 Vercel Developers 账号公告中确认目前以 beta 形式提供。
原文 · Guillermo Rauch
“Thinking fast and s̶l̶o̶w̶ a bit less fast under a confidence threshold.” A very simple feature that I think will be extremely impactful for at-scale AI decision-making. Vercel Developers @vercel_dev Your agents can now escalate uncertain decisions to a fallback model. AI Gateway reruns the decision on a fallback model when the primary model's confidence drops below your threshold. Available in beta. 🔗 View Quoted Tweet 💬 2 🔄 0 ❤️ 4 👀 775 📊 2 ⚡
