Vercel给AI Gateway加上了用户预算功能,再也不怕实习生乱用API密钥爆单了。
Vercel为AI Gateway添加了按用户设置预算的功能,每用户预算可限制使用量。此前公司对AI代币的管理类似于提供无限制的AWS密钥,可能导致成本失控。新功能支持团队、项目和API密钥级别的预算管理,默认设置每月刷新周期。
Coding tokens are basically infrastructure. Yet, the way companies have approached them amounts to: ...
Coding tokens are basically infrastructure. Yet, the way companies have approached them amounts to: "Hey all, here's an AWS key. It can spin up anything from a 𝚝𝟹.𝚗𝚊𝚗𝚘 ($𝟹.𝟾𝟶/𝚖𝚘) to an 𝚙𝟻.𝟺𝟾𝚡𝚕𝚊𝚛𝚐𝚎 ($𝟺𝟶𝚔/𝚖𝚘). Go wild" And obviously the reason companies don't do this for their core infra is that you need to govern, optimize, and observe usage and costs. The intern might decide to host a static website in that 192 vCPU machine, and you won't be very happy about the bill. AI Gateway fixes this for all your tokens, with per-key, and now per-user budgets. Vercel Developers @vercel_dev Set per-user budgets on AI Gateway. ▲ ~/ 𝚟𝚌 𝚊𝚒-𝚐𝚊𝚝𝚎𝚠𝚊𝚢 𝚋𝚞𝚍𝚐𝚎𝚝𝚜 𝚍𝚎𝚏𝚊𝚞𝚕𝚝𝚜 \ 𝚜𝚎𝚝 𝚞𝚜𝚎𝚛 --𝚕𝚒𝚖𝚒𝚝 𝟻𝟶𝟶 \ --𝚛𝚎𝚏𝚛𝚎𝚜𝚑-𝚙𝚎𝚛𝚒𝚘𝚍 𝚖𝚘𝚗𝚝𝚑𝚕𝚢 vercel.com/changelog/set-… g team, project, and API key budgets. https://t.co/ipmYeiL8h1 🔗 View Quoted Tweet 💬 15 🔄 0 ❤️ 61 👀 7820 📊 15 ⚡