产品官方一手

OpenAI 上线 Prompt Caching 仪表盘,可追踪缓存命中率

See what’s being reused and what’s preventing cache hits. Track cache-hit rates in the new Prompt C...

精选理由

OpenAI 出了个缓存仪表盘,能直接看到你哪些 prompt 被复用了、哪次改动把缓存搞失效了,还给出受影响的 token 数,省钱利器。

OpenAI 在 platform.openai.com 推出 Prompt Caching Dashboard,开发者可以查看哪些 prompt 内容被复用、哪些改动导致缓存未命中。配套的 diagnostics API 能定位阻碍复用的具体变更,并估算受影响的 token 数量。该工具用于提升 prompt 缓存命中率、降低 token 消耗成本。

原文 · @OpenAIDevs

See what’s being reused and what’s preventing cache hits. Track cache-hit rates in the new Prompt C...

See what’s being reused and what’s preventing cache hits. Track cache-hit rates in the new Prompt Caching Dashboard on platform.openai.com . Use the diagnostics API to identify changes that prevented reuse and estimate how many tokens were affected. 💬 1 🔄 0 ❤️ 17 👀 1681 📊 3 ⚡