Qdrant这篇讲怎么用语义缓存省API调用，相似问题直接回旧答案，不用每次检索生成，适合做聊天机器人的参考。
当用户反复询问退款政策这类同一问题时，每次请求都会触发一次完整的API往返。Qdrant指出，关键词缓存只能处理精确匹配，换一种问法就失效。语义缓存会把已问过的问题和对应答案存起来，新查询先做语义相似度匹配。相似度超过阈值就直接返回缓存答案，不再走检索和生成流程。详细做法可参考qdrant.tech上的指南。
You know you are hitting the API and making round trips again and again when a user asks the same qu...
You know you are hitting the API and making round trips again and again when a user asks the same question, like "what's the refund policy?" or "what are the conditions of a refund?" You might not have a cache layer built in, or if you do it's probably keyword-based, which only works on exact matches. In that case semantic cache can be useful. What semantic cache does is store previously asked questions along with their answers. When a new query comes in, it checks for semantic similarity against cached questions. If the similarity score is above a threshold, it returns the cached answer without going through retrieval and generation again. Same answer, no unnecessary API calls or retrieval round trips. You can learn more about how semantic cache works in practice in our guide: qdrant.tech/articles/seman… 💬 0 🔄 1 ❤️ 2 👀 120 📊 1 ⚡