#提示词缓存

10 stories · 2 in 7 days · 5 in 30 days
Stories, products and papers tagged "提示词缓存", newest first.
Nov 3
IndustryBuildersMulti-sourceSelected14:49
Agent Arena finds top agents consume 93 input tokens per output token

The economics of agents are decided on the input side, not the output side, so cache discounts now shape which models are viable for long-running workflows. Builders choosing between Anthropic and Google DeepMind for agent deployments can use the session data to estimate real token spend before committing. The caching walkthrough with live sessions doubles as a practical cost-optimisation reference.

Event
lmarena.ai@lmarena_ai11 sourcesSource
ProductsBuildersMulti-sourceSelected14:44
Anthropic launches Message Threads beta for Claude Messages API

Threads cut upload overhead and latency for long-running agents, but they are not a cost-saving feature: billable tokens are identical and caching still has to be configured separately. Developers building computer-use or document-heavy agents benefit most, since screenshots and files no longer need re-uploading every turn. Teams with strict data retention or HIPAA requirements should hold off, and batch processing is not yet supported.

Event
宝玉@dotey11 sourcesSource
Oct 27
PapersBuildersMulti-sourceSelected10:42
Cachelint Detects Silent Prompt-Caching Bugs in LLM Agent Systems

The non-obvious takeaway is that caching bugs produce no errors at all — teams simply pay more per token while assuming caching works. Platform and backend engineers running agent workloads on OpenAI, Anthropic or other provider APIs can run CACHELINT on their own repos before costs accumulate. As an academic tool study with no pricing or regional availability angle, its closest comparison is other static-analysis approaches like CodeQL-based linting, which CACHELINT extends with provider-aware precondition checks.

Event
arXiv: Anthropic@Ying Zhang et al. (7)11 sourcesSource
Oct 21
Oct 15
Oct 1
Sep 23
Aug 5