Anthropic 推出 Message Threads，长对话首 token 延迟降低 35%
Anthropic's Message Threads cut time to first token by 35 percent for long conversations
Anthropic 给 Messages API 加了 Message Threads，长对话不用每次重发全部上下文，百万 token 请求首 token 快了 35%，写长对话 Agent 的可以看看。
Anthropic 为 Messages API 发布 Message Threads 功能。以前每轮对话都要重发整个上下文，现在只需传输变化的部分。对于 50 万到 100 万 token 之间的请求，首 token 响应时间缩短约 35%。
Anthropic's Message Threads cut time to first token by 35 percent for long conversations
Anthropic released Message Threads for the Messages API. Instead of resending the entire conversation with every turn, agents now only transmit what's changed. For requests between 500,000 and one million tokens, time to first token drops by about 35 percent. The article Anthropic's Message Threads cut time to first token by 35 percent for long conversations appeared first on The Decoder .
