DolphinBench 发布：以动作正确性评测智能体记忆系统

Launching DolphinBench - agent memory benchmark that grades action after long history and measures a...

Launching DolphinBench - agent memory benchmark that grades action after long history and measures accuracy, cost and latency on one board. Deshraj Yadav @deshrajdry Today we are releasing DolphinBench: Mapping the Pareto frontier of agent memory. Coding, tool use, and long-context retrieval already have strong public benchmarks. Memory still mostly gets graded as a quiz: ask a question, judge the answer, maybe report precision and recall. A lot of those boards are getting saturated. They also skip the two questions that matter when you pick a memory system to ship: At what cost? At what latency? Agents are not taking memory quizzes but they take actions. The fact that matters is usually missing from the request. Either it shows up in the tool call, or the agent does the wrong thing while sounding fluent. DolphinBench grades that action after long history, and puts accuracy, cost, and latency on one board. dolphinbench.ai 🔗 View Quoted Tweet 💬 3 🔄 4 ❤️ 23 👀 1174 📊 6 ⚡