Mem0 发布 DolphinBench：用准确率、成本、延迟三维度评测智能体记忆

Today we are releasing DolphinBench: Mapping the Pareto frontier of agent memory. Coding, tool use,...

Today we are releasing DolphinBench: Mapping the Pareto frontier of agent memory. Coding, tool use, and long-context retrieval already have strong public benchmarks. Memory still mostly gets graded as a quiz: ask a question, judge the answer, maybe report precision and recall. DolphinBench grades that action after long history, and puts accuracy, cost, and latency on one board. dolphinbench.ai Deshraj Yadav @deshrajdry Today we are releasing DolphinBench: Mapping the Pareto frontier of agent memory. Coding, tool use, and long-context retrieval already have strong public benchmarks. Memory still mostly gets graded as a quiz: ask a question, judge the answer, maybe report precision and recall. A lot of those boards are getting saturated. They also skip the two questions that matter when you pick a memory system to ship: At what cost? At what latency? Agents are not taking memory quizzes but they take actions. The fact that matters is usually missing from the request. Either it shows up in the tool call, or the agent does the wrong thing while sounding fluent. DolphinBench grades that action after long history, and puts accuracy, cost, and latency on one board. dolphinbench.ai 🔗 View Quoted Tweet 💬 3 🔄 4 ❤️ 29 👀 2117 📊 9 ⚡