#DolphinBench

5 stories · 0 in 7 days · 0 in 30 days
Stories, products and papers tagged "DolphinBench", newest first.
Sep 23
ProductsBuildersMulti-sourceSelected73°03:55
DolphinBench grades agent memory by action, cost and latency

Memory benchmarks that judge answers rather than actions reward fluency while hiding real shipping trade-offs; DolphinBench's three-axis scoring makes cost-versus-latency comparisons visible when choosing between memory backends. Builders picking a memory layer for production agents can use it to weigh accuracy against infrastructure spend and response time. It sits alongside existing public boards for coding and long-context retrieval rather than replacing them.

Event
Taranjeet@taranjeetio3 sourcesSource
ProductsBuildersMulti-sourceSelected73°02:06
Mem0 releases DolphinBench for agent memory evaluation

Memory benchmarks have mostly measured recall on quiz-style questions, ignoring the cost and latency trade-offs that decide what teams actually ship. DolphinBench scores downstream actions after long histories, so results better reflect real agent behaviour. Builders choosing a memory layer for production agents can use it to compare systems on all three axes at once.

Event
mem0@mem0ai3 sourcesSource
PapersBuildersMulti-sourceSelected02:04
Mem0 Releases DolphinBench Memory Benchmark

A dedicated memory benchmark from Mem0 gives teams a standard way to compare long-term memory layers across agents and chat systems instead of relying on vendor self-reports. Builders choosing a memory backend can check the leaderboard and submit their own configurations via the hosted run page. The open dataset and code make results reproducible for anyone evaluating agent stacks.

Event
mem0@mem0ai3 sourcesSource
Sep 22