#UC Berkeley

23 stories · 1 in 7 days · 6 in 30 days
Stories, products and papers tagged "UC Berkeley", newest first.
Nov 17
PapersBuildersSelected23:44
FrontierCS 2 benchmark tests agents on unpublished CS research

The interesting part is that agents can score well by exploiting evaluation loopholes rather than solving problems, a failure mode that affects every benchmark built for agentic research. Builders designing evals for coding or research agents should study the cost-versus-performance tradeoffs and exploit categories discussed here. Unlike standard code benchmarks such as SWE-bench, the closed-paper setup directly tests whether an agent can produce novel methods, not recall existing ones.

lmarena.ai@lmarena_aiSource
Nov 13
Nov 11
PapersBuildersSelected01:44
Berkeley study finds model routing saves 8.82X cost per quality

The gap between the theoretical 5.4-point router ceiling and the 0.3-point real-world gain reframes routing as a cost tool, not a quality tool. Teams building LLM applications, especially those balancing API budgets against output quality, can use the 25.5X coding-efficiency figure to justify routing to cheaper models for routine requests. The cross-domain benchmark coverage beyond language models makes the findings useful for robotics and multimodal pipelines too.

rohanpaul_ai@rohanpaul_aiSource
Nov 10
Chinese contentUC Berkeley 论文:Evolving Agent Teams 让编码智能体超越 FlashInfer 单体方案

做 GPU 内核优化或跑智能体集群的朋友可以看下。同样是调 MLA decode,固定 4 角色团队只有 FlashInfer 的 0.31 倍,加了会重组团队的 supervisor 就到 0.74 倍,预算放宽后甚至超过 FlashInfer。写多智能体工作流的人值得对照改设计。

rohanpaul_ai@rohanpaul_aiSource
Nov 7
Nov 1
Oct 16
PapersBuildersSelected10:24
UC Berkeley Paper Induces Forgetting to Scale Research Agents

Deliberate forgetting turns out to be the scaling lever, challenging the default of agents keeping full history and iterating on it. Researchers and agent builders running long-horizon automated tasks can apply the restart-from-best-candidate trick to their own pipelines with the same compute budget. The paper's code link and Chat with Paper tool are available via the post.

elvis@omarsar0Source
Oct 11
Oct 9
Oct 8
Oct 6
Sep 30
Sep 19
Aug 23
Aug 22
Jul 15
Jul 8
Jul 6
Jun 30
Jun 21
Jun 18