Latest

Every published item, in order · 1470 items
Oct 5
PapersBuildersSelected20:19
Nathan Baschez argues shared AI factories beat personal agents

The actionable shift is treating internal AI setup as shared infrastructure with a designated maintainer, rather than letting each employee tune private configurations. Teams building on Claude Code, Codex or agent frameworks can apply the Shared-Specific-Scrutinized checklist to decide which of their workflows deserve a factory. The 5x learning-curve concentration math also gives managers a concrete argument for budgeting maintenance time centrally.

shao__meng@shao__mengSource
PapersBuildersSelected01:08
GitHarness treats agent memory like a Git repository

Versioning requirement-to-work pairs solves the common failure where agents redo everything after one changed detail. Builders of agents that take iterative user feedback can adopt commit-and-branch memory to cut token costs and preserve valid work. The 73.6% token reduction on coding tasks gives a concrete benchmark to compare against your own agent's continuation baseline.

rohanpaul_ai@rohanpaul_aiSource
Oct 4
PapersBuildersSelected19:44
Google's VeriHarness Turns Agent Rollout Agreement Into Verification

Agreement among multiple rollouts is widely treated as a reliability signal, but this work shows it can mask correlated errors — a finding that affects how anyone builds best-of-n selection for agents. The verification-and-revision loop is practical to apply with existing frontier models, as the Gemini 3.5 Flash and Claude Opus 4.8 gains show. Teams building long-horizon agent pipelines can start from the released 26,000-rollout dataset.

Event
elvis@omarsar0Source
PapersBuildersMulti-sourceSelected19:02
NVIDIA paper on test-time compute for terminal agents

The result argues verifier quality, not sample count, is the real bottleneck in agentic terminal tasks, which reshapes how teams should budget inference tokens. Builders of coding agents and shell automation can adopt the Mid-Harness pattern without touching their existing generator or harness. The comparison between a large GPT-5.6 Sol verifier and a distilled TMAX-9B self-verifier gives practitioners a concrete cost-quality trade-off to replicate.

Event
DAIR.AI@dair_aiSource
Tomorrow 08:00, the daily lands in your inboxTelegram channel or email. Same screening as this page, no ads.
PapersBuildersSelected15:21
Microsoft paper ScholarEvolve evolves agent harnesses from research papers

The counterintuitive idea is that the literature, not runtime traces, is the highest-value source of harness improvements. Builders tuning agent scaffolds around a fixed model can replicate the module-and-topic-modeling loop with their own paper corpus instead of paying for a model upgrade. Results on AppWorld Challenge and Tau2-Bench Telecom give a concrete baseline for comparing it against failure-log-driven harness tuning.

elvis@omarsar0Source
PapersBuildersSelected13:44
ActiveSaddler boosts agent harness optimizers via adaptive scenarios

The key insight is that optimizer quality alone is not the bottleneck in agent harness training — scenario scheduling is, and treating failure patterns as a bandit problem recovers gains the fixed-order baseline leaves on the table. Builders training coding or task agents can apply the same scheduling idea without changing their optimizer. Compared with GAIA2's 4.4-point gain, the 7.5-point jump on Terminal-Bench 2.0 suggests the method helps most where failure modes are more diverse.

DAIR.AI@dair_aiSource
PapersBuildersSelected08:29
CMU Paper Trains RL Proposer to Improve Agent Harness Code

Harness learning points to a cheaper path to agent improvement: iterate on surrounding code with a small proposer model instead of retraining the solver, and the 4B-beats-35B result shows small models can specialise well here. Builders working on agent pipelines can apply the same edit-test-reward loop to their own harnesses. The companion Chat with Paper tool at academy.dair.ai makes the method easy to explore hands-on.

Event
elvis@omarsar0Source
PapersBuildersSelected07:44
Meta's RankEvolve Enforces Reliable Auto-Research With Claude Code and Codex

The cross-review architecture matters more than any single score: silent bugs like leaked eval data or disconnected gradients can invalidate hours of training and every iteration built on it. Teams letting coding agents run ML experiments can adopt the compiled-protocol gate pattern with their existing Claude Code or Codex setups. The 16.7-point accuracy jump from pairing two products suggests redundancy is a practical reliability lever.

DAIR.AI@dair_aiSource
PapersBuildersSelected06:44
Meta, Duke paper splits agent harness tuning into specialized branches

The result suggests that betting on a single auto-tuned harness leaves accuracy on the table; specialization plus routing captures strengths that a unified search converges past. Builders who auto-tune agents should maintain several harnesses and route between them rather than picking one winner. The comparison against Meta-Harness on Gemini 3 Flash gives a concrete baseline for benchmarking your own agent stack.

rohanpaul_ai@rohanpaul_aiSource
PapersBuildersSelected05:24
AgentBug-Smith Benchmark Shows Coding Agents Miss Most Agent Bugs

Agent code fails differently from ordinary software because bugs depend on live model calls, so standard coding benchmarks overstate how reliable agents are at debugging themselves. Anyone building self-improving or autonomous agent systems should benchmark tools on bugs they have already fixed before delegating agent-harness maintenance. The 200-bug growing benchmark offers a ready-made starting point for that evaluation.

rohanpaul_ai@rohanpaul_aiSource
PapersBuildersSelected05:01
ERRC Optimizes Tensor-Parallel LLM Communication in PyTorch

Instead of treating communication compression and quantization error as separate problems, ERRC recycles bandwidth savings to correct quantization drift, a trade-off most serving stacks ignore. Engineers running multi-GPU inference on tensor-parallel setups can look to it as an alternative to simply adding bandwidth or dropping quantization precision. The poster session at PyTorch Conference on 20-21 October 2026 in San Jose is where the implementation details will surface.

Official accountPyTorch@PyTorchSource
PapersBuildersSelected01:29
AutoCompact trains agents to decide when to compact context

The notable shift is model-harness co-design: instead of hard-coded rule-based compaction, the model learns when to invoke it — part of a broader trend including AutoHarness and AutoContext. Builders of agent frameworks can compare this learned approach against the rule-based compaction already packaged in harnesses, and the arXiv paper (2610.02163) details the judge-then-RL pipeline for replication.

elvis@omarsar0Source
PapersBuildersSelected01:29
Meta Labs Paper Finds Base LLMs Beat RL Post-Trained Models at Scale

Post-training raises single-shot reliability while shrinking the ceiling of what test-time compute can reach, a trade-off most teams never measure. Builders choosing between base and RL-tuned models for agentic pipelines can use the paper's few-rollout estimate to decide when extra sampling beats extra training. PTGS offers a concrete fix for labs running their own RL pipelines.

elvis@omarsar0Source
PapersBuildersSelected73°00:21
Meta Superintelligence Labs Sharpening Tax

This research reveals a fundamental trade-off in AI model training that challenges conventional wisdom about post-training benefits. The Sharpening Tax phenomenon suggests that for certain complex, multi-turn tasks, less-trained models may actually outperform their refined counterparts, offering a new perspective on model optimization strategies. Developers and researchers working with large language models should consider this finding when designing training pipelines, especially for applications requiring broad task coverage rather than just single-task success rates.

DAIR.AI@dair_aiSource
Oct 3
Oct 2
PapersBuildersMulti-sourceSelected76°23:51
NVIDIA Long-Transduction Agents Study

This research reveals critical limitations in current AI agent capabilities that developers must account for when building long-running applications. The significant accuracy drops at longer context lengths suggest practical constraints for enterprise implementations requiring sustained task performance. Developers should consider these findings when designing agent workflows that maintain state across thousands of operations, particularly for financial or data-intensive applications.

Event
DAIR.AI@dair_aiSource
PapersBuildersSelected73°23:16
Alternative Compute in AI Research

This exploration of alternative compute methods signals potential shifts in AI hardware development as traditional GPU efficiency plateaus. Researchers and developers should pay attention to these emerging approaches that could redefine computational paradigms, particularly those working on next-generation AI systems or facing current hardware limitations. The comparison between digital, optical, and biological computing offers insights into future architectural directions.

Y Combinator@ycombinatorSource
PapersBuildersSelected73°20:56
LLM context change study reveals attention drift

This reveals a critical flaw in how LLMs handle dynamic information, potentially causing errors in real-world applications where preferences change frequently. Developers building agents that track changing data should explicitly include current state in prompts rather than relying on models to parse through context history.

rohanpaul_ai@rohanpaul_aiSource