Latest

Every published item, in order · 9845 items
Nov 9
Tomorrow 08:00, the daily lands in your inboxTelegram channel or email. Same screening as this page, no ads.
PapersBuildersSelected07:42
Turtle Evolves AppWorld Tasks Into Harder Benchmarks

Saturated benchmarks lose their ability to separate models, and TURTLE offers a cheaper path than building new tests from scratch. Practitioners evaluating tool-use or agent models can apply the evolution pipeline to refresh existing benchmarks against their own target model, keeping failure signal alive. The 52.5% versus 19.8% hardness rating quantifies how much headroom task mutation adds.

rohanpaul_ai@rohanpaul_aiSource
PapersBuildersSelected05:30
Amazon paper finds tax and legal benchmarks misgrade correct AI answers

Benchmark scores on rule-following tasks may reflect grading bugs rather than model weakness, so leaderboard gaps deserve scrutiny before drawing conclusions. Teams evaluating models on tax, legal or compliance tasks should read scorer code and manually inspect a sample of failed answers before trusting low numbers. The paper's audit method, tracing references to source rules, offers a reusable checklist for anyone relying on public benchmarks.

rohanpaul_ai@rohanpaul_aiSource
PapersBuildersSelected71°05:07
Yann LeCun Clarifies the Difference Between JEPA and JEA

The real takeaway is a taxonomy: JEA methods like DINO and Barlow Twins suit symmetric view-matching, while JEPA's predictor targets corrupted-input or temporal prediction, with an action variable making it a world model. Researchers comparing self-supervised approaches or building world models get a concise map of which loss function fits which task.

Official accountYann LeCun@ylecunSource
PapersBuildersSelected01:17
Evolver Reuses Agent Trajectories to Improve Task Success

The key implication is that harness-level memory can outperform parameter tuning: agents get better purely by reusing learned procedures, making this applicable to any existing model deployment. Practitioners building coding agents or evaluation pipelines can adopt the Gene-asset pattern to cut token costs. Terminal-Bench 2.1 and SWE-bench Multilingual results give concrete baselines for comparing against their own harness setups.

elvis@omarsar0Source
PapersBuildersSelected00:07
Meta's ABTest Agent keeps LLMs away from A/B test numbers

The real lesson is architectural: reliability came from constraining the agent, not from a smarter model, with every number produced by validated code. Teams building analytics or experiment agents should pre-register success metrics so the agent cannot help p-hack, and route all computation through audited tools. Meta's design shows what enterprise-grade agent guardrails look like in practice.

rohanpaul_ai@rohanpaul_aiSource
PapersBuildersSelected00:07
Salesforce paper shows RL experts merged beat external teacher distillation

The finding flips a common assumption that dense teacher feedback is the compute-efficient path, showing the teacher's per-token forward pass overhead usually outweighs its benefit. Teams training domain-specific models can instead run RL per domain and merge experts, cutting compute by roughly 42%. Practitioners weighing teacher choice or FLOP budgets for math and code training get a concrete decision rule.

rohanpaul_ai@rohanpaul_aiSource
Nov 8
PapersBuildersSelected23:53
Tsinghua TraceMRT attack evades chain-of-thought monitors on SHADE-Arena

The finding suggests that faithfulness of chain-of-thought monitoring depends heavily on how attacks are framed, not just on the monitor's model. Teams deploying CoT monitors should red-team them with task-specific, goal-integrated attacks rather than generic templates, and score both whole traces and individual actions. The Bayesian scoring approach offers a concrete, replicable detection upgrade for safety engineers.

rohanpaul_ai@rohanpaul_aiSource
PapersBuildersSelected21:26
Shanghai Jiao Tong Builds AutoDNA Lab for Autonomous Molecular Biology Experiments

Most autonomous labs bolt AI onto pre-configured instruments; AutoDNA's model-experiment-instrument co-design instead makes the hardware natively callable by agents, a distinction that matters for anyone building embodied lab automation. Research groups running wet-lab pipelines or instrument vendors designing robot interfaces can study its atomic-service abstraction and multi-agent task decomposition. The Nature homepage coverage signals strong institutional endorsement.

IT之家Source
PapersBuildersSelected12:10
KOSMOS Self-Scheduling Kernels Speed Up Training on AMD GPUs

Fixed-role fused kernels leave idle windows because a predetermined communication-compute split cannot track actual data readiness; KOSMOS replaces static schedules with demand-ordered queues that adapt at runtime. Engineers training large MoE models on AMD Instinct hardware can apply it directly through Megatron-LM, where it outperforms DeepEP by up to 1.83x on DeepSeek-V3 and Qwen3-235B proxies.

arXiv: DeepSeek@Alexander Magro et al. (4)Source
PapersBuildersSelected03:53
Yann LeCun Explains Why JEPA Research Papers Differ From Meta Models

The thread lays out a taxonomy of SSL methods — predictor presence, anti-collapse criterion, augmentation scheme — that helps readers place any new 'JEPA' paper in the right context. Researchers deciding which papers to cite or reproduce will find it a concise map of what academic work can and cannot demonstrate. The core distinction between method discovery and resource-heavy scaling applies far beyond the JEPA family.

Official accountYann LeCun@ylecunSource
PapersBuildersSelected02:51
Oxford paper finds frontier LLM agents fail cross-vendor coordination

The practical implication is that agent interoperability breaks down not from capability gaps but from unstated conventions, so inter-agent protocols may need explicit shared norms rather than smarter models. Teams building multi-agent systems that span different vendors should add instructions telling agents to avoid unstated conventions and prefer actions any partner can read correctly. The finding applies to anyone chaining GPT-5.2 and Gemini 3 Pro agents together today.

rohanpaul_ai@rohanpaul_aiSource
Nov 7
PapersBuildersSelected23:48
Google Paper: ReproBridge Lifts Agent Reproduction Success to 92.6%

The practical implication is that pipeline artifacts, not model choice, explain most reproduction failures — teams can capture setup steps from a first successful run instead of paying for a larger model. Builders running coding agents on research repos can apply this immediately via the arXiv paper (2611.08452) and the accompanying Chat with Paper tool from dair.ai. Compared with raw repo reruns, the packaged approach also lowers API spend by 19.7%.

Event
elvis@omarsar0Source

Only the latest 2000 items are listed; for older ones see the daily archive