PapersSelected

Meta's RankEvolve Enforces Reliable Auto-Research With Claude Code and Codex

Why we picked it

The cross-review architecture matters more than any single score: silent bugs like leaked eval data or disconnected gradients can invalidate hours of training and every iteration built on it. Teams letting coding agents run ML experiments can adopt the compiled-protocol gate pattern with their existing Claude Code or Codex setups. The 16.7-point accuracy jump from pairing two products suggests redundancy is a practical reliability lever.

Meta published a paper introducing RankEvolve, a system for reliable auto-research agents that runs ML experiments autonomously.

Body

RankEvolve enforces each research phase and gate through a compiled protocol, and runs Claude Code and Codex as separate nodes that review and repair each other's changes.

At a matched budget, combining the two products raises execution accuracy from 45.8% for the best single product to 62.

5%.Over twelve iterations on the open-source HSTU recommender, it improved NDCG@10 on MovieLens-20M by 4.

48% over the published result.

Original · DAIR.AI

Must-read paper from Meta on reliable auto-research agents.

If you let coding agents run ML experiments, one silent bug like leaked eval data or a disconnected gradient can invalidate hours of training and every iteration built on it.

RankEvolve enforces each research phase and gate through a compiled protocol. It runs Claude Code and Codex as separate nodes that review and repair each other's changes.

At a matched budget, combining the two products raises execution accuracy from 45.8% for the best single product to 62.5%.

Over twelve iterations on the open-source HSTU recommender, it improved NDCG@10 on MovieLens-20M by 4.48% over the published result.

Paper: https://t.co/HzlsOulc5D

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Papers" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include RankEvolve, Claude Code, Codex, Meta.

Source attribution: curated from DAIR.AI (@dair_ai).