Anthropic's Agent4Sci Benchmarks Coding Agents on Scientific ML
The scaffolding, not the model, roughly doubled the improvement — a design lesson for anyone building AI-scientist or agent systems. Builders of research agents can copy the three skill modules (ideation, experiment management, scheduled checklists) and benchmark against Agent4Sci's 20 tasks. The paper also exposes predictable agent failure modes, such as wasted compute and narrow local sweeps, that teams can check for directly.