Recursive Self-Improvement Applied to Frontier Pre-Training Run
The non-obvious takeaway is that RSI may pay off more in pre-training headroom than in post-training tricks, since a barely fine-tuned base beat fully post-trained rivals. Researchers running large-scale training pipelines and labs weighing agent-assisted data curation should study the loop decomposition and shared context store design. The model being open-weight and sized at 30B MoE makes it directly comparable for local deployment against Qwen3-30B-A3B and Nemotron-3.5-Lightning-30B-A3B.
