NVIDIA adds 1/2 DPO training to NeMo Megatron Bridge
Offline reference scoring turns DPO from a two-model job into a one-model job, roughly halving memory and removing per-step reference overhead during preference tuning. Teams running preference optimisation on Megatron-scale models can reuse one scoring pass across full hyperparameter sweeps, cutting GPU hours. It matters most for builders fine-tuning large models where a second reference copy was previously the bottleneck.
